-- Logs begin at Mon 2022-05-09 14:25:34 UTC, end at Mon 2022-05-09 16:32:02 UTC. -- May 09 15:01:25.946240 dv-cinder-841125-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 15:01:25.953830 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 15:01:25 2022] *** May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: nodename: dv-cinder-841125-1-iscsi May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: machine: x86_64 May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: clock source: unix May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: pcre jit disabled May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: detected number of CPU cores: 4 May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: current working directory: / May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: detected binary path: /usr/bin/uwsgi-core May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: your processes number limit is 47680 May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: your memory page size is 4096 bytes May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: detected max file descriptor number: 2048 May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: lock engine: pthread robust mutexes May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: thunder lock: enabled May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 15:01:25.959803 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 15:01:26.005156 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: Python main interpreter initialized at 0x55d93cc589c0 May 09 15:01:26.005156 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: python threads support enabled May 09 15:01:26.005156 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: your server socket listen backlog is limited to 100 connections May 09 15:01:26.005156 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: your mercy for graceful operations on workers is 90 seconds May 09 15:01:26.005537 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: mapped 403077 bytes (393 KB) for 2 cores May 09 15:01:26.005616 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: *** Operational MODE: preforking *** May 09 15:01:26.005864 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: *** uWSGI is running in multiple interpreter mode *** May 09 15:01:26.005864 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: spawned uWSGI master process (pid: 80117) May 09 15:01:26.006080 dv-cinder-841125-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 15:01:26.006886 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: spawned uWSGI worker 1 (pid: 80127, cores: 1) May 09 15:01:26.006978 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: spawned uWSGI worker 2 (pid: 80128, cores: 1) May 09 15:01:26.007120 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 15:01:31.851960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:01:31.851960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: from cryptography.utils import int_from_bytes May 09 15:01:31.853264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:01:31.853264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: from cryptography.utils import int_from_bytes May 09 15:01:31.862730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:01:31.862730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: from cryptography.utils import int_from_bytes May 09 15:01:31.864539 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:01:31.864539 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: from cryptography.utils import int_from_bytes May 09 15:01:31.908311 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:01:31.908534 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:01:31.908673 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] command line args: [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:01:31.908998 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:01:31.909640 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ================================================================================ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:01:31.909901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] admin_token = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.910149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] config_dir = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.910334 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.910516 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] config_source = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.910694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] debug = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.910894 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] log_config_append = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] log_dir = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] log_file = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913668 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913668 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913668 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913668 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.913890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.914243 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.914243 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.914533 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.914740 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.914935 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.915125 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.915358 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.915602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.915882 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.916181 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.916648 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.916845 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] publish_errors = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.917053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.917268 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.917472 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.917671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.917907 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.918143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] standard_threads = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.918353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.918589 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.918781 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.918976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] use_journal = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.919135 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] use_json = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.919305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] use_stderr = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.919484 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] use_syslog = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.919618 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.919892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.920143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.920391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.920626 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.920872 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.921108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.921355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.921591 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.921787 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:01:31.921962 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.922106 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:01:31.922237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.922377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] command line args: [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:01:31.922504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.922645 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:01:31.922780 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.922917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ================================================================================ {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:01:31.923054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.923189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] admin_token = **** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.923324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.923459 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] config_dir = [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.923459 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.923717 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.923884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] config_source = [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.924021 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.924169 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] debug = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.924305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.924961 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.925152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.925290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.925290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.925602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.925740 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.925871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.926004 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.926133 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.926266 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] list_limit = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.926414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.926544 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] log_config_append = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.926678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.926808 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.926937 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.927070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] log_dir = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.927210 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.927346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] log_file = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.927475 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.927603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.927730 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.927900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.928039 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.928179 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.928306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.928440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.928440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.928686 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.928822 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.928955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.929083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.929210 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.929337 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.929473 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.929608 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.929751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.929880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.930008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.930139 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.930429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.930569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.930698 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.930826 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.930961 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.931098 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.931247 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.931377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.931506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.931506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.931815 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.931972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.932105 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] publish_errors = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.932238 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.932374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.932503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.932638 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.932773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.932901 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.933036 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.933165 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.933292 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.933431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.933571 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.933699 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] standard_threads = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.933827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.933960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.934089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.934229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.934229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.934471 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.934605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] use_journal = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.934733 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.934861 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] use_json = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.934861 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] use_stderr = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.935120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.935250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] use_syslog = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.935394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.935524 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:01:31.935652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.935822 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.935959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.936088 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.936216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.936343 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.936471 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.936676 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.936808 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.936942 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.937071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.937216 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.937352 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.937493 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.937623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.937751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.937879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.938014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.938144 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.938286 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.938417 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.938545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.938672 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.938800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.938932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.939080 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.939216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.939346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.939480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.939610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.939737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.939914 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.940047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.940218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.940348 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.940515 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.940678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.940822 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.942160 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.942361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.942598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.942769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.942999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.943207 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.943373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.943568 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.943819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.943988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.944182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.944990 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.945228 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.945430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.945430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.945866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.946068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.946267 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.946434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.946627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.946820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.947049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.947253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.947453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.947618 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.947818 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.947996 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.948142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.948286 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.948460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.948603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.948834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.949061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.949322 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.949322 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.949597 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.949737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.949870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.949999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.950128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.950257 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.950398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.950569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.950704 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.950834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.951000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.951136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.951275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.951413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.951545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.951675 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.952777 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.952923 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.953162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.953607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.953745 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.953898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.954034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.954165 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.954306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.954438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.954567 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.954697 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.external = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.954938 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.955091 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.955234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.955366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.955498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.955641 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.955856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.955995 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.password = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.956209 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.956344 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] auth.token = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.956475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.956604 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.956734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.956863 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.957000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.957132 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.957262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.957391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.957531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.957668 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.957807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.957807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.958052 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.958181 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.958320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.958320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.958589 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.958589 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.958863 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.958995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.959124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.959255 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.959401 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.959532 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.959670 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.959819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.959956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.960087 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.960226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.960358 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.960496 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.960627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.960756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.960886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.961014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.961154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.961292 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.961424 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.961554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.961684 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.961820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.961961 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.962103 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.962234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.962364 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.962494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.962623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.962765 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.962925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.963077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.963218 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.963350 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.963350 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.963597 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.963733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.963955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.963955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.964233 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.964233 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.964233 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.964233 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.964233 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.964829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.964972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.965110 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.965242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.965378 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.965517 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.965649 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.965779 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.965908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.966044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.966175 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.966313 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.966444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.966581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.966724 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.966854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.966854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.967107 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.967239 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.967369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.967507 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.967507 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.967797 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.967949 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.968081 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.968211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.968342 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.968472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.968612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.968752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] auth.external = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.968884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.969020 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.969152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.969282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.969414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.969553 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.969684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.969815 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] auth.password = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.969946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.970075 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] auth.token = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.970205 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.970353 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.970485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.970625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.970755 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.970886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.971016 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.971224 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.971897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.972041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.972172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.972304 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.972433 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.972574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.972707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.972849 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] credential.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.972980 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.973111 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.973242 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.973380 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.973513 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.973642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.973772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.973902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.974040 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.974179 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.974321 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.974452 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.974596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.974727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.974857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.974997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.975129 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.975259 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.975389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.975520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.975650 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.975832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.975972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.976104 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.976234 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.976365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.976506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.976648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.976780 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.976911 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.977041 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.977171 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] federation.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.977301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.977440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.977573 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.977714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.977846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.977975 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.978113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.978246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.978390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.978521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.978652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.978782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.978921 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.979053 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.979184 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.979314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.979444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.979574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.979713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.979867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.979999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.980140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.980272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.980402 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.980544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.980676 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.980807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.980938 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.981068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.981198 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.981337 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.981469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.981599 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.981766 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.982053 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.982192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.982325 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.982456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.982587 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.982716 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.982846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.983033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.983166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.983296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.983427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.983557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.983686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.983927 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.984064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.984195 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.984326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.984457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.984587 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.984734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.984866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.984996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.985126 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.985263 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.985403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.985548 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.985681 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.985821 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.985951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.986080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.986210 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.986349 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.986481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.986612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.986742 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.986873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.987033 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.987671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.987865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.988004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.988145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.988276 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.988407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.988548 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.988682 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.988822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.988993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.989126 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.989257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.989396 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.989529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.989660 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.989791 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.989921 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.990063 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.990202 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.990334 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.990465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.990594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.990594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.990842 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.990981 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.991113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.991244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.991374 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.991504 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.991781 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.991941 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.992094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.992226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.992356 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.992487 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.992626 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.992758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.992889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.993019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.993149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.993279 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.993417 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.993549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.993680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.993820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.993952 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.994083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.994222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.994354 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.994484 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.994620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.994753 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.994883 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.995022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] role.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.995160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.995292 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] role.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.995423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.995553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.995694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.995872 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.996008 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.996138 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.996268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.996398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.996528 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.996666 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.996798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.996929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.997060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.997190 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.997320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.997468 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.997600 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.997730 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.997869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.998005 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.998142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.998356 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.998498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.998636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.998772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.998908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.999046 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.999192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.999331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.999331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.999606 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.999744 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:31.999923 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.000073 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.000215 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.000353 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.000489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.000626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.000762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.000907 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.000907 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.001168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.001317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.001455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.001592 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.001737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.001876 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.002019 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.002160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.002298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.002434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.002610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.002758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.003036 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.003036 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.003384 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.003545 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.003686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.003686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004290 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004579 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004716 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.004989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] resource.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.005460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.005615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.005753 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] token.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.005890 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006161 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.006989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.007254 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.007391 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.007539 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.007676 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.007832 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.007986 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] role.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.008126 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.008262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] role.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.008398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.008536 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.008673 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.008817 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.008956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.009093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.009230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.009365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.009511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.009659 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.009797 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.009971 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.010113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.010249 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.010385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.010530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.010669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.010806 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.010943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.011087 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.011233 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.011527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.011664 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.011853 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.011992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.012135 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.012275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.012689 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.012826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.012962 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.013098 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.013243 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.013391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.013528 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.013663 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.013800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.013936 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.014080 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.014219 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.014355 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.014491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.014630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.014765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.014911 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.015048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.015196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.015196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.015455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.015591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.015591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.015935 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016074 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016210 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016210 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] token.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.016469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.017623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.connection = **** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.019162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.021577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.021577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.021577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.021577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.021577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.021577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:01:32.021577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:01:32.029664 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.029960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.030121 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.033218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.033444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.033657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.040842 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.047098 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.073312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.073645 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.078790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.078790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.130266 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.130758 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.192972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.193303 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.204672 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.204867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.273233 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.273621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.273953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.274282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.274629 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.274955 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.276936 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.277169 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.277394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.277615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.277832 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.278045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.301387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.301769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.302107 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.302454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.302834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.303154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.303241 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.303475 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.303620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.303706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.303939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.304156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.304370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.304584 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.316414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.317281 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.332805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.333117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.333266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.333399 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.333529 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.333529 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.333769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.333911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.333911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.334164 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.334289 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.334415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.334626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.334904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:01:32.352968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.353268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:01:32.353676 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.353953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:01:32.354293 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.354624 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.354951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.355275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.355520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.355520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:01:32.355843 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.356018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:01:32.356283 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.356540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.356793 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.357047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.367514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.367901 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.368245 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.368478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.368665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.368799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.369014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.369295 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.377085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.377982 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.380654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.381077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.381427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.381560 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.381704 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.381984 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.382112 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.382381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.382657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.382789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.382930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.383183 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.383590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.383955 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.384137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.384365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.384491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.384653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.384829 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.385039 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.385236 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.413621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.415343 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.415532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.415790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.417203 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.417487 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.421447 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.421805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.422154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.423286 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.423565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.423886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.431040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.431405 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.431839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.432127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.436260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.436622 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.436971 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.437322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.437667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.438009 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.438347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.438589 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.438748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.438892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.439147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.439428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.439700 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.439999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.440379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.440906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.459683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.460081 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.461034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.461325 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.464871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.466401 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.468752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.469123 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.470043 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.470340 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.474714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.476361 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.478462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.481696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.482366 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.482738 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.483092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.483448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.483821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.484174 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.485440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.485738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.486467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.486742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.487581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.505687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.506169 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.506511 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.506852 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.507421 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.507909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.508381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.508860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.515682 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.517436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.517575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.517844 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.519196 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.519470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.521185 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.521543 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.521906 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.522271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.522623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.523898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.524182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.524579 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.525070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.525512 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.537561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.537926 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.538280 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.538645 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.538995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.539346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.539692 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.540381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.540677 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.540956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.541245 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.541522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.541805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.542075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.559133 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.561143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.562695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.564839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.567531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.568878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.570472 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.570656 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.572114 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.572395 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.572682 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.574058 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.574664 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.575265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.580623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.582409 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.583674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.585353 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.585619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.585904 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.586186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.586460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.588976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.589336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.589690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.590042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.595624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.595944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.596225 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.600149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.600526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.600881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.605918 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.606360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.606651 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.606928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.607201 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.607658 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.607990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.610964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.610964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.610964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.610964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.610964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.610964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.611718 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.611880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:01:32.611880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.611880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.611880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.611880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.611880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.613117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.613329 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.613683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.614022 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.614360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.614700 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.615046 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.615375 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:01:32.657229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d93cc589c0 pid: 80127 (default app) May 09 15:01:32.658715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d93cc589c0 pid: 80128 (default app) May 09 15:01:32.660913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f263fe-64e7-4d78-9b08-95507e3f1231 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:32.661217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f263fe-64e7-4d78-9b08-95507e3f1231 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:32.661499 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f263fe-64e7-4d78-9b08-95507e3f1231 None None] PATH_INFO: `/v3` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:32.665729 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Mon May 9 15:01:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:01:40.718772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b529df-d3e6-464e-bd00-04eeb29906c6 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:40.719353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b529df-d3e6-464e-bd00-04eeb29906c6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:40.719353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b529df-d3e6-464e-bd00-04eeb29906c6 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:40.723875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:40.729160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:40.729622 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:40.729716 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:40.761347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG oslo_db.sqlalchemy.engines [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:01:40.946854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG passlib.handlers.bcrypt [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80127) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:01:40.947268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG passlib.handlers.bcrypt [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80127) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:01:41.003728 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:41.005297 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:41.130418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:01:41.247438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b529df-d3e6-464e-bd00-04eeb29906c6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:41.280687 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG oslo_db.sqlalchemy.engines [None req-c5b529df-d3e6-464e-bd00-04eeb29906c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:01:41.410612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b529df-d3e6-464e-bd00-04eeb29906c6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:41.414948 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57d927-88c1-4722-a929-c7cc55f40077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7440b284bbab42b8b509df6ef55b7d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:41.415612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57d927-88c1-4722-a929-c7cc55f40077 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:41.415924 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57d927-88c1-4722-a929-c7cc55f40077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:41.416204 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57d927-88c1-4722-a929-c7cc55f40077 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:41.425090 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57d927-88c1-4722-a929-c7cc55f40077 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:41.479358 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a57d927-88c1-4722-a929-c7cc55f40077 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:01:41.479699 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57d927-88c1-4722-a929-c7cc55f40077 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:41.490768 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 9 15:01:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:01:41.496624 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:41.511403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62280b-75f5-4f2d-893d-cee318df4639 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:41.515787 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ad75-f40c-4816-9bb8-ef1ec2a8cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7440b284bbab42b8b509df6ef55b7d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:41.516912 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ad75-f40c-4816-9bb8-ef1ec2a8cce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:41.517199 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ad75-f40c-4816-9bb8-ef1ec2a8cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:41.517472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ad75-f40c-4816-9bb8-ef1ec2a8cce3 admin admin] PATH_INFO: `/v3/projects/7440b284bbab42b8b509df6ef55b7d5c` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:41.519196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0ad75-f40c-4816-9bb8-ef1ec2a8cce3 admin admin] RBAC: Authorizing `identity:get_project(project_id=7440b284bbab42b8b509df6ef55b7d5c)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:41.570678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: WARNING keystone.common.rbac_enforcer.enforcer [None req-34e0ad75-f40c-4816-9bb8-ef1ec2a8cce3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:01:41.570954 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0ad75-f40c-4816-9bb8-ef1ec2a8cce3 admin admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:41.575447 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Mon May 9 15:01:41 2022] GET /identity/v3/projects/7440b284bbab42b8b509df6ef55b7d5c => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:43.804723 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d042b-d0d6-4f1c-9159-3244767a0ff1 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:43.805297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d042b-d0d6-4f1c-9159-3244767a0ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:43.805297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d042b-d0d6-4f1c-9159-3244767a0ff1 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:43.809419 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:43.815361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df172a1-8a62-4078-a986-3b835992e0cb None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:43.815881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df172a1-8a62-4078-a986-3b835992e0cb None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:43.815983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df172a1-8a62-4078-a986-3b835992e0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:43.836015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-3df172a1-8a62-4078-a986-3b835992e0cb None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:43.837563 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-3df172a1-8a62-4078-a986-3b835992e0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:43.845242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:01:43.867896 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d042b-d0d6-4f1c-9159-3244767a0ff1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:43.880288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d042b-d0d6-4f1c-9159-3244767a0ff1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:43.884573 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af71c5-21b2-4e85-bed0-a0ab49e45ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7440b284bbab42b8b509df6ef55b7d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:43.885200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af71c5-21b2-4e85-bed0-a0ab49e45ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:43.885485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af71c5-21b2-4e85-bed0-a0ab49e45ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:43.885768 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af71c5-21b2-4e85-bed0-a0ab49e45ff6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:43.893394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af71c5-21b2-4e85-bed0-a0ab49e45ff6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:43.895151 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af71c5-21b2-4e85-bed0-a0ab49e45ff6 admin admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:43.903678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 9 15:01:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:01:43.908992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df172a1-8a62-4078-a986-3b835992e0cb None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:43.917758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df172a1-8a62-4078-a986-3b835992e0cb None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:43.922119 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d463ee-ee6d-469f-95d4-c17c4ed9b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7440b284bbab42b8b509df6ef55b7d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:43.922973 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d463ee-ee6d-469f-95d4-c17c4ed9b93a admin admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:43.923255 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d463ee-ee6d-469f-95d4-c17c4ed9b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:43.923531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d463ee-ee6d-469f-95d4-c17c4ed9b93a admin admin] PATH_INFO: `/v3/users/f4e589d5b5944217aa6bbd924fcc21dc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:43.925698 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d463ee-ee6d-469f-95d4-c17c4ed9b93a admin admin] RBAC: Authorizing `identity:get_user(user_id=f4e589d5b5944217aa6bbd924fcc21dc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:43.927496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d463ee-ee6d-469f-95d4-c17c4ed9b93a admin admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:43.929069 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Mon May 9 15:01:43 2022] GET /identity/v3/users/f4e589d5b5944217aa6bbd924fcc21dc => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:01:46.200951 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44676d13-b971-4c82-a0ef-a9234e2a9dd1 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.201487 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44676d13-b971-4c82-a0ef-a9234e2a9dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.201487 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44676d13-b971-4c82-a0ef-a9234e2a9dd1 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.202855 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:46.208961 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285ec22-2580-4c23-a04a-c49ba8724306 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.209378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285ec22-2580-4c23-a04a-c49ba8724306 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.209532 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285ec22-2580-4c23-a04a-c49ba8724306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.257856 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f351-1e23-4aed-af72-3d20bbc352a7 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.258142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f351-1e23-4aed-af72-3d20bbc352a7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.258421 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f351-1e23-4aed-af72-3d20bbc352a7 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.259817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:01:46.265708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.265988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.266262 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.307570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG passlib.handlers.bcrypt [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80128) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:01:46.308006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG passlib.handlers.bcrypt [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80128) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:01:46.335257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-1285ec22-2580-4c23-a04a-c49ba8724306 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:46.336392 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-1285ec22-2580-4c23-a04a-c49ba8724306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:46.356467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:46.358003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:46.414227 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:01:46.437300 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285ec22-2580-4c23-a04a-c49ba8724306 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:46.461812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:01:46.484011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:46.532816 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285ec22-2580-4c23-a04a-c49ba8724306 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:46.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a48ce-f93d-4cd1-a436-e9cd7210f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:46.566138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a48ce-f93d-4cd1-a436-e9cd7210f1ae None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.566422 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a48ce-f93d-4cd1-a436-e9cd7210f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.566697 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a48ce-f93d-4cd1-a436-e9cd7210f1ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.577476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a48ce-f93d-4cd1-a436-e9cd7210f1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:01:46.579301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6bb32-d516-4e3c-a034-cc9f91e5bc9e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a29a48ce-f93d-4cd1-a436-e9cd7210f1ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:01:46.589331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:01:46.590408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:01:46.591261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 7/14] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:01:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:01:46.596881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a48ce-f93d-4cd1-a436-e9cd7210f1ae None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:46.613513 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28977-cfcb-4771-bdeb-ac42612f7b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:46.614414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28977-cfcb-4771-bdeb-ac42612f7b79 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.614702 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28977-cfcb-4771-bdeb-ac42612f7b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.614977 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28977-cfcb-4771-bdeb-ac42612f7b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.678488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb28977-cfcb-4771-bdeb-ac42612f7b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:46.680027 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb28977-cfcb-4771-bdeb-ac42612f7b79 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:46.690277 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a48ce-f93d-4cd1-a436-e9cd7210f1ae None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:46.723134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:46.723820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.724105 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.724380 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:01:46.725439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:46.726819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:46.738529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 8/15] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:01:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:46.743907 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:46.772390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:01:46.778144 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28977-cfcb-4771-bdeb-ac42612f7b79 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:46.838846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc57d4e-c72e-4ed5-beb6-040976d9a71e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:46.871840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28977-cfcb-4771-bdeb-ac42612f7b79 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:46.872751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cfda4-353c-43e2-9b0a-140b2ef1fc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:46.873623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cfda4-353c-43e2-9b0a-140b2ef1fc5a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.873909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cfda4-353c-43e2-9b0a-140b2ef1fc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.874188 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cfda4-353c-43e2-9b0a-140b2ef1fc5a None admin] PATH_INFO: `/v3/users/f4e589d5b5944217aa6bbd924fcc21dc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.875398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cfda4-353c-43e2-9b0a-140b2ef1fc5a None admin] RBAC: Authorizing `identity:get_user(user_id=f4e589d5b5944217aa6bbd924fcc21dc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:46.876908 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cfda4-353c-43e2-9b0a-140b2ef1fc5a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:46.879064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 9/17] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:01:46 2022] GET /identity/v3/users/f4e589d5b5944217aa6bbd924fcc21dc => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:46.884439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cfda4-353c-43e2-9b0a-140b2ef1fc5a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:46.903752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:46.904576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:46.904856 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:46.905155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:46.983956 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cfda4-353c-43e2-9b0a-140b2ef1fc5a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:47.019558 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5cf83-5fa8-4140-a420-099ad2d23314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:47.020389 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5cf83-5fa8-4140-a420-099ad2d23314 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:47.020669 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5cf83-5fa8-4140-a420-099ad2d23314 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:47.020939 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5cf83-5fa8-4140-a420-099ad2d23314 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:47.022120 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5cf83-5fa8-4140-a420-099ad2d23314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:47.023546 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5cf83-5fa8-4140-a420-099ad2d23314 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:47.025407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:01:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:47.030882 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5cf83-5fa8-4140-a420-099ad2d23314 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:47.031928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:47.033411 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:01:47.053992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:01:47.054867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:01:47.055680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:01:47.055680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:01:47.055680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:01:47.055680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:01:47.055680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:01:47.061015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:47.126856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5cf83-5fa8-4140-a420-099ad2d23314 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:47.156063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2cd15-a93c-4a6c-9d80-6baa06e54316 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:47.160082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006bb37-4ee9-4172-8820-bde7a8e5e259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:47.160735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006bb37-4ee9-4172-8820-bde7a8e5e259 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:47.161015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006bb37-4ee9-4172-8820-bde7a8e5e259 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:47.161291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006bb37-4ee9-4172-8820-bde7a8e5e259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:47.162117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006bb37-4ee9-4172-8820-bde7a8e5e259 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.domain.id=default, user.id=f4e589d5b5944217aa6bbd924fcc21dc) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:01:47.162427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006bb37-4ee9-4172-8820-bde7a8e5e259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:47.163900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006bb37-4ee9-4172-8820-bde7a8e5e259 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:47.170413 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 9 15:01:47 2022] GET /identity/v3/role_assignments?user.id=f4e589d5b5944217aa6bbd924fcc21dc&scope.domain.id=default&role.id=67227061f74f48f293a12155e904b5fc => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:47.188453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3754414-ecfb-41c9-b984-8c49b84865ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:47.189135 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754414-ecfb-41c9-b984-8c49b84865ec None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:47.189417 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754414-ecfb-41c9-b984-8c49b84865ec None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:47.190343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3754414-ecfb-41c9-b984-8c49b84865ec None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:47.191200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3754414-ecfb-41c9-b984-8c49b84865ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:01:47.191509 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3754414-ecfb-41c9-b984-8c49b84865ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:47.192982 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3754414-ecfb-41c9-b984-8c49b84865ec None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:47.212793 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:49.827872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763509a-940c-4fe2-bf53-2d8fcaaad66a None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:49.829181 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763509a-940c-4fe2-bf53-2d8fcaaad66a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:49.829662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763509a-940c-4fe2-bf53-2d8fcaaad66a None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:49.832166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:49.837258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f6f0f-3d0c-413d-8555-c9d03de449c6 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:49.838070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f6f0f-3d0c-413d-8555-c9d03de449c6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:49.838538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f6f0f-3d0c-413d-8555-c9d03de449c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:49.860742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ac5f6f0f-3d0c-413d-8555-c9d03de449c6 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:49.862265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ac5f6f0f-3d0c-413d-8555-c9d03de449c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:49.941778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 11/23] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:01:49.976741 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763509a-940c-4fe2-bf53-2d8fcaaad66a None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:50.045226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959d917-84bc-4d8c-aa4f-1a75c4c6f193 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:50.045846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959d917-84bc-4d8c-aa4f-1a75c4c6f193 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:50.046313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959d917-84bc-4d8c-aa4f-1a75c4c6f193 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:50.047899 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:01:50.070147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db58ee-bf52-4a27-be2b-5249fe8c663f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:50.070755 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db58ee-bf52-4a27-be2b-5249fe8c663f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:50.071239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db58ee-bf52-4a27-be2b-5249fe8c663f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:50.120242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763509a-940c-4fe2-bf53-2d8fcaaad66a None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:50.124326 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-64db58ee-bf52-4a27-be2b-5249fe8c663f None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:50.125571 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-64db58ee-bf52-4a27-be2b-5249fe8c663f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:50.195418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b17fa8-bc4b-451a-b127-d57d51e9d289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:50.196122 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17fa8-bc4b-451a-b127-d57d51e9d289 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:50.196407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17fa8-bc4b-451a-b127-d57d51e9d289 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:50.196686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b17fa8-bc4b-451a-b127-d57d51e9d289 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:50.197458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b17fa8-bc4b-451a-b127-d57d51e9d289 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:50.198847 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b17fa8-bc4b-451a-b127-d57d51e9d289 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:50.270447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 13/25] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:01:50.271554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314cc4-f443-45cc-9ee8-df23bfe81b0b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:50.271885 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314cc4-f443-45cc-9ee8-df23bfe81b0b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:50.272171 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314cc4-f443-45cc-9ee8-df23bfe81b0b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:50.273421 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 14/26] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:50.278818 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be868e8-0c99-4e8e-9450-05aa4856d865 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:50.279109 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be868e8-0c99-4e8e-9450-05aa4856d865 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:50.279389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be868e8-0c99-4e8e-9450-05aa4856d865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:50.312780 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5be868e8-0c99-4e8e-9450-05aa4856d865 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:50.313966 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5be868e8-0c99-4e8e-9450-05aa4856d865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:50.366989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 13/27] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:01:49 2022] POST /identity/v3/roles => generated 219 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:01:50.372106 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b17fa8-bc4b-451a-b127-d57d51e9d289 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:50.449390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 15/28] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:01:50.489476 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be868e8-0c99-4e8e-9450-05aa4856d865 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:50.533610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b17fa8-bc4b-451a-b127-d57d51e9d289 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:50.588134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:50.588966 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:50.589254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:50.589534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:50.606443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:50.616291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:01:50.644727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:01:50.645562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:01:50.646842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:01:50.646842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:01:50.646842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:01:50.646842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:01:50.646842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 14/29] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:01:50.651854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:50.716501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be868e8-0c99-4e8e-9450-05aa4856d865 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:50.773483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab674ba-8e2f-4074-bdf8-d58dbe05f801 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:50.785116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f814b29-a3bc-44f8-b213-4d47caa1a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:50.786090 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814b29-a3bc-44f8-b213-4d47caa1a345 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:50.786507 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814b29-a3bc-44f8-b213-4d47caa1a345 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:50.786871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814b29-a3bc-44f8-b213-4d47caa1a345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:50.810949 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f814b29-a3bc-44f8-b213-4d47caa1a345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:01:50.821984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:50.823015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:50.823504 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:50.824041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:50.825016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:01:50.825531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:50.827166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5f814b29-a3bc-44f8-b213-4d47caa1a345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:01:50.833694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:01:50.834680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:01:50.835469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:01:50.842467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 16/30] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:01:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:01:50.848743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f814b29-a3bc-44f8-b213-4d47caa1a345 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:50.868678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 15/31] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:50.874796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:51.051659 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f814b29-a3bc-44f8-b213-4d47caa1a345 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:51.054374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c05b8a-1fcd-4068-be19-aee87abc3479 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:51.096246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088ce3-8bfb-4f64-9f4a-039de19e8e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:51.097330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088ce3-8bfb-4f64-9f4a-039de19e8e10 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.097839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088ce3-8bfb-4f64-9f4a-039de19e8e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.098314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088ce3-8bfb-4f64-9f4a-039de19e8e10 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.099241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41088ce3-8bfb-4f64-9f4a-039de19e8e10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:51.100958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41088ce3-8bfb-4f64-9f4a-039de19e8e10 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:51.138593 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 16/32] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:01:50 2022] POST /identity/v3/projects => generated 301 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:01:51.140265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37520b40-98f8-41ba-99d1-3f1df3257ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:51.140962 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520b40-98f8-41ba-99d1-3f1df3257ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.141251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520b40-98f8-41ba-99d1-3f1df3257ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.141696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520b40-98f8-41ba-99d1-3f1df3257ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.142486 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37520b40-98f8-41ba-99d1-3f1df3257ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:01:51.143350 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37520b40-98f8-41ba-99d1-3f1df3257ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:51.149085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37520b40-98f8-41ba-99d1-3f1df3257ca0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:51.163781 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 17/33] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:01:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:51.169782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088ce3-8bfb-4f64-9f4a-039de19e8e10 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:51.305401 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614651-b636-4e7f-ab7e-cd70f28a5732 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.306030 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614651-b636-4e7f-ab7e-cd70f28a5732 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.306519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614651-b636-4e7f-ab7e-cd70f28a5732 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.308308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 18/34] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:01:51.325792 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65b484-3ca6-4cd5-adc1-919ccdc67542 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.326436 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65b484-3ca6-4cd5-adc1-919ccdc67542 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.326933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65b484-3ca6-4cd5-adc1-919ccdc67542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.355597 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088ce3-8bfb-4f64-9f4a-039de19e8e10 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:51.365490 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fa65b484-3ca6-4cd5-adc1-919ccdc67542 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:51.367075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fa65b484-3ca6-4cd5-adc1-919ccdc67542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:51.409080 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b57189-6c5a-44b7-be1a-4861368fbfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:51.409080 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b57189-6c5a-44b7-be1a-4861368fbfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.409363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b57189-6c5a-44b7-be1a-4861368fbfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.409649 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b57189-6c5a-44b7-be1a-4861368fbfd0 None admin] PATH_INFO: `/v3/users/f4e589d5b5944217aa6bbd924fcc21dc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.410722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b57189-6c5a-44b7-be1a-4861368fbfd0 None admin] RBAC: Authorizing `identity:get_user(user_id=f4e589d5b5944217aa6bbd924fcc21dc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:51.412240 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b57189-6c5a-44b7-be1a-4861368fbfd0 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:51.413890 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 17/35] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:01:51 2022] GET /identity/v3/users/f4e589d5b5944217aa6bbd924fcc21dc => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:01:51.415185 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc58b5f-7631-4a2a-a622-1c940753203e None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.415473 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc58b5f-7631-4a2a-a622-1c940753203e None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.415755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc58b5f-7631-4a2a-a622-1c940753203e None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.417303 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 18/36] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:51.421858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc58b5f-7631-4a2a-a622-1c940753203e None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:51.465714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 19/37] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 09 15:01:51.468966 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297101-29de-41a1-ad0b-20e39ca943ce None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.469251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297101-29de-41a1-ad0b-20e39ca943ce None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.469527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297101-29de-41a1-ad0b-20e39ca943ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.492132 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c0297101-29de-41a1-ad0b-20e39ca943ce None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:51.493533 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c0297101-29de-41a1-ad0b-20e39ca943ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:51.536009 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc58b5f-7631-4a2a-a622-1c940753203e None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:51.558597 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 20/38] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:01:51.559345 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0297101-29de-41a1-ad0b-20e39ca943ce None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:51.570707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377292e-a46a-43d2-8a77-a16f5fcbcaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:51.571499 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377292e-a46a-43d2-8a77-a16f5fcbcaea None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.571804 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377292e-a46a-43d2-8a77-a16f5fcbcaea None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.572087 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377292e-a46a-43d2-8a77-a16f5fcbcaea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.573275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377292e-a46a-43d2-8a77-a16f5fcbcaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:51.574724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377292e-a46a-43d2-8a77-a16f5fcbcaea None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:51.576360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 19/39] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:01:51.581195 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152680f-16e1-42e8-860b-51ebd030b6ef None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.581491 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152680f-16e1-42e8-860b-51ebd030b6ef None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.581774 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152680f-16e1-42e8-860b-51ebd030b6ef None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.583062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 20/40] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:51.583777 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152680f-16e1-42e8-860b-51ebd030b6ef None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:51.656686 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0297101-29de-41a1-ad0b-20e39ca943ce None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:51.681094 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152680f-16e1-42e8-860b-51ebd030b6ef None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:51.690115 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e2cb2-501c-438d-bfe1-a6c492d1f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:51.690779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e2cb2-501c-438d-bfe1-a6c492d1f70d None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.691055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e2cb2-501c-438d-bfe1-a6c492d1f70d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.691325 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e2cb2-501c-438d-bfe1-a6c492d1f70d None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.692093 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e2cb2-501c-438d-bfe1-a6c492d1f70d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:51.693463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e2cb2-501c-438d-bfe1-a6c492d1f70d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:51.714067 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda97b4-edcb-414d-856b-4872478c9829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:51.714864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda97b4-edcb-414d-856b-4872478c9829 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.715142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda97b4-edcb-414d-856b-4872478c9829 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.715416 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda97b4-edcb-414d-856b-4872478c9829 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.716613 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda97b4-edcb-414d-856b-4872478c9829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:51.718028 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda97b4-edcb-414d-856b-4872478c9829 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:51.719603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 21/41] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:01:51.720371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda97b4-edcb-414d-856b-4872478c9829 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:51.812880 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:01:51 2022] POST /identity/v3/roles => generated 225 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:01:51.813763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda97b4-edcb-414d-856b-4872478c9829 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:51.814359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5368f9-a084-49f2-8d19-708eff7860b3 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.814808 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5368f9-a084-49f2-8d19-708eff7860b3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.815097 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5368f9-a084-49f2-8d19-708eff7860b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.834070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-cd5368f9-a084-49f2-8d19-708eff7860b3 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:51.835673 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cd5368f9-a084-49f2-8d19-708eff7860b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:51.851155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a929b8-100b-4a6f-a724-3109511a6956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:51.852093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a929b8-100b-4a6f-a724-3109511a6956 None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:51.852375 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a929b8-100b-4a6f-a724-3109511a6956 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:51.852665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a929b8-100b-4a6f-a724-3109511a6956 None admin] PATH_INFO: `/v3/domains/default/users/f4e589d5b5944217aa6bbd924fcc21dc/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:51.854806 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a929b8-100b-4a6f-a724-3109511a6956 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f4e589d5b5944217aa6bbd924fcc21dc, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:51.856311 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a929b8-100b-4a6f-a724-3109511a6956 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:51.871002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 22/43] 10.222.0.32 () {58 vars in 1361 bytes} [Mon May 9 15:01:51 2022] PUT /identity/v3/domains/default/users/f4e589d5b5944217aa6bbd924fcc21dc/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:01:51.871899 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a929b8-100b-4a6f-a724-3109511a6956 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:51.918118 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 22/44] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:01:51.941339 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5368f9-a084-49f2-8d19-708eff7860b3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:52.024447 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a929b8-100b-4a6f-a724-3109511a6956 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:52.062439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537894e-7811-4a6e-8158-a08d2ff819ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:52.063340 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537894e-7811-4a6e-8158-a08d2ff819ef None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:52.063927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537894e-7811-4a6e-8158-a08d2ff819ef None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:52.064215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537894e-7811-4a6e-8158-a08d2ff819ef None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:52.065331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537894e-7811-4a6e-8158-a08d2ff819ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:52.066702 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5368f9-a084-49f2-8d19-708eff7860b3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:52.066820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537894e-7811-4a6e-8158-a08d2ff819ef None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:52.106864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:01:51 2022] POST /identity/v3/projects => generated 312 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:01:52.119903 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fee74f-ab50-4b75-a3a8-8fa4e8bf8b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:52.120495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fee74f-ab50-4b75-a3a8-8fa4e8bf8b67 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:52.120782 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fee74f-ab50-4b75-a3a8-8fa4e8bf8b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:52.121067 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fee74f-ab50-4b75-a3a8-8fa4e8bf8b67 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:52.121838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fee74f-ab50-4b75-a3a8-8fa4e8bf8b67 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:52.123444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fee74f-ab50-4b75-a3a8-8fa4e8bf8b67 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:52.137444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:01:51 2022] POST /identity/v3/roles => generated 223 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:01:54.157738 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5a51c-4840-481d-bd8f-eb60487e11d5 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.158310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5a51c-4840-481d-bd8f-eb60487e11d5 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.158903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5a51c-4840-481d-bd8f-eb60487e11d5 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.160433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 24/47] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:54.165488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882beb-707d-482b-892f-a088f5459936 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.165910 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882beb-707d-482b-892f-a088f5459936 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.166130 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882beb-707d-482b-892f-a088f5459936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.183646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-77882beb-707d-482b-892f-a088f5459936 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:54.184917 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-77882beb-707d-482b-892f-a088f5459936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:54.251427 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:01:54.274979 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5a51c-4840-481d-bd8f-eb60487e11d5 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:54.366416 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6e62-07f2-49a3-9ac6-fcd3ca3aa9a8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.366637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6e62-07f2-49a3-9ac6-fcd3ca3aa9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.366948 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6e62-07f2-49a3-9ac6-fcd3ca3aa9a8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.368366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 25/49] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:01:54.372984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5a51c-4840-481d-bd8f-eb60487e11d5 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:54.373320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e2ad4-851b-4476-9ab3-fcac52a13ce7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.373616 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e2ad4-851b-4476-9ab3-fcac52a13ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.373899 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e2ad4-851b-4476-9ab3-fcac52a13ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.389808 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-692e2ad4-851b-4476-9ab3-fcac52a13ce7 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:54.391000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-692e2ad4-851b-4476-9ab3-fcac52a13ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:54.405603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38755ae4-191a-4ceb-be81-b315c2ce4dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:54.406397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38755ae4-191a-4ceb-be81-b315c2ce4dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.406682 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38755ae4-191a-4ceb-be81-b315c2ce4dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.406958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38755ae4-191a-4ceb-be81-b315c2ce4dd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.417438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38755ae4-191a-4ceb-be81-b315c2ce4dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-38755ae4-191a-4ceb-be81-b315c2ce4dd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:01:54.425014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:01:54.425868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:01:54.426639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 25/50] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:01:54.431992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38755ae4-191a-4ceb-be81-b315c2ce4dd6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:54.457661 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 26/51] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:01:54.480927 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e2ad4-851b-4476-9ab3-fcac52a13ce7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:54.530270 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38755ae4-191a-4ceb-be81-b315c2ce4dd6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:54.562089 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:54.562762 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.563046 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.563327 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.564115 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:01:54.565021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:54.566561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:54.574652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 26/52] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:54.580944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e2ad4-851b-4476-9ab3-fcac52a13ce7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:54.581503 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:54.612918 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63123910-80ec-4761-b680-e6c99c8056af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:54.613710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123910-80ec-4761-b680-e6c99c8056af None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.613995 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123910-80ec-4761-b680-e6c99c8056af None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.614274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63123910-80ec-4761-b680-e6c99c8056af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.615725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63123910-80ec-4761-b680-e6c99c8056af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:54.617264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63123910-80ec-4761-b680-e6c99c8056af None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:54.618820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:01:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:54.624509 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63123910-80ec-4761-b680-e6c99c8056af None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:54.676386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6f4f-c2c8-4aeb-8c2d-bb88f60acc99 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:54.709692 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c97c-5344-4f6d-bf8e-df20c6049c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:54.710555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c97c-5344-4f6d-bf8e-df20c6049c8e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.710838 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c97c-5344-4f6d-bf8e-df20c6049c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.711114 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6c97c-5344-4f6d-bf8e-df20c6049c8e None admin] PATH_INFO: `/v3/users/f4e589d5b5944217aa6bbd924fcc21dc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.712344 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6c97c-5344-4f6d-bf8e-df20c6049c8e None admin] RBAC: Authorizing `identity:get_user(user_id=f4e589d5b5944217aa6bbd924fcc21dc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:54.713781 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6c97c-5344-4f6d-bf8e-df20c6049c8e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:54.715388 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 27/54] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:01:54 2022] GET /identity/v3/users/f4e589d5b5944217aa6bbd924fcc21dc => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:54.718002 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63123910-80ec-4761-b680-e6c99c8056af None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:54.720627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c97c-5344-4f6d-bf8e-df20c6049c8e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:54.749870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a038b9f-b3f0-4a02-b49a-44090470a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:54.750525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038b9f-b3f0-4a02-b49a-44090470a1fc None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.750807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038b9f-b3f0-4a02-b49a-44090470a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.751082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038b9f-b3f0-4a02-b49a-44090470a1fc None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.752301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a038b9f-b3f0-4a02-b49a-44090470a1fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:54.753749 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a038b9f-b3f0-4a02-b49a-44090470a1fc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:54.785749 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 28/55] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 9 15:01:54 2022] POST /identity/v3/projects => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:01:54.829861 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6c97c-5344-4f6d-bf8e-df20c6049c8e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:54.868800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd75299-60cf-4fdd-ad63-344423d69d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:54.869529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75299-60cf-4fdd-ad63-344423d69d43 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:54.869845 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75299-60cf-4fdd-ad63-344423d69d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:54.870098 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75299-60cf-4fdd-ad63-344423d69d43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:54.871333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd75299-60cf-4fdd-ad63-344423d69d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:54.872839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd75299-60cf-4fdd-ad63-344423d69d43 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:54.874513 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 28/56] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:01:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:01:54.881733 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a038b9f-b3f0-4a02-b49a-44090470a1fc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:54.982683 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a038b9f-b3f0-4a02-b49a-44090470a1fc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:55.016779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72c407-d036-48d8-9a91-5e2696f91771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:55.017449 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c407-d036-48d8-9a91-5e2696f91771 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:55.018283 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c407-d036-48d8-9a91-5e2696f91771 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:55.018621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c407-d036-48d8-9a91-5e2696f91771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:55.019568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72c407-d036-48d8-9a91-5e2696f91771 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.domain.id=default, user.id=f4e589d5b5944217aa6bbd924fcc21dc) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:01:55.019972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72c407-d036-48d8-9a91-5e2696f91771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:55.021498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72c407-d036-48d8-9a91-5e2696f91771 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:55.049264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 29/57] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 9 15:01:54 2022] GET /identity/v3/role_assignments?user.id=f4e589d5b5944217aa6bbd924fcc21dc&scope.domain.id=default&role.id=67227061f74f48f293a12155e904b5fc => generated 530 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:01:57.014125 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6cac3-0630-4243-afda-0f7b557845ed None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:57.014648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6cac3-0630-4243-afda-0f7b557845ed None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:57.014732 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6cac3-0630-4243-afda-0f7b557845ed None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:57.016089 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 29/58] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:01:57.021360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2577-55b0-4388-8daa-8ca5e1c828dc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:57.021754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2577-55b0-4388-8daa-8ca5e1c828dc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:57.021924 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c2577-55b0-4388-8daa-8ca5e1c828dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:57.038904 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fc7c2577-55b0-4388-8daa-8ca5e1c828dc None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:01:57.040114 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fc7c2577-55b0-4388-8daa-8ca5e1c828dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:01:57.103644 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 30/59] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:01:57.127686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6cac3-0630-4243-afda-0f7b557845ed None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:57.231921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6cac3-0630-4243-afda-0f7b557845ed None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:57.264864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd5a1-f44b-490c-8be8-b2d34b2e4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:57.265590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd5a1-f44b-490c-8be8-b2d34b2e4e40 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:57.265875 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd5a1-f44b-490c-8be8-b2d34b2e4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:57.266154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd5a1-f44b-490c-8be8-b2d34b2e4e40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:57.267357 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd5a1-f44b-490c-8be8-b2d34b2e4e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:57.268842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd5a1-f44b-490c-8be8-b2d34b2e4e40 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:57.270434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 30/60] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:01:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:01:57.275998 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c2577-55b0-4388-8daa-8ca5e1c828dc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:01:57.368939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c2577-55b0-4388-8daa-8ca5e1c828dc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:01:57.400471 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8fd02-5978-45b0-bf2f-33c71a995b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:01:57.401130 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fd02-5978-45b0-bf2f-33c71a995b2a None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:01:57.401414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fd02-5978-45b0-bf2f-33c71a995b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:01:57.401690 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8fd02-5978-45b0-bf2f-33c71a995b2a None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:01:57.402391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8fd02-5978-45b0-bf2f-33c71a995b2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:01:57.403889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8fd02-5978-45b0-bf2f-33c71a995b2a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:01:57.432166 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 31/61] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:01:57 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:00.889898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d468-6dc9-4fa9-80d0-6f8e86c4f131 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:00.890412 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d468-6dc9-4fa9-80d0-6f8e86c4f131 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:00.890523 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d468-6dc9-4fa9-80d0-6f8e86c4f131 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:00.892127 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 31/62] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:00.898734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817849-f4ae-4689-b159-a352c4c9a1e7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:00.899187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817849-f4ae-4689-b159-a352c4c9a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:00.899381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14817849-f4ae-4689-b159-a352c4c9a1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:00.926044 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-14817849-f4ae-4689-b159-a352c4c9a1e7 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:00.927259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-14817849-f4ae-4689-b159-a352c4c9a1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:00.948286 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b623-dba9-49ec-8849-220611dee25c None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:00.948897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b623-dba9-49ec-8849-220611dee25c None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:00.949379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56b623-dba9-49ec-8849-220611dee25c None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:00.951184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:00.957072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267f5cd-b7ec-4d7b-b993-e16fdde00623 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:00.957616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267f5cd-b7ec-4d7b-b993-e16fdde00623 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:00.958112 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267f5cd-b7ec-4d7b-b993-e16fdde00623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.000792 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-0267f5cd-b7ec-4d7b-b993-e16fdde00623 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:01.002579 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 32/64] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:01.003346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-0267f5cd-b7ec-4d7b-b993-e16fdde00623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:01.025686 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14817849-f4ae-4689-b159-a352c4c9a1e7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.122836 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 33/65] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:01.124434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1fbc9-5155-457c-a961-be94e106e3c1 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.124892 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1fbc9-5155-457c-a961-be94e106e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.125312 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1fbc9-5155-457c-a961-be94e106e3c1 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.127293 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 34/66] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:01.133026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43ab7c-bc33-47f5-94d1-29f7840fb619 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.133479 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43ab7c-bc33-47f5-94d1-29f7840fb619 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.133920 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43ab7c-bc33-47f5-94d1-29f7840fb619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.150858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-cb43ab7c-bc33-47f5-94d1-29f7840fb619 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:01.152263 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-cb43ab7c-bc33-47f5-94d1-29f7840fb619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:01.165412 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14817849-f4ae-4689-b159-a352c4c9a1e7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.202338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38596c-5023-4232-bba6-19039d6cf338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.203662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38596c-5023-4232-bba6-19039d6cf338 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.204118 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38596c-5023-4232-bba6-19039d6cf338 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.204535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38596c-5023-4232-bba6-19039d6cf338 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.215556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38596c-5023-4232-bba6-19039d6cf338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6b38596c-5023-4232-bba6-19039d6cf338 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:01.223535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:01.224694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:01.225656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:01.227526 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 33/67] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:01.228482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38596c-5023-4232-bba6-19039d6cf338 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.234113 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 35/68] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:01.236000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43ab7c-bc33-47f5-94d1-29f7840fb619 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.349620 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38596c-5023-4232-bba6-19039d6cf338 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.381848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43ab7c-bc33-47f5-94d1-29f7840fb619 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.384062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94399a-ce6b-44f8-a349-198230e90530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.385022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94399a-ce6b-44f8-a349-198230e90530 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.385449 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94399a-ce6b-44f8-a349-198230e90530 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.385869 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94399a-ce6b-44f8-a349-198230e90530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.396552 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94399a-ce6b-44f8-a349-198230e90530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5b94399a-ce6b-44f8-a349-198230e90530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:01.404520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:01.405569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:01.406488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:01.409274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 34/69] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:01.410309 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94399a-ce6b-44f8-a349-198230e90530 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.418178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.418857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.419144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.419424 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.420220 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:01.420527 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:01.422093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:01.436540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 36/70] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:01.437767 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.512918 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94399a-ce6b-44f8-a349-198230e90530 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.538125 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369379-21d9-4af6-9ae3-42e1fa1d013b None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.545507 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a555fb-8322-43c8-a1d9-a1a0fd10da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.546312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a555fb-8322-43c8-a1d9-a1a0fd10da23 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.546605 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a555fb-8322-43c8-a1d9-a1a0fd10da23 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.546881 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a555fb-8322-43c8-a1d9-a1a0fd10da23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.557693 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a555fb-8322-43c8-a1d9-a1a0fd10da23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-e9a555fb-8322-43c8-a1d9-a1a0fd10da23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:01.566549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:01.567623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 35/71] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:01.573227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a555fb-8322-43c8-a1d9-a1a0fd10da23 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.573932 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091c229-e822-4d66-b5f9-5f4e16546880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.573932 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c229-e822-4d66-b5f9-5f4e16546880 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.573932 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c229-e822-4d66-b5f9-5f4e16546880 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.573932 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091c229-e822-4d66-b5f9-5f4e16546880 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.574180 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091c229-e822-4d66-b5f9-5f4e16546880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:01.574180 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091c229-e822-4d66-b5f9-5f4e16546880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:01.574543 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091c229-e822-4d66-b5f9-5f4e16546880 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:01.583584 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 37/72] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:01.584882 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961862-2bac-4493-9007-121d548d3733 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.585171 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961862-2bac-4493-9007-121d548d3733 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.585619 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71961862-2bac-4493-9007-121d548d3733 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.587036 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 38/73] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:01.589276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880119-c524-41cb-a5ff-7207ec0489df None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.589567 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880119-c524-41cb-a5ff-7207ec0489df None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.589851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880119-c524-41cb-a5ff-7207ec0489df None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.591188 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 39/74] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:01.591935 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880119-c524-41cb-a5ff-7207ec0489df None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.670519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a555fb-8322-43c8-a1d9-a1a0fd10da23 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.689309 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880119-c524-41cb-a5ff-7207ec0489df None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.701587 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac23ef-1736-4737-8c35-132826bb420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.702455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac23ef-1736-4737-8c35-132826bb420e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.702743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac23ef-1736-4737-8c35-132826bb420e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.703024 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac23ef-1736-4737-8c35-132826bb420e None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.718272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac23ef-1736-4737-8c35-132826bb420e None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:01.719726 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac23ef-1736-4737-8c35-132826bb420e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:01.722162 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 36/75] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:01.722616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df704f65-8db6-4bff-89d3-dba68f995cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.722938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac23ef-1736-4737-8c35-132826bb420e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.723288 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704f65-8db6-4bff-89d3-dba68f995cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.723652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704f65-8db6-4bff-89d3-dba68f995cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.723896 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704f65-8db6-4bff-89d3-dba68f995cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.724647 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df704f65-8db6-4bff-89d3-dba68f995cc6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:01.724960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df704f65-8db6-4bff-89d3-dba68f995cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:01.726333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df704f65-8db6-4bff-89d3-dba68f995cc6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:01.734461 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 40/76] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:01.735518 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0c29a-e318-4c02-aa01-da0bd7915431 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.735832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0c29a-e318-4c02-aa01-da0bd7915431 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.736117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0c29a-e318-4c02-aa01-da0bd7915431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.751973 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-a9b0c29a-e318-4c02-aa01-da0bd7915431 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:01.753160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-a9b0c29a-e318-4c02-aa01-da0bd7915431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:01.816611 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac23ef-1736-4737-8c35-132826bb420e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.816839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 41/77] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:01.819273 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ffe05-5c48-4d06-8707-4f641b2aab0e None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.819567 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ffe05-5c48-4d06-8707-4f641b2aab0e None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.819876 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ffe05-5c48-4d06-8707-4f641b2aab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.836958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-6e4ffe05-5c48-4d06-8707-4f641b2aab0e None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:01.838139 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-6e4ffe05-5c48-4d06-8707-4f641b2aab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:01.849832 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e8b9a-6315-40fc-8173-b1c13cc2d6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.850707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8b9a-6315-40fc-8173-b1c13cc2d6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.850993 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8b9a-6315-40fc-8173-b1c13cc2d6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.851271 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e8b9a-6315-40fc-8173-b1c13cc2d6d8 None admin] PATH_INFO: `/v3/users/f4e589d5b5944217aa6bbd924fcc21dc` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:01.852483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e8b9a-6315-40fc-8173-b1c13cc2d6d8 None admin] RBAC: Authorizing `identity:get_user(user_id=f4e589d5b5944217aa6bbd924fcc21dc)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:01.853943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e8b9a-6315-40fc-8173-b1c13cc2d6d8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:01.855784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 37/78] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/users/f4e589d5b5944217aa6bbd924fcc21dc => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:01.856362 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e8b9a-6315-40fc-8173-b1c13cc2d6d8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.907057 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 42/79] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:01.909263 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ffe05-5c48-4d06-8707-4f641b2aab0e None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:01.951497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e8b9a-6315-40fc-8173-b1c13cc2d6d8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:01.983938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c418-16ba-4a57-993d-80d515f94d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:01.984586 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c418-16ba-4a57-993d-80d515f94d2f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:01.984873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c418-16ba-4a57-993d-80d515f94d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:01.985160 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c418-16ba-4a57-993d-80d515f94d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.003398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ffe05-5c48-4d06-8707-4f641b2aab0e None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.035778 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e5022-4a86-4e01-96c3-26f86a5ee3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.036660 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e5022-4a86-4e01-96c3-26f86a5ee3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.036953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e5022-4a86-4e01-96c3-26f86a5ee3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.037232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e5022-4a86-4e01-96c3-26f86a5ee3f3 None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.038454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e5022-4a86-4e01-96c3-26f86a5ee3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.039948 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e5022-4a86-4e01-96c3-26f86a5ee3f3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.041558 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 43/80] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:02.042329 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e5022-4a86-4e01-96c3-26f86a5ee3f3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.048485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9c418-16ba-4a57-993d-80d515f94d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.050723 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9c418-16ba-4a57-993d-80d515f94d2f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.140284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e5022-4a86-4e01-96c3-26f86a5ee3f3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.143201 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 38/81] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:02.144078 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c418-16ba-4a57-993d-80d515f94d2f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.175438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9001fe-7996-4a23-a9b5-42b76dd00807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.176265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9001fe-7996-4a23-a9b5-42b76dd00807 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.176550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9001fe-7996-4a23-a9b5-42b76dd00807 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.176827 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9001fe-7996-4a23-a9b5-42b76dd00807 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.186665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9001fe-7996-4a23-a9b5-42b76dd00807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-8b9001fe-7996-4a23-a9b5-42b76dd00807 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:02.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:02.197287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 44/82] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:02.200560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9001fe-7996-4a23-a9b5-42b76dd00807 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.249019 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c418-16ba-4a57-993d-80d515f94d2f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.281315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4afa8f-63b9-4ffd-b2bd-faac514f7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.281962 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afa8f-63b9-4ffd-b2bd-faac514f7b37 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.282244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afa8f-63b9-4ffd-b2bd-faac514f7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.282517 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afa8f-63b9-4ffd-b2bd-faac514f7b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.293139 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9001fe-7996-4a23-a9b5-42b76dd00807 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.324978 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ecc6-de69-466b-bf92-bf27fa925b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.325765 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ecc6-de69-466b-bf92-bf27fa925b79 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.326055 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ecc6-de69-466b-bf92-bf27fa925b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.326336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71ecc6-de69-466b-bf92-bf27fa925b79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.327498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71ecc6-de69-466b-bf92-bf27fa925b79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.329241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71ecc6-de69-466b-bf92-bf27fa925b79 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.331484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 45/83] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:02.332284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ecc6-de69-466b-bf92-bf27fa925b79 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.347636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4afa8f-63b9-4ffd-b2bd-faac514f7b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.349124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4afa8f-63b9-4ffd-b2bd-faac514f7b37 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.428606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71ecc6-de69-466b-bf92-bf27fa925b79 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.441302 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 39/84] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:02.442133 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4afa8f-63b9-4ffd-b2bd-faac514f7b37 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.464752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6565e-4738-4931-8cfd-73592d16abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.465451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6565e-4738-4931-8cfd-73592d16abc5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.465739 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6565e-4738-4931-8cfd-73592d16abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.466015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6565e-4738-4931-8cfd-73592d16abc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.529201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6565e-4738-4931-8cfd-73592d16abc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.530566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6565e-4738-4931-8cfd-73592d16abc5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.534731 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4afa8f-63b9-4ffd-b2bd-faac514f7b37 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.567026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c281-bd32-48a8-9c10-8ccc0b7b2f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.567910 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c281-bd32-48a8-9c10-8ccc0b7b2f3a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.568193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c281-bd32-48a8-9c10-8ccc0b7b2f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.568465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25c281-bd32-48a8-9c10-8ccc0b7b2f3a None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.570763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25c281-bd32-48a8-9c10-8ccc0b7b2f3a None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.572245 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25c281-bd32-48a8-9c10-8ccc0b7b2f3a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.573923 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 40/85] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:02.574687 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c281-bd32-48a8-9c10-8ccc0b7b2f3a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.625621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 46/86] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:02.626254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6565e-4738-4931-8cfd-73592d16abc5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.668342 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25c281-bd32-48a8-9c10-8ccc0b7b2f3a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.700040 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.700697 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.700979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.701254 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.701985 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:02.702294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.703955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.712365 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 41/87] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:02.713227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.724160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6565e-4738-4931-8cfd-73592d16abc5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.756062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba334df-e457-464c-9201-c425f6fc77e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.756727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba334df-e457-464c-9201-c425f6fc77e0 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.757012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba334df-e457-464c-9201-c425f6fc77e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.757289 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba334df-e457-464c-9201-c425f6fc77e0 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.757991 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba334df-e457-464c-9201-c425f6fc77e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.759409 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba334df-e457-464c-9201-c425f6fc77e0 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.784488 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 47/88] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:02 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:02.792954 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba334df-e457-464c-9201-c425f6fc77e0 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.808601 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8baa4e-0e2f-44e1-8a2c-bb793ad3e09c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.845408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5abeb-66de-49bf-b6f2-dc45895ab311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.846455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5abeb-66de-49bf-b6f2-dc45895ab311 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.846738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5abeb-66de-49bf-b6f2-dc45895ab311 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.847011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5abeb-66de-49bf-b6f2-dc45895ab311 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.848375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5abeb-66de-49bf-b6f2-dc45895ab311 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.849858 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5abeb-66de-49bf-b6f2-dc45895ab311 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.851663 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 42/89] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:02.852495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5abeb-66de-49bf-b6f2-dc45895ab311 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:02.908819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba334df-e457-464c-9201-c425f6fc77e0 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.945438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:02.946112 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:02.946391 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:02.946666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:02.947512 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] RBAC: Adding query filter params (role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6, user.id=d10b080250d04a0999342a6933d185ca) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:02.947854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:02.949346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:02.956623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 48/90] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/role_assignments?user.id=d10b080250d04a0999342a6933d185ca&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:02.967074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5abeb-66de-49bf-b6f2-dc45895ab311 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:02.968835 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:03.009909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8637de-c386-452d-8cf6-e0d0c0730cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:03.011038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8637de-c386-452d-8cf6-e0d0c0730cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:03.011501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8637de-c386-452d-8cf6-e0d0c0730cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:03.011956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8637de-c386-452d-8cf6-e0d0c0730cf5 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:03.013416 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8637de-c386-452d-8cf6-e0d0c0730cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:03.015050 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8637de-c386-452d-8cf6-e0d0c0730cf5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:03.017067 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 43/91] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:03.018701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8637de-c386-452d-8cf6-e0d0c0730cf5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:03.128482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc4b6-7ab5-4ec5-bb65-689353b915ea None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:03.140605 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8637de-c386-452d-8cf6-e0d0c0730cf5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:03.170722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf686fc-39e5-4117-8130-5b65bde6a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:03.172144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf686fc-39e5-4117-8130-5b65bde6a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:03.172629 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf686fc-39e5-4117-8130-5b65bde6a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:03.173245 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf686fc-39e5-4117-8130-5b65bde6a8c4 None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:03.175497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf686fc-39e5-4117-8130-5b65bde6a8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:03.177356 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:03.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf686fc-39e5-4117-8130-5b65bde6a8c4 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:03.178021 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:03.178312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:03.178593 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:03.179437 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6, user.id=f4e589d5b5944217aa6bbd924fcc21dc) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:03.179752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:03.180749 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 49/92] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:02 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:03.181242 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:03.182043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf686fc-39e5-4117-8130-5b65bde6a8c4 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:03.192669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 44/93] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:03 2022] GET /identity/v3/role_assignments?user.id=f4e589d5b5944217aa6bbd924fcc21dc&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=67227061f74f48f293a12155e904b5fc => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:03.194169 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:03.309136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cd99a-ed32-457d-8b64-1fd0f90b57b2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:03.310314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf686fc-39e5-4117-8130-5b65bde6a8c4 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:03.347920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52005cd-6a28-4330-b259-7d497128c558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:03.348514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52005cd-6a28-4330-b259-7d497128c558 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:03.348805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52005cd-6a28-4330-b259-7d497128c558 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:03.349089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52005cd-6a28-4330-b259-7d497128c558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:03.381581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:03.382598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:03.383100 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:03.383567 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:03.384681 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] RBAC: Adding query filter params (role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6, user.id=d10b080250d04a0999342a6933d185ca) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:03.385239 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:03.386943 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:03.401743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 50/94] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:03 2022] GET /identity/v3/role_assignments?user.id=d10b080250d04a0999342a6933d185ca&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=abb44eff7ea447f6b105452bacf3892b => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:03.426546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52005cd-6a28-4330-b259-7d497128c558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:03.428311 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52005cd-6a28-4330-b259-7d497128c558 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:03.567726 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 45/95] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:02:03.573763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:03.709448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299fcf5-be72-4bd7-ab11-cafe906d0fbe None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:03.756493 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f51e-9f47-4069-89d3-aa13981cfeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:03.757371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f51e-9f47-4069-89d3-aa13981cfeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:03.757660 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f51e-9f47-4069-89d3-aa13981cfeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:03.757938 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f51e-9f47-4069-89d3-aa13981cfeb0 None admin] PATH_INFO: `/v3/projects/46c01b756ecc4b97b3e60a5cc810d5cb` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:03.759155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1f51e-9f47-4069-89d3-aa13981cfeb0 None admin] RBAC: Authorizing `identity:get_project(project_id=46c01b756ecc4b97b3e60a5cc810d5cb)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:03.760637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1f51e-9f47-4069-89d3-aa13981cfeb0 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:03.762347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 51/96] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:03 2022] GET /identity/v3/projects/46c01b756ecc4b97b3e60a5cc810d5cb => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:03.769013 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52005cd-6a28-4330-b259-7d497128c558 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:03.871927 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52005cd-6a28-4330-b259-7d497128c558 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:03.906371 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca94fe1-2fbe-47ad-8792-4352dba5f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:03.907020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca94fe1-2fbe-47ad-8792-4352dba5f39f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:03.907302 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca94fe1-2fbe-47ad-8792-4352dba5f39f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:03.907578 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca94fe1-2fbe-47ad-8792-4352dba5f39f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:03.909199 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca94fe1-2fbe-47ad-8792-4352dba5f39f None admin] RBAC: Adding query filter params (role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=46c01b756ecc4b97b3e60a5cc810d5cb, user.id=d10b080250d04a0999342a6933d185ca) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:03.909647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca94fe1-2fbe-47ad-8792-4352dba5f39f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:03.911614 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca94fe1-2fbe-47ad-8792-4352dba5f39f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:03.920495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 46/97] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:03 2022] GET /identity/v3/role_assignments?user.id=d10b080250d04a0999342a6933d185ca&scope.project.id=46c01b756ecc4b97b3e60a5cc810d5cb&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:06.345767 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da86f-8d63-4d29-b151-046421146296 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.346539 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da86f-8d63-4d29-b151-046421146296 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.346776 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da86f-8d63-4d29-b151-046421146296 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.348449 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 52/98] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:06.357292 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93006c3-3401-4234-a953-41831f2c6591 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.357760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93006c3-3401-4234-a953-41831f2c6591 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.357841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93006c3-3401-4234-a953-41831f2c6591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.382563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d93006c3-3401-4234-a953-41831f2c6591 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:06.383788 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d93006c3-3401-4234-a953-41831f2c6591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:06.478400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 47/99] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:06.514348 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6da86f-8d63-4d29-b151-046421146296 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:06.528130 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2054-0479-487b-8bfa-1310be0099ce None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.528462 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2054-0479-487b-8bfa-1310be0099ce None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.528736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c2054-0479-487b-8bfa-1310be0099ce None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.530169 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 48/100] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:06.536819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c5fa-6267-45d1-bf82-c3881a44ae81 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.537110 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c5fa-6267-45d1-bf82-c3881a44ae81 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.537382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c5fa-6267-45d1-bf82-c3881a44ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.572996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7162c5fa-6267-45d1-bf82-c3881a44ae81 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:06.574222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7162c5fa-6267-45d1-bf82-c3881a44ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:06.640751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6da86f-8d63-4d29-b151-046421146296 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:06.676026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125bdbc-d8f6-41f5-8ce0-818121edf3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:06.677246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 49/101] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:06.677365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125bdbc-d8f6-41f5-8ce0-818121edf3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.677969 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125bdbc-d8f6-41f5-8ce0-818121edf3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.678436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125bdbc-d8f6-41f5-8ce0-818121edf3f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.678653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6f25-8ed1-4de2-ba10-73774ced8cb9 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.678950 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6f25-8ed1-4de2-ba10-73774ced8cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.679235 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6f25-8ed1-4de2-ba10-73774ced8cb9 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.680531 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 50/102] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:06.685993 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32d42-7ac3-4a20-aa7d-0690c303f7ea None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.686288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32d42-7ac3-4a20-aa7d-0690c303f7ea None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.686569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32d42-7ac3-4a20-aa7d-0690c303f7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.692061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125bdbc-d8f6-41f5-8ce0-818121edf3f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-8125bdbc-d8f6-41f5-8ce0-818121edf3f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:06.700364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:06.701269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:06.702068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:06.705834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 53/103] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:06.711686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125bdbc-d8f6-41f5-8ce0-818121edf3f1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:06.731659 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1dd32d42-7ac3-4a20-aa7d-0690c303f7ea None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:06.734596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1dd32d42-7ac3-4a20-aa7d-0690c303f7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:06.814136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 51/104] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:06.815635 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32d42-7ac3-4a20-aa7d-0690c303f7ea None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:06.843010 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125bdbc-d8f6-41f5-8ce0-818121edf3f1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:06.876313 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef38570-5670-4196-a578-a5038946864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:06.877221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38570-5670-4196-a578-a5038946864c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.877512 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38570-5670-4196-a578-a5038946864c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.877794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef38570-5670-4196-a578-a5038946864c None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.878544 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef38570-5670-4196-a578-a5038946864c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:06.878858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef38570-5670-4196-a578-a5038946864c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:06.880285 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef38570-5670-4196-a578-a5038946864c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:06.896341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 54/105] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:06.896341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250302c2-3f5b-4366-8144-e30baa4e26ff None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.896341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250302c2-3f5b-4366-8144-e30baa4e26ff None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.896341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250302c2-3f5b-4366-8144-e30baa4e26ff None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.896341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 55/106] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:06.896341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25320c1-ae57-4be5-ae31-404dacfd40aa None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.896341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25320c1-ae57-4be5-ae31-404dacfd40aa None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.896858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25320c1-ae57-4be5-ae31-404dacfd40aa None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.896858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 56/107] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:06.896858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25320c1-ae57-4be5-ae31-404dacfd40aa None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:06.917343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32d42-7ac3-4a20-aa7d-0690c303f7ea None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:06.955540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d038-d7e1-4de0-981d-d351adf105df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:06.956631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d038-d7e1-4de0-981d-d351adf105df None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:06.957077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d038-d7e1-4de0-981d-d351adf105df None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:06.957354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d038-d7e1-4de0-981d-d351adf105df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:06.967146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d038-d7e1-4de0-981d-d351adf105df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1e33d038-d7e1-4de0-981d-d351adf105df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:06.974888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:06.975814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:06.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 52/108] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:06.980289 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d038-d7e1-4de0-981d-d351adf105df None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.005393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25320c1-ae57-4be5-ae31-404dacfd40aa None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.038234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd408ed4-46f4-42f7-9a02-18e1368c59f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.039290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd408ed4-46f4-42f7-9a02-18e1368c59f1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.039724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd408ed4-46f4-42f7-9a02-18e1368c59f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.040029 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd408ed4-46f4-42f7-9a02-18e1368c59f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.050500 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd408ed4-46f4-42f7-9a02-18e1368c59f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-bd408ed4-46f4-42f7-9a02-18e1368c59f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:07.058138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:07.059015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 57/109] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:07.066038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31398196-23ce-49ac-a65d-3bc4195d54aa None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.066800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31398196-23ce-49ac-a65d-3bc4195d54aa None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.066800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31398196-23ce-49ac-a65d-3bc4195d54aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.081409 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d038-d7e1-4de0-981d-d351adf105df None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.085649 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-31398196-23ce-49ac-a65d-3bc4195d54aa None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:07.086852 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-31398196-23ce-49ac-a65d-3bc4195d54aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:07.116393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d98e47-f2fb-47d9-90ab-5bdf238f8949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.117273 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d98e47-f2fb-47d9-90ab-5bdf238f8949 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.117557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d98e47-f2fb-47d9-90ab-5bdf238f8949 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.117833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d98e47-f2fb-47d9-90ab-5bdf238f8949 None admin] PATH_INFO: `/v3/users/1b6df53592d24558ada125662d6de1b2` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.131319 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d98e47-f2fb-47d9-90ab-5bdf238f8949 None admin] RBAC: Authorizing `identity:get_user(user_id=1b6df53592d24558ada125662d6de1b2)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:07.132832 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d98e47-f2fb-47d9-90ab-5bdf238f8949 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:07.134475 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 53/110] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:06 2022] GET /identity/v3/users/1b6df53592d24558ada125662d6de1b2 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:07.135652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd941716-84cf-4118-b8ce-9a422872f35b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.135966 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd941716-84cf-4118-b8ce-9a422872f35b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.136268 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd941716-84cf-4118-b8ce-9a422872f35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.152149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-cd941716-84cf-4118-b8ce-9a422872f35b None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:07.152504 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 58/111] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:07.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cd941716-84cf-4118-b8ce-9a422872f35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:07.153386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31398196-23ce-49ac-a65d-3bc4195d54aa None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.217386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 54/112] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:07.218228 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd941716-84cf-4118-b8ce-9a422872f35b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.248173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31398196-23ce-49ac-a65d-3bc4195d54aa None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.280556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18dd7d7-48f9-4a95-a94e-c0f0bb956f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.281222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dd7d7-48f9-4a95-a94e-c0f0bb956f1d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.281505 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dd7d7-48f9-4a95-a94e-c0f0bb956f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.281777 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18dd7d7-48f9-4a95-a94e-c0f0bb956f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.282514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dd7d7-48f9-4a95-a94e-c0f0bb956f1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:07.282819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dd7d7-48f9-4a95-a94e-c0f0bb956f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:07.284346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18dd7d7-48f9-4a95-a94e-c0f0bb956f1d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:07.292186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 59/113] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:07.293413 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d25fb-4a6d-4c5b-a470-230907f679de None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.293697 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d25fb-4a6d-4c5b-a470-230907f679de None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.293970 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d25fb-4a6d-4c5b-a470-230907f679de None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.295339 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 60/114] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:07.296534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d25fb-4a6d-4c5b-a470-230907f679de None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.311891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd941716-84cf-4118-b8ce-9a422872f35b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.344608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.345271 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.345699 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.345979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.346728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:07.347036 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:07.348445 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:07.356228 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 55/115] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:07.357044 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.391725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d25fb-4a6d-4c5b-a470-230907f679de None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.423104 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389e08-a8d0-4c1a-97c0-7137c239b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.423712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389e08-a8d0-4c1a-97c0-7137c239b351 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.424019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389e08-a8d0-4c1a-97c0-7137c239b351 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.424295 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389e08-a8d0-4c1a-97c0-7137c239b351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.451893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c5eb0-35bc-46db-9427-8bbe7d39445d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.485444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a1454-c2e6-46b8-aef3-c3235e11205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.486795 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a1454-c2e6-46b8-aef3-c3235e11205d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.487079 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a1454-c2e6-46b8-aef3-c3235e11205d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.487363 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a1454-c2e6-46b8-aef3-c3235e11205d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.488577 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a1454-c2e6-46b8-aef3-c3235e11205d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:07.490031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a1454-c2e6-46b8-aef3-c3235e11205d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:07.491424 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca389e08-a8d0-4c1a-97c0-7137c239b351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:07.491671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 56/116] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:07.492471 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a1454-c2e6-46b8-aef3-c3235e11205d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.492992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca389e08-a8d0-4c1a-97c0-7137c239b351 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:07.585123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a1454-c2e6-46b8-aef3-c3235e11205d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.585896 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 61/117] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:07.586725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389e08-a8d0-4c1a-97c0-7137c239b351 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.617457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f9806-c1f4-4b90-b547-4cceb76d669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.618250 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f9806-c1f4-4b90-b547-4cceb76d669f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.618539 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f9806-c1f4-4b90-b547-4cceb76d669f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.618821 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f9806-c1f4-4b90-b547-4cceb76d669f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.629085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f9806-c1f4-4b90-b547-4cceb76d669f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-614f9806-c1f4-4b90-b547-4cceb76d669f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:07.636728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:07.637653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:07.638425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 57/118] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:07.639503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb9f4d-3ba5-4f1b-a17a-6bac6c972733 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.639594 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb9f4d-3ba5-4f1b-a17a-6bac6c972733 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.639877 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb9f4d-3ba5-4f1b-a17a-6bac6c972733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.656901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-15eb9f4d-3ba5-4f1b-a17a-6bac6c972733 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:07.658787 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-15eb9f4d-3ba5-4f1b-a17a-6bac6c972733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:07.681584 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389e08-a8d0-4c1a-97c0-7137c239b351 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.713689 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5785622-d86a-4e99-8d67-6b65b4345759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.714554 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5785622-d86a-4e99-8d67-6b65b4345759 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.714832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5785622-d86a-4e99-8d67-6b65b4345759 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.715104 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5785622-d86a-4e99-8d67-6b65b4345759 None admin] PATH_INFO: `/v3/users/f4e589d5b5944217aa6bbd924fcc21dc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.716307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5785622-d86a-4e99-8d67-6b65b4345759 None admin] RBAC: Authorizing `identity:get_user(user_id=f4e589d5b5944217aa6bbd924fcc21dc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:07.717746 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5785622-d86a-4e99-8d67-6b65b4345759 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:07.719651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 62/119] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/users/f4e589d5b5944217aa6bbd924fcc21dc => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:07.720122 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5785622-d86a-4e99-8d67-6b65b4345759 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.725131 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 58/120] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:07.728648 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb9f4d-3ba5-4f1b-a17a-6bac6c972733 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.818184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5785622-d86a-4e99-8d67-6b65b4345759 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.821594 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb9f4d-3ba5-4f1b-a17a-6bac6c972733 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.850541 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4fb9a-7918-48e4-8126-31f246b890c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.851409 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4fb9a-7918-48e4-8126-31f246b890c3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.851692 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4fb9a-7918-48e4-8126-31f246b890c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.851994 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4fb9a-7918-48e4-8126-31f246b890c3 None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.852705 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a3a30-53df-40cc-a48f-0e9e209001a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:07.853188 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4fb9a-7918-48e4-8126-31f246b890c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:07.853354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3a30-53df-40cc-a48f-0e9e209001a3 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:07.853642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3a30-53df-40cc-a48f-0e9e209001a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:07.853918 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3a30-53df-40cc-a48f-0e9e209001a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:07.854615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a3a30-53df-40cc-a48f-0e9e209001a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:07.854705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4fb9a-7918-48e4-8126-31f246b890c3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:07.856098 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a3a30-53df-40cc-a48f-0e9e209001a3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:07.856292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 63/121] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:07.857066 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4fb9a-7918-48e4-8126-31f246b890c3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.884096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 59/122] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:02:07 2022] POST /identity/v3/projects => generated 302 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:07.884918 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a3a30-53df-40cc-a48f-0e9e209001a3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:07.965806 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4fb9a-7918-48e4-8126-31f246b890c3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:07.991756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a3a30-53df-40cc-a48f-0e9e209001a3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.001127 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9dfbb-2be9-423f-b0b3-a99b41f8995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.002646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9dfbb-2be9-423f-b0b3-a99b41f8995d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.002924 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9dfbb-2be9-423f-b0b3-a99b41f8995d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.003194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9dfbb-2be9-423f-b0b3-a99b41f8995d None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.004437 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9dfbb-2be9-423f-b0b3-a99b41f8995d None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.005885 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9dfbb-2be9-423f-b0b3-a99b41f8995d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.007619 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 64/123] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.008461 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9dfbb-2be9-423f-b0b3-a99b41f8995d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.032718 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.033602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.033886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.034176 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.034925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:08.035233 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.036655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.045479 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 60/124] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.051464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.121798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9dfbb-2be9-423f-b0b3-a99b41f8995d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.153590 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb16b7-afb1-4072-8edc-05920d3a24a7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.155793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257870e-31ed-467e-b70e-c6faaa3cc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.156681 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257870e-31ed-467e-b70e-c6faaa3cc24a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.156968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257870e-31ed-467e-b70e-c6faaa3cc24a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.157245 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257870e-31ed-467e-b70e-c6faaa3cc24a None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.159088 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257870e-31ed-467e-b70e-c6faaa3cc24a None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.160569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257870e-31ed-467e-b70e-c6faaa3cc24a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.162507 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 65/125] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.167201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257870e-31ed-467e-b70e-c6faaa3cc24a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.187702 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96156e-bc09-4743-89ad-e25012e9b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.188564 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96156e-bc09-4743-89ad-e25012e9b406 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.188851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96156e-bc09-4743-89ad-e25012e9b406 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.189128 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96156e-bc09-4743-89ad-e25012e9b406 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.199990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96156e-bc09-4743-89ad-e25012e9b406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-de96156e-bc09-4743-89ad-e25012e9b406 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:08.208532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:08.209442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:08.210259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 61/126] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:08.210950 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96156e-bc09-4743-89ad-e25012e9b406 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.272354 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257870e-31ed-467e-b70e-c6faaa3cc24a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.306302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b887-ede4-4345-bea6-13b877aeb5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.307167 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b887-ede4-4345-bea6-13b877aeb5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.307451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b887-ede4-4345-bea6-13b877aeb5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.307722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b887-ede4-4345-bea6-13b877aeb5b2 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.308944 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80b887-ede4-4345-bea6-13b877aeb5b2 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.310374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80b887-ede4-4345-bea6-13b877aeb5b2 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.312129 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 66/127] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.312897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b887-ede4-4345-bea6-13b877aeb5b2 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.318179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96156e-bc09-4743-89ad-e25012e9b406 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.352657 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.353320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.353611 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.353893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.354731 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] RBAC: Adding query filter params (role.id=097994ff79ef4bb7a76712f02ac27677, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6, user.id=1b6df53592d24558ada125662d6de1b2) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:08.355046 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.356543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.362056 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 62/128] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/role_assignments?user.id=1b6df53592d24558ada125662d6de1b2&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=097994ff79ef4bb7a76712f02ac27677 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.362821 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.420733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b887-ede4-4345-bea6-13b877aeb5b2 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.461763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33552c7d-1e62-44cf-8d16-f026f899120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.463064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33552c7d-1e62-44cf-8d16-f026f899120c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.463569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33552c7d-1e62-44cf-8d16-f026f899120c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.464083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33552c7d-1e62-44cf-8d16-f026f899120c None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.465623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33552c7d-1e62-44cf-8d16-f026f899120c None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.467374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33552c7d-1e62-44cf-8d16-f026f899120c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.469419 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 67/129] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.470639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33552c7d-1e62-44cf-8d16-f026f899120c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.472678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f07e49-4367-4e14-8540-62a19d6a744a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.512020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c83f8-67a2-4607-8f2a-787580f1dae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.512973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c83f8-67a2-4607-8f2a-787580f1dae2 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.513260 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c83f8-67a2-4607-8f2a-787580f1dae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.513542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c83f8-67a2-4607-8f2a-787580f1dae2 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/users/f4e589d5b5944217aa6bbd924fcc21dc/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.515725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c83f8-67a2-4607-8f2a-787580f1dae2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e14d0e2f8bff42f98671631097e2d1f6, user_id=f4e589d5b5944217aa6bbd924fcc21dc, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.517285 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c83f8-67a2-4607-8f2a-787580f1dae2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.535125 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 63/130] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:08 2022] PUT /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/users/f4e589d5b5944217aa6bbd924fcc21dc/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:08.536457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c83f8-67a2-4607-8f2a-787580f1dae2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.589265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33552c7d-1e62-44cf-8d16-f026f899120c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.625637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.626335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.626654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.628320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:08.628592 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.630053 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.639353 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 68/131] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.640749 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.654027 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c83f8-67a2-4607-8f2a-787580f1dae2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.694045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcbe6d-2227-43af-9c1a-0f39dfc51718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.695384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcbe6d-2227-43af-9c1a-0f39dfc51718 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.695941 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcbe6d-2227-43af-9c1a-0f39dfc51718 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.696447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcbe6d-2227-43af-9c1a-0f39dfc51718 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/users/d10b080250d04a0999342a6933d185ca/roles/969f252ad8ce4e4e8be6b6d5e6590338` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.698868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcbe6d-2227-43af-9c1a-0f39dfc51718 None admin] RBAC: Authorizing `identity:create_grant(project_id=e14d0e2f8bff42f98671631097e2d1f6, user_id=d10b080250d04a0999342a6933d185ca, role_id=969f252ad8ce4e4e8be6b6d5e6590338)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.700756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcbe6d-2227-43af-9c1a-0f39dfc51718 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.716747 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 64/132] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:08 2022] PUT /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/users/d10b080250d04a0999342a6933d185ca/roles/969f252ad8ce4e4e8be6b6d5e6590338 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:08.718059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcbe6d-2227-43af-9c1a-0f39dfc51718 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.755695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf2b73-44a8-4473-9a15-7bb6a0808f8a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.793168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f1f4e-a03b-426e-bd1c-fa8bacfe292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.793976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f1f4e-a03b-426e-bd1c-fa8bacfe292e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.794268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f1f4e-a03b-426e-bd1c-fa8bacfe292e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.794551 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f1f4e-a03b-426e-bd1c-fa8bacfe292e None admin] PATH_INFO: `/v3/projects/46c01b756ecc4b97b3e60a5cc810d5cb` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.795867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f1f4e-a03b-426e-bd1c-fa8bacfe292e None admin] RBAC: Authorizing `identity:get_project(project_id=46c01b756ecc4b97b3e60a5cc810d5cb)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.797516 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f1f4e-a03b-426e-bd1c-fa8bacfe292e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.800253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 69/133] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/projects/46c01b756ecc4b97b3e60a5cc810d5cb => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.808954 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f1f4e-a03b-426e-bd1c-fa8bacfe292e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:08.855849 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcbe6d-2227-43af-9c1a-0f39dfc51718 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:08.925554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6682925-ddbc-4568-9e1f-5c91c407318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:08.926824 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6682925-ddbc-4568-9e1f-5c91c407318c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:08.927342 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6682925-ddbc-4568-9e1f-5c91c407318c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:08.927857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6682925-ddbc-4568-9e1f-5c91c407318c None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:08.930824 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6682925-ddbc-4568-9e1f-5c91c407318c None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:08.932597 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6682925-ddbc-4568-9e1f-5c91c407318c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:08.934574 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 65/134] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:08.941600 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6682925-ddbc-4568-9e1f-5c91c407318c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:09.019730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f1f4e-a03b-426e-bd1c-fa8bacfe292e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:09.087379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada72a8-cec8-4ea2-9a85-028bc6cc6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:09.089845 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada72a8-cec8-4ea2-9a85-028bc6cc6e48 None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:09.090587 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada72a8-cec8-4ea2-9a85-028bc6cc6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:09.091497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada72a8-cec8-4ea2-9a85-028bc6cc6e48 None admin] PATH_INFO: `/v3/projects/46c01b756ecc4b97b3e60a5cc810d5cb/users/d10b080250d04a0999342a6933d185ca/roles/969f252ad8ce4e4e8be6b6d5e6590338` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:09.097228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada72a8-cec8-4ea2-9a85-028bc6cc6e48 None admin] RBAC: Authorizing `identity:create_grant(project_id=46c01b756ecc4b97b3e60a5cc810d5cb, user_id=d10b080250d04a0999342a6933d185ca, role_id=969f252ad8ce4e4e8be6b6d5e6590338)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:09.100407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada72a8-cec8-4ea2-9a85-028bc6cc6e48 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:09.123295 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 70/135] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:08 2022] PUT /identity/v3/projects/46c01b756ecc4b97b3e60a5cc810d5cb/users/d10b080250d04a0999342a6933d185ca/roles/969f252ad8ce4e4e8be6b6d5e6590338 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:09.190345 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6682925-ddbc-4568-9e1f-5c91c407318c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:09.241995 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf98054-671e-4945-9d87-9623c28789e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:09.242885 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98054-671e-4945-9d87-9623c28789e6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:09.243174 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98054-671e-4945-9d87-9623c28789e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:09.243437 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98054-671e-4945-9d87-9623c28789e6 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:09.244701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf98054-671e-4945-9d87-9623c28789e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:09.246176 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf98054-671e-4945-9d87-9623c28789e6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:09.247926 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 66/136] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:08 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:09.254319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada72a8-cec8-4ea2-9a85-028bc6cc6e48 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:09.441248 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada72a8-cec8-4ea2-9a85-028bc6cc6e48 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:09.488243 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef5173-8c10-462c-b2d2-45a4635d323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:09.489210 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef5173-8c10-462c-b2d2-45a4635d323e None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:09.489493 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef5173-8c10-462c-b2d2-45a4635d323e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:09.489768 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef5173-8c10-462c-b2d2-45a4635d323e None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/users/d10b080250d04a0999342a6933d185ca/roles/abb44eff7ea447f6b105452bacf3892b` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:09.497175 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef5173-8c10-462c-b2d2-45a4635d323e None admin] RBAC: Authorizing `identity:create_grant(project_id=e14d0e2f8bff42f98671631097e2d1f6, user_id=d10b080250d04a0999342a6933d185ca, role_id=abb44eff7ea447f6b105452bacf3892b)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:09.498713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef5173-8c10-462c-b2d2-45a4635d323e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:09.525546 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 71/137] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:09 2022] PUT /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/users/d10b080250d04a0999342a6933d185ca/roles/abb44eff7ea447f6b105452bacf3892b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:11.260198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d50b-9a52-48b5-87dc-f3fd3e1ec87e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.260700 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d50b-9a52-48b5-87dc-f3fd3e1ec87e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.260771 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d50b-9a52-48b5-87dc-f3fd3e1ec87e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.262424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 67/138] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:11.268385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c9b2-23d8-44bc-9f6c-15254912d59c None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.268816 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c9b2-23d8-44bc-9f6c-15254912d59c None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.268989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c9b2-23d8-44bc-9f6c-15254912d59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.292944 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-0812c9b2-23d8-44bc-9f6c-15254912d59c None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:11.294173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-0812c9b2-23d8-44bc-9f6c-15254912d59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:11.372186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 72/139] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:11.404493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d50b-9a52-48b5-87dc-f3fd3e1ec87e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:11.443243 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a526649-a04e-4d19-badf-807be8a4389f None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.443900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a526649-a04e-4d19-badf-807be8a4389f None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.444388 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a526649-a04e-4d19-badf-807be8a4389f None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.445984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 73/140] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:11.451520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e30cf-6363-42f5-b5a9-ca6ac968f1ff None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.452082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e30cf-6363-42f5-b5a9-ca6ac968f1ff None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.452569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e30cf-6363-42f5-b5a9-ca6ac968f1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.469340 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-7a2e30cf-6363-42f5-b5a9-ca6ac968f1ff None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:11.470940 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-7a2e30cf-6363-42f5-b5a9-ca6ac968f1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:11.539309 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 74/141] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:11.562763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e30cf-6363-42f5-b5a9-ca6ac968f1ff None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:11.585398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d50b-9a52-48b5-87dc-f3fd3e1ec87e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:11.669457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4d0f6-8246-4598-bae8-cc5c6ad9ede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:11.670181 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4d0f6-8246-4598-bae8-cc5c6ad9ede3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.670467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4d0f6-8246-4598-bae8-cc5c6ad9ede3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.670741 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4d0f6-8246-4598-bae8-cc5c6ad9ede3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.674396 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e30cf-6363-42f5-b5a9-ca6ac968f1ff None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:11.676492 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4d0f6-8246-4598-bae8-cc5c6ad9ede3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:11.677958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4d0f6-8246-4598-bae8-cc5c6ad9ede3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:11.679756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 68/142] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:11.701271 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4d0f6-8246-4598-bae8-cc5c6ad9ede3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:11.717595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccc145-77bb-4fcf-b317-d73cb61f9b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:11.718734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc145-77bb-4fcf-b317-d73cb61f9b41 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.719212 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc145-77bb-4fcf-b317-d73cb61f9b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.719689 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccc145-77bb-4fcf-b317-d73cb61f9b41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.731733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccc145-77bb-4fcf-b317-d73cb61f9b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-ebccc145-77bb-4fcf-b317-d73cb61f9b41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:11.739850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:11.740705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:11.741482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:11.743801 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 75/143] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:11.745211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbadc8-b0b7-44d6-9c05-734e8e0eea51 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.745688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbadc8-b0b7-44d6-9c05-734e8e0eea51 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.746152 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbadc8-b0b7-44d6-9c05-734e8e0eea51 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.752005 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 76/144] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:11.753898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbadc8-b0b7-44d6-9c05-734e8e0eea51 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:11.863196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbadc8-b0b7-44d6-9c05-734e8e0eea51 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:11.896638 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf3c4f-5f86-4996-b4f8-fb0d714ec08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:11.897683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3c4f-5f86-4996-b4f8-fb0d714ec08b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.898175 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3c4f-5f86-4996-b4f8-fb0d714ec08b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.898657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf3c4f-5f86-4996-b4f8-fb0d714ec08b None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.899596 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3c4f-5f86-4996-b4f8-fb0d714ec08b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:11.900123 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3c4f-5f86-4996-b4f8-fb0d714ec08b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:11.901701 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf3c4f-5f86-4996-b4f8-fb0d714ec08b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:11.911557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 77/145] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:11.917271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4629b-f073-4c4c-bfe5-69f45d17503f None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:11.917772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4629b-f073-4c4c-bfe5-69f45d17503f None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:11.918242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4629b-f073-4c4c-bfe5-69f45d17503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:11.935803 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-34d4629b-f073-4c4c-bfe5-69f45d17503f None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:11.937276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-34d4629b-f073-4c4c-bfe5-69f45d17503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:11.957967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4d0f6-8246-4598-bae8-cc5c6ad9ede3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:12.005099 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 78/146] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:12.006348 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4629b-f073-4c4c-bfe5-69f45d17503f None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.046264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59adad-1668-4bc6-981d-94d3c6501d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:12.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59adad-1668-4bc6-981d-94d3c6501d26 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.048278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59adad-1668-4bc6-981d-94d3c6501d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.049347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59adad-1668-4bc6-981d-94d3c6501d26 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.050742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59adad-1668-4bc6-981d-94d3c6501d26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:12.052690 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59adad-1668-4bc6-981d-94d3c6501d26 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:12.094033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 69/147] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:11 2022] POST /identity/v3/users => generated 283 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:02:12.102955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5afb3-6b93-4d72-9d4a-b2f62183e984 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.102955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5afb3-6b93-4d72-9d4a-b2f62183e984 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.102955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5afb3-6b93-4d72-9d4a-b2f62183e984 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.102955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 70/148] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:12.103384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5afb3-6b93-4d72-9d4a-b2f62183e984 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.140324 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4629b-f073-4c4c-bfe5-69f45d17503f None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:12.190318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234ee1c-a0f9-42aa-acdf-ddadedd7f8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:12.191135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ee1c-a0f9-42aa-acdf-ddadedd7f8fb None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.191416 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ee1c-a0f9-42aa-acdf-ddadedd7f8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.191690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ee1c-a0f9-42aa-acdf-ddadedd7f8fb None admin] PATH_INFO: `/v3/users/1b6df53592d24558ada125662d6de1b2` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.196757 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234ee1c-a0f9-42aa-acdf-ddadedd7f8fb None admin] RBAC: Authorizing `identity:get_user(user_id=1b6df53592d24558ada125662d6de1b2)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:12.198238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234ee1c-a0f9-42aa-acdf-ddadedd7f8fb None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:12.205964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 79/149] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:12 2022] GET /identity/v3/users/1b6df53592d24558ada125662d6de1b2 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:12.207378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674db48-56b9-424d-bf9a-d4d7792debb5 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.207662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674db48-56b9-424d-bf9a-d4d7792debb5 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.207961 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674db48-56b9-424d-bf9a-d4d7792debb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.242260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-d674db48-56b9-424d-bf9a-d4d7792debb5 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:12.244223 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-d674db48-56b9-424d-bf9a-d4d7792debb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:12.316499 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5afb3-6b93-4d72-9d4a-b2f62183e984 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:12.337951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 80/150] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:12.338636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674db48-56b9-424d-bf9a-d4d7792debb5 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.354291 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620da1-e0d7-4e4f-9b65-adb19d1c70fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:12.355404 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620da1-e0d7-4e4f-9b65-adb19d1c70fe None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.355954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620da1-e0d7-4e4f-9b65-adb19d1c70fe None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620da1-e0d7-4e4f-9b65-adb19d1c70fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.367209 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1620da1-e0d7-4e4f-9b65-adb19d1c70fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b1620da1-e0d7-4e4f-9b65-adb19d1c70fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:12.375988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:12.376833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:12.379802 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 71/151] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:12.380914 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620da1-e0d7-4e4f-9b65-adb19d1c70fe None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.444806 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674db48-56b9-424d-bf9a-d4d7792debb5 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:12.480039 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823120a9-f358-4268-ad69-518e0586c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:12.481181 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823120a9-f358-4268-ad69-518e0586c826 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.481181 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823120a9-f358-4268-ad69-518e0586c826 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.481429 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823120a9-f358-4268-ad69-518e0586c826 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.482650 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823120a9-f358-4268-ad69-518e0586c826 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:12.484975 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823120a9-f358-4268-ad69-518e0586c826 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:12.487227 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 81/152] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:12 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:12.488004 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823120a9-f358-4268-ad69-518e0586c826 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.522979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620da1-e0d7-4e4f-9b65-adb19d1c70fe None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:12.568173 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db884fdc-acfe-40fa-9ad8-df1ddc0fd81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:12.569335 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884fdc-acfe-40fa-9ad8-df1ddc0fd81b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.569789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884fdc-acfe-40fa-9ad8-df1ddc0fd81b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.570498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884fdc-acfe-40fa-9ad8-df1ddc0fd81b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.584172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db884fdc-acfe-40fa-9ad8-df1ddc0fd81b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-db884fdc-acfe-40fa-9ad8-df1ddc0fd81b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:12.593580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:12.594619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:12.595930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:12.598244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 72/153] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:12.599149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db884fdc-acfe-40fa-9ad8-df1ddc0fd81b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.619698 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823120a9-f358-4268-ad69-518e0586c826 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:12.662860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:12.663694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.664103 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.664474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.665435 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:12.665855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:12.667431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:12.679173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 82/154] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:12.684427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.728848 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db884fdc-acfe-40fa-9ad8-df1ddc0fd81b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:12.791064 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f97569-e735-485b-a1ec-5dad30924e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:12.792235 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f97569-e735-485b-a1ec-5dad30924e9b None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.792514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f97569-e735-485b-a1ec-5dad30924e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.792787 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f97569-e735-485b-a1ec-5dad30924e9b None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/users/1b6df53592d24558ada125662d6de1b2/roles/097994ff79ef4bb7a76712f02ac27677` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.796407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f97569-e735-485b-a1ec-5dad30924e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=e14d0e2f8bff42f98671631097e2d1f6, user_id=1b6df53592d24558ada125662d6de1b2, role_id=097994ff79ef4bb7a76712f02ac27677)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:12.799527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f97569-e735-485b-a1ec-5dad30924e9b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:12.822441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 73/155] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:12 2022] PUT /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/users/1b6df53592d24558ada125662d6de1b2/roles/097994ff79ef4bb7a76712f02ac27677 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:12.823293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f97569-e735-485b-a1ec-5dad30924e9b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.843636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da045b-1d25-400a-ab18-468029a1870e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:12.929534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eda89-e5b7-4551-a05d-dbf55985ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:12.930231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eda89-e5b7-4551-a05d-dbf55985ade8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.930512 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eda89-e5b7-4551-a05d-dbf55985ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.931042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eda89-e5b7-4551-a05d-dbf55985ade8 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.933347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eda89-e5b7-4551-a05d-dbf55985ade8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:12.933698 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eda89-e5b7-4551-a05d-dbf55985ade8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:12.936078 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22eda89-e5b7-4551-a05d-dbf55985ade8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:12.955201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 83/156] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:12.959027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eb51e-e051-405c-8e5a-52a73d515a06 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:12.959321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eb51e-e051-405c-8e5a-52a73d515a06 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:12.959585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eb51e-e051-405c-8e5a-52a73d515a06 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:12.962104 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 84/157] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:12.962938 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eb51e-e051-405c-8e5a-52a73d515a06 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:12.971016 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f97569-e735-485b-a1ec-5dad30924e9b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:13.053488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1987a27-4922-45c6-ae98-c65d13d0992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:13.054320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1987a27-4922-45c6-ae98-c65d13d0992a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.054606 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1987a27-4922-45c6-ae98-c65d13d0992a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.054880 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1987a27-4922-45c6-ae98-c65d13d0992a None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.057254 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1987a27-4922-45c6-ae98-c65d13d0992a None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:13.061474 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1987a27-4922-45c6-ae98-c65d13d0992a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:13.065698 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 74/158] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:12 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:13.069881 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe763ce6-8148-4c0e-962e-25b0f7f3d838 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.070198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe763ce6-8148-4c0e-962e-25b0f7f3d838 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.070543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe763ce6-8148-4c0e-962e-25b0f7f3d838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.111882 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fe763ce6-8148-4c0e-962e-25b0f7f3d838 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:13.113228 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fe763ce6-8148-4c0e-962e-25b0f7f3d838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:13.149563 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eb51e-e051-405c-8e5a-52a73d515a06 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:13.203607 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bff53-75eb-4246-b59a-759737880976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:13.204687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bff53-75eb-4246-b59a-759737880976 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.205850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bff53-75eb-4246-b59a-759737880976 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.206223 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bff53-75eb-4246-b59a-759737880976 None admin] PATH_INFO: `/v3/users/f4e589d5b5944217aa6bbd924fcc21dc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.208597 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bff53-75eb-4246-b59a-759737880976 None admin] RBAC: Authorizing `identity:get_user(user_id=f4e589d5b5944217aa6bbd924fcc21dc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:13.210227 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bff53-75eb-4246-b59a-759737880976 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:13.212379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 75/160] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:13.213465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe763ce6-8148-4c0e-962e-25b0f7f3d838 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:13.215862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 85/160] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:12 2022] GET /identity/v3/users/f4e589d5b5944217aa6bbd924fcc21dc => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:13.217167 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ce0e-cd93-41e5-8e5f-202d3bfb739b None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.217454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ce0e-cd93-41e5-8e5f-202d3bfb739b None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.217732 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ce0e-cd93-41e5-8e5f-202d3bfb739b None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.219132 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 86/161] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:13.221836 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60ce0e-cd93-41e5-8e5f-202d3bfb739b None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:13.322851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe763ce6-8148-4c0e-962e-25b0f7f3d838 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:13.339950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60ce0e-cd93-41e5-8e5f-202d3bfb739b None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:13.362059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20395578-b43b-40c3-9501-77c8f1280a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:13.363134 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395578-b43b-40c3-9501-77c8f1280a9d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.363623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395578-b43b-40c3-9501-77c8f1280a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.364133 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20395578-b43b-40c3-9501-77c8f1280a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.377355 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c20ef-187b-48c5-b6ce-1b2487fd68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:13.377954 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c20ef-187b-48c5-b6ce-1b2487fd68ea None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.378244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c20ef-187b-48c5-b6ce-1b2487fd68ea None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.378509 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c20ef-187b-48c5-b6ce-1b2487fd68ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.435822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20395578-b43b-40c3-9501-77c8f1280a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:13.437640 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20395578-b43b-40c3-9501-77c8f1280a9d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:13.452100 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c20ef-187b-48c5-b6ce-1b2487fd68ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:13.453810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c20ef-187b-48c5-b6ce-1b2487fd68ea None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:13.543216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 76/162] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:13.549627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8265-1f5d-474e-9cfd-696230647802 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.550198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8265-1f5d-474e-9cfd-696230647802 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.550680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8265-1f5d-474e-9cfd-696230647802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.556254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 87/163] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:13.557674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c20ef-187b-48c5-b6ce-1b2487fd68ea None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:13.568630 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b57c8265-1f5d-474e-9cfd-696230647802 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:13.570164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b57c8265-1f5d-474e-9cfd-696230647802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:13.638918 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 77/164] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:13.640106 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8265-1f5d-474e-9cfd-696230647802 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:13.657513 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c20ef-187b-48c5-b6ce-1b2487fd68ea None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:13.695814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2e3a8-f02d-4258-abd8-298eb1319903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:13.695814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2e3a8-f02d-4258-abd8-298eb1319903 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.695814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2e3a8-f02d-4258-abd8-298eb1319903 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.695814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2e3a8-f02d-4258-abd8-298eb1319903 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.705432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2e3a8-f02d-4258-abd8-298eb1319903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-f1b2e3a8-f02d-4258-abd8-298eb1319903 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:13.713221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:13.714208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:13.714995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 88/165] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:13.715654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2e3a8-f02d-4258-abd8-298eb1319903 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:13.815186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8265-1f5d-474e-9cfd-696230647802 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:13.876549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2e3a8-f02d-4258-abd8-298eb1319903 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:13.912287 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee2f79-69f2-4a5f-b8c6-4e35d8d95e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:13.913088 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee2f79-69f2-4a5f-b8c6-4e35d8d95e59 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.913371 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee2f79-69f2-4a5f-b8c6-4e35d8d95e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.913645 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee2f79-69f2-4a5f-b8c6-4e35d8d95e59 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.915302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691bc1-ebea-4089-b35e-90f3a2abd6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:13.916247 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691bc1-ebea-4089-b35e-90f3a2abd6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:13.916523 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691bc1-ebea-4089-b35e-90f3a2abd6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:13.916791 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691bc1-ebea-4089-b35e-90f3a2abd6d9 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:13.917905 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee2f79-69f2-4a5f-b8c6-4e35d8d95e59 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:13.919384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee2f79-69f2-4a5f-b8c6-4e35d8d95e59 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:13.921116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 78/166] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:13 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:13.921892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee2f79-69f2-4a5f-b8c6-4e35d8d95e59 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:13.923112 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8691bc1-ebea-4089-b35e-90f3a2abd6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:13.924896 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8691bc1-ebea-4089-b35e-90f3a2abd6d9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:13.926603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 89/167] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:13 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:13.927364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691bc1-ebea-4089-b35e-90f3a2abd6d9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:14.086088 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee2f79-69f2-4a5f-b8c6-4e35d8d95e59 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:14.128558 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331bc02-aeb3-4fa6-986b-84a45522099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:14.129378 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331bc02-aeb3-4fa6-986b-84a45522099d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:14.129662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331bc02-aeb3-4fa6-986b-84a45522099d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:14.129938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331bc02-aeb3-4fa6-986b-84a45522099d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:14.137030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691bc1-ebea-4089-b35e-90f3a2abd6d9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:14.154777 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331bc02-aeb3-4fa6-986b-84a45522099d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f331bc02-aeb3-4fa6-986b-84a45522099d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:14.163525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:14.164511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:14.165304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:14.174374 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 79/168] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:14.175246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331bc02-aeb3-4fa6-986b-84a45522099d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:14.197814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:14.198486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:14.198767 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:14.199045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:14.199813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:14.200125 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:14.201505 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:14.217056 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 90/169] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:14.217718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:14.332232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331bc02-aeb3-4fa6-986b-84a45522099d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:14.374794 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:14.375829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:14.376306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:14.377110 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:14.378134 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6, user.id=f4e589d5b5944217aa6bbd924fcc21dc) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:14.378638 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:14.381167 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:14.391755 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 80/170] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:14 2022] GET /identity/v3/role_assignments?user.id=f4e589d5b5944217aa6bbd924fcc21dc&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=67227061f74f48f293a12155e904b5fc => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:14.394241 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:14.419671 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f76d24-0bd8-4e79-9975-7c33a86a205f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:14.492601 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:14.493715 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:14.494197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:14.494669 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:14.495792 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] RBAC: Adding query filter params (role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6, user.id=d10b080250d04a0999342a6933d185ca) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:14.496340 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:14.498125 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:14.513636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 91/171] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:14 2022] GET /identity/v3/role_assignments?user.id=d10b080250d04a0999342a6933d185ca&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:14.514825 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:14.639849 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e1096-5284-4abd-b351-6aadc6c5262c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:14.729508 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:14.730214 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:14.730669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:14.731098 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:14.732055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:14.732450 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a3cc5-58bf-491c-9df2-c2c90fcbd6bd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:14.732565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:14.733977 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:14.751193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 81/172] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:14.767162 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:14.791912 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54ba41-7939-4271-a8b6-6b2f98b2a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:14.793129 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54ba41-7939-4271-a8b6-6b2f98b2a94b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:14.793556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54ba41-7939-4271-a8b6-6b2f98b2a94b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:14.793973 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54ba41-7939-4271-a8b6-6b2f98b2a94b None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:14.795366 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54ba41-7939-4271-a8b6-6b2f98b2a94b None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:14.797033 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54ba41-7939-4271-a8b6-6b2f98b2a94b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:14.799598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 92/173] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:14 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:14.804964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54ba41-7939-4271-a8b6-6b2f98b2a94b None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:14.921257 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8507-856e-4659-9101-7fc593e397b3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:14.964117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54ba41-7939-4271-a8b6-6b2f98b2a94b None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:14.976591 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ef2d-d17c-4bbd-904e-14f665071bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:14.977505 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ef2d-d17c-4bbd-904e-14f665071bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:14.977786 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ef2d-d17c-4bbd-904e-14f665071bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:14.978121 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85ef2d-d17c-4bbd-904e-14f665071bb3 None admin] PATH_INFO: `/v3/users/d10b080250d04a0999342a6933d185ca` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:14.979461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85ef2d-d17c-4bbd-904e-14f665071bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=d10b080250d04a0999342a6933d185ca)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:14.981033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85ef2d-d17c-4bbd-904e-14f665071bb3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:14.982642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 82/174] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:14 2022] GET /identity/v3/users/d10b080250d04a0999342a6933d185ca => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:14.989038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ef2d-d17c-4bbd-904e-14f665071bb3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:15.020383 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5de230-5600-405b-8a40-7c279b47394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:15.021095 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5de230-5600-405b-8a40-7c279b47394c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:15.021376 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5de230-5600-405b-8a40-7c279b47394c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:15.021646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5de230-5600-405b-8a40-7c279b47394c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:15.095087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85ef2d-d17c-4bbd-904e-14f665071bb3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:15.130054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ddce4-111b-45e6-bf3a-7eb581e576be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:15.130711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ddce4-111b-45e6-bf3a-7eb581e576be None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:15.130995 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ddce4-111b-45e6-bf3a-7eb581e576be None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:15.131273 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ddce4-111b-45e6-bf3a-7eb581e576be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:15.135805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5de230-5600-405b-8a40-7c279b47394c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:15.137285 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5de230-5600-405b-8a40-7c279b47394c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:15.203817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ddce4-111b-45e6-bf3a-7eb581e576be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:15.205508 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ddce4-111b-45e6-bf3a-7eb581e576be None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:15.305998 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 83/175] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:02:15.311713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ddce4-111b-45e6-bf3a-7eb581e576be None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:15.312510 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 93/176] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:02:15.318206 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5de230-5600-405b-8a40-7c279b47394c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:15.426113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ddce4-111b-45e6-bf3a-7eb581e576be None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:15.456993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5de230-5600-405b-8a40-7c279b47394c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:15.482582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93987b-538f-4658-8989-2edcaedbe7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:15.483440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93987b-538f-4658-8989-2edcaedbe7ec None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:15.487100 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93987b-538f-4658-8989-2edcaedbe7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:15.487370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93987b-538f-4658-8989-2edcaedbe7ec None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:15.489569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93987b-538f-4658-8989-2edcaedbe7ec None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:15.491033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93987b-538f-4658-8989-2edcaedbe7ec None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:15.492957 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 84/177] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:15 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:15.499220 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93987b-538f-4658-8989-2edcaedbe7ec None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:15.528498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7f010-d337-4ce9-be98-820a9021afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:15.529648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7f010-d337-4ce9-be98-820a9021afb2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:15.530082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7f010-d337-4ce9-be98-820a9021afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:15.530505 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7f010-d337-4ce9-be98-820a9021afb2 None admin] PATH_INFO: `/v3/projects/46c01b756ecc4b97b3e60a5cc810d5cb` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:15.531941 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7f010-d337-4ce9-be98-820a9021afb2 None admin] RBAC: Authorizing `identity:get_project(project_id=46c01b756ecc4b97b3e60a5cc810d5cb)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:15.534164 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7f010-d337-4ce9-be98-820a9021afb2 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:15.537252 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 94/178] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:15 2022] GET /identity/v3/projects/46c01b756ecc4b97b3e60a5cc810d5cb => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:15.546299 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7f010-d337-4ce9-be98-820a9021afb2 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:15.659435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93987b-538f-4658-8989-2edcaedbe7ec None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:15.723391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a52808-4ccc-4d9e-bf76-3370b31282e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:15.724354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a52808-4ccc-4d9e-bf76-3370b31282e0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:15.724779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a52808-4ccc-4d9e-bf76-3370b31282e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:15.725187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a52808-4ccc-4d9e-bf76-3370b31282e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:15.726182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a52808-4ccc-4d9e-bf76-3370b31282e0 None admin] RBAC: Adding query filter params (role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6, user.id=d10b080250d04a0999342a6933d185ca) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:15.726630 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a52808-4ccc-4d9e-bf76-3370b31282e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:15.728236 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a52808-4ccc-4d9e-bf76-3370b31282e0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:15.735382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 85/179] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:15 2022] GET /identity/v3/role_assignments?user.id=d10b080250d04a0999342a6933d185ca&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=abb44eff7ea447f6b105452bacf3892b => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:15.762717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7f010-d337-4ce9-be98-820a9021afb2 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:15.803115 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec85cce-7b10-4d77-972d-527cabba61b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:15.804225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec85cce-7b10-4d77-972d-527cabba61b7 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:15.804652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec85cce-7b10-4d77-972d-527cabba61b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:15.805211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec85cce-7b10-4d77-972d-527cabba61b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:15.806202 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec85cce-7b10-4d77-972d-527cabba61b7 None admin] RBAC: Adding query filter params (role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=46c01b756ecc4b97b3e60a5cc810d5cb, user.id=d10b080250d04a0999342a6933d185ca) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:15.806684 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec85cce-7b10-4d77-972d-527cabba61b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:15.808332 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec85cce-7b10-4d77-972d-527cabba61b7 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:15.815516 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 95/180] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:15 2022] GET /identity/v3/role_assignments?user.id=d10b080250d04a0999342a6933d185ca&scope.project.id=46c01b756ecc4b97b3e60a5cc810d5cb&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:16.108094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a8eb-e083-41c1-a25d-e53bd8057cff None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.108762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a8eb-e083-41c1-a25d-e53bd8057cff None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.109243 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3a8eb-e083-41c1-a25d-e53bd8057cff None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.111587 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 86/181] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:16.116786 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff7608-19f9-4119-9bcd-01e806c8a765 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.117393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff7608-19f9-4119-9bcd-01e806c8a765 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.117902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff7608-19f9-4119-9bcd-01e806c8a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.140827 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-93ff7608-19f9-4119-9bcd-01e806c8a765 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:16.143120 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-93ff7608-19f9-4119-9bcd-01e806c8a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:16.231269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 96/182] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:16.257037 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3a8eb-e083-41c1-a25d-e53bd8057cff None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:16.383427 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3a8eb-e083-41c1-a25d-e53bd8057cff None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:16.425347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00de43-0fbe-461c-8fc8-2ba6f020008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:16.426576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00de43-0fbe-461c-8fc8-2ba6f020008a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.427556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00de43-0fbe-461c-8fc8-2ba6f020008a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.428053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00de43-0fbe-461c-8fc8-2ba6f020008a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.447066 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00de43-0fbe-461c-8fc8-2ba6f020008a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-db00de43-0fbe-461c-8fc8-2ba6f020008a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:16.455974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:16.456963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:16.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:16.462840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 87/183] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:16.468474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff7608-19f9-4119-9bcd-01e806c8a765 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:16.557340 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddaeb6-90c6-4a98-b7cf-44e9c28adceb None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.557967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddaeb6-90c6-4a98-b7cf-44e9c28adceb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.558473 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddaeb6-90c6-4a98-b7cf-44e9c28adceb None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.560072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 88/184] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:16.565726 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60422a28-c3cd-49b2-a02d-af0126044687 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.566258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60422a28-c3cd-49b2-a02d-af0126044687 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.566749 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60422a28-c3cd-49b2-a02d-af0126044687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.589254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff7608-19f9-4119-9bcd-01e806c8a765 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:16.594834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-60422a28-c3cd-49b2-a02d-af0126044687 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:16.596964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-60422a28-c3cd-49b2-a02d-af0126044687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:16.630981 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:16.631660 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.631982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.632264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.633021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:16.633333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:16.635814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:16.646285 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 97/185] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:16.651807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:16.672118 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 89/186] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:16.673438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0dfa-ce76-424f-8206-339517ae6d77 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.674203 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0dfa-ce76-424f-8206-339517ae6d77 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.674203 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0dfa-ce76-424f-8206-339517ae6d77 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.675313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 90/187] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:16.681090 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b54f3-9c84-44b3-8714-59809360fc4c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.684412 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b54f3-9c84-44b3-8714-59809360fc4c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.684982 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b54f3-9c84-44b3-8714-59809360fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.706490 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f89b54f3-9c84-44b3-8714-59809360fc4c None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:16.707662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f89b54f3-9c84-44b3-8714-59809360fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:16.764457 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b9d8-3e61-4cd8-85bf-0235d91607e8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:16.787785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 91/188] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:16.787785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b54f3-9c84-44b3-8714-59809360fc4c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:16.815531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63b950-7987-4da8-85cb-b7fad5d06e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:16.816690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63b950-7987-4da8-85cb-b7fad5d06e54 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.817114 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63b950-7987-4da8-85cb-b7fad5d06e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.817529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63b950-7987-4da8-85cb-b7fad5d06e54 None admin] PATH_INFO: `/v3/users/1b6df53592d24558ada125662d6de1b2` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.818907 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63b950-7987-4da8-85cb-b7fad5d06e54 None admin] RBAC: Authorizing `identity:get_user(user_id=1b6df53592d24558ada125662d6de1b2)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:16.820610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63b950-7987-4da8-85cb-b7fad5d06e54 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:16.822487 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 98/189] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:16 2022] GET /identity/v3/users/1b6df53592d24558ada125662d6de1b2 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:16.823528 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63b950-7987-4da8-85cb-b7fad5d06e54 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:16.890044 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b54f3-9c84-44b3-8714-59809360fc4c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:16.923647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e5aa-c86b-4824-a1e8-e4a48ed0fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:16.924485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e5aa-c86b-4824-a1e8-e4a48ed0fee3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.924764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e5aa-c86b-4824-a1e8-e4a48ed0fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.925042 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e5aa-c86b-4824-a1e8-e4a48ed0fee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.933252 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63b950-7987-4da8-85cb-b7fad5d06e54 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:16.934859 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962e5aa-c86b-4824-a1e8-e4a48ed0fee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1962e5aa-c86b-4824-a1e8-e4a48ed0fee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:16.942897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:16.943972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:16.944992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 92/190] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:16.948930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e5aa-c86b-4824-a1e8-e4a48ed0fee3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:16.969582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696f8cf-2275-4380-a90b-c30752c73476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:16.971084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f8cf-2275-4380-a90b-c30752c73476 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:16.971372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f8cf-2275-4380-a90b-c30752c73476 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:16.971625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696f8cf-2275-4380-a90b-c30752c73476 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:16.981607 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696f8cf-2275-4380-a90b-c30752c73476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-2696f8cf-2275-4380-a90b-c30752c73476 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:16.990432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:16.991356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:16.992215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 99/191] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:16.993327 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696f8cf-2275-4380-a90b-c30752c73476 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.055045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e5aa-c86b-4824-a1e8-e4a48ed0fee3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.089618 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d9d03-1f79-4885-b88b-cc470467da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.090276 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d9d03-1f79-4885-b88b-cc470467da38 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.090562 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d9d03-1f79-4885-b88b-cc470467da38 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.090837 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d9d03-1f79-4885-b88b-cc470467da38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.093622 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696f8cf-2275-4380-a90b-c30752c73476 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.126880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.127628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.127937 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.128209 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.128967 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:17.129274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.133111 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.141583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 100/192] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:17.142881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.158755 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d9d03-1f79-4885-b88b-cc470467da38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.160265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d9d03-1f79-4885-b88b-cc470467da38 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.236427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152315ab-e4ba-44b4-98e7-5c5084ceafff None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.253852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 93/193] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:17.255163 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b592-50f9-4dde-8386-64309fbab8af None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.255447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b592-50f9-4dde-8386-64309fbab8af None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.255728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b592-50f9-4dde-8386-64309fbab8af None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.257298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 94/194] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:17.258011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b592-50f9-4dde-8386-64309fbab8af None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.270544 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.271443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.271724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.272026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.272776 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:17.273082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.274446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.282302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 101/195] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:17.283018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.355061 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b592-50f9-4dde-8386-64309fbab8af None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.377872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739914f-5ab7-437f-a893-64e4c861eb49 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.388588 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d6367-b2a4-419f-984c-994c7752d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.389444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6367-b2a4-419f-984c-994c7752d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.389731 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6367-b2a4-419f-984c-994c7752d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.390004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6367-b2a4-419f-984c-994c7752d1f4 None admin] PATH_INFO: `/v3/users/8f2e164a29fa450589ba047adc261334` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.402823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d6367-b2a4-419f-984c-994c7752d1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=8f2e164a29fa450589ba047adc261334)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.404261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d6367-b2a4-419f-984c-994c7752d1f4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.405988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 95/196] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/users/8f2e164a29fa450589ba047adc261334 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:17.407118 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5a89-ef3e-4403-8bdb-e82392e68671 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.407403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5a89-ef3e-4403-8bdb-e82392e68671 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.407682 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5a89-ef3e-4403-8bdb-e82392e68671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.414091 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9db04-b8d7-406a-a74c-10aaf7ce0deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.414974 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9db04-b8d7-406a-a74c-10aaf7ce0deb None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.415247 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9db04-b8d7-406a-a74c-10aaf7ce0deb None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.415525 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9db04-b8d7-406a-a74c-10aaf7ce0deb None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.417042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9db04-b8d7-406a-a74c-10aaf7ce0deb None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.418519 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9db04-b8d7-406a-a74c-10aaf7ce0deb None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.420262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 102/197] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:17.421030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9db04-b8d7-406a-a74c-10aaf7ce0deb None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.424358 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fc8a5a89-ef3e-4403-8bdb-e82392e68671 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:17.425851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fc8a5a89-ef3e-4403-8bdb-e82392e68671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:17.487890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 96/198] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:17.488718 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a5a89-ef3e-4403-8bdb-e82392e68671 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.526301 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9db04-b8d7-406a-a74c-10aaf7ce0deb None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.558474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428631f-e4f0-4335-9e29-c180e6e6f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.559364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428631f-e4f0-4335-9e29-c180e6e6f205 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.559644 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428631f-e4f0-4335-9e29-c180e6e6f205 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.559952 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428631f-e4f0-4335-9e29-c180e6e6f205 None admin] PATH_INFO: `/v3/users/8f2e164a29fa450589ba047adc261334` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.561144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428631f-e4f0-4335-9e29-c180e6e6f205 None admin] RBAC: Authorizing `identity:get_user(user_id=8f2e164a29fa450589ba047adc261334)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.562601 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428631f-e4f0-4335-9e29-c180e6e6f205 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.565194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 103/199] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/users/8f2e164a29fa450589ba047adc261334 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:17.565926 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428631f-e4f0-4335-9e29-c180e6e6f205 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.582701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a5a89-ef3e-4403-8bdb-e82392e68671 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.614941 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2ddc7-0676-4578-84b3-00a4d63eea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.615582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ddc7-0676-4578-84b3-00a4d63eea1c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.615899 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ddc7-0676-4578-84b3-00a4d63eea1c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.616178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2ddc7-0676-4578-84b3-00a4d63eea1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.660792 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428631f-e4f0-4335-9e29-c180e6e6f205 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.679831 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2ddc7-0676-4578-84b3-00a4d63eea1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.681281 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2ddc7-0676-4578-84b3-00a4d63eea1c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.692708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.693357 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.693641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.693919 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.694750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] RBAC: Adding query filter params (role.id=097994ff79ef4bb7a76712f02ac27677, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6, user.id=1b6df53592d24558ada125662d6de1b2) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:17.695062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.696502 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.702235 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 104/200] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/role_assignments?user.id=1b6df53592d24558ada125662d6de1b2&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=097994ff79ef4bb7a76712f02ac27677 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:17.702926 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.787406 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 97/201] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:17.788340 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2ddc7-0676-4578-84b3-00a4d63eea1c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.824642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55f060-902f-4643-a767-dd1ec1b152b5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.859054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf103a3-58ab-4dd6-8860-ab713955cadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.859885 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf103a3-58ab-4dd6-8860-ab713955cadd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.860173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf103a3-58ab-4dd6-8860-ab713955cadd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.860449 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf103a3-58ab-4dd6-8860-ab713955cadd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.861933 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf103a3-58ab-4dd6-8860-ab713955cadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:17.863441 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf103a3-58ab-4dd6-8860-ab713955cadd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:17.865169 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 105/202] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:17.865968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf103a3-58ab-4dd6-8860-ab713955cadd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:17.897179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2ddc7-0676-4578-84b3-00a4d63eea1c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:17.937986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1329-6276-4380-9d30-50cd7ca85275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:17.938646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1329-6276-4380-9d30-50cd7ca85275 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:17.942359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1329-6276-4380-9d30-50cd7ca85275 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:17.942359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1329-6276-4380-9d30-50cd7ca85275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:17.978825 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf103a3-58ab-4dd6-8860-ab713955cadd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:18.007505 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b1329-6276-4380-9d30-50cd7ca85275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:18.009020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b1329-6276-4380-9d30-50cd7ca85275 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:18.010875 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42798985-babe-4e4a-bf55-e9faf0bec485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:18.011729 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798985-babe-4e4a-bf55-e9faf0bec485 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:18.012049 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798985-babe-4e4a-bf55-e9faf0bec485 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:18.012319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798985-babe-4e4a-bf55-e9faf0bec485 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:18.013489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42798985-babe-4e4a-bf55-e9faf0bec485 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:18.014910 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42798985-babe-4e4a-bf55-e9faf0bec485 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:18.016624 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 106/203] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:18.017546 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42798985-babe-4e4a-bf55-e9faf0bec485 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:18.104207 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 98/204] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:18.105057 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1329-6276-4380-9d30-50cd7ca85275 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:18.114240 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42798985-babe-4e4a-bf55-e9faf0bec485 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:18.145577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ef8b0-d7e4-43b9-95eb-ffb21bc027cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:18.146237 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ef8b0-d7e4-43b9-95eb-ffb21bc027cd None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:18.146516 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ef8b0-d7e4-43b9-95eb-ffb21bc027cd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:18.146787 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ef8b0-d7e4-43b9-95eb-ffb21bc027cd None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:18.147486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ef8b0-d7e4-43b9-95eb-ffb21bc027cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:18.148960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ef8b0-d7e4-43b9-95eb-ffb21bc027cd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:18.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 107/205] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:18 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:18.171815 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ef8b0-d7e4-43b9-95eb-ffb21bc027cd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:18.204204 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1329-6276-4380-9d30-50cd7ca85275 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:18.241508 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:18.242179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:18.242458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:18.242792 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:18.243634 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=cfb2458fae474b03952818a61655107f, user.id=8f2e164a29fa450589ba047adc261334) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:18.243978 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:18.245515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:18.252070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 99/206] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:18 2022] GET /identity/v3/role_assignments?user.id=8f2e164a29fa450589ba047adc261334&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=67227061f74f48f293a12155e904b5fc => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:18.282127 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ef8b0-d7e4-43b9-95eb-ffb21bc027cd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:18.320898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d2fde-ab75-4a8d-8cc5-35c9eff1b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:18.321150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2fde-ab75-4a8d-8cc5-35c9eff1b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:18.321394 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2fde-ab75-4a8d-8cc5-35c9eff1b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:18.321576 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2fde-ab75-4a8d-8cc5-35c9eff1b4f5 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:18.322903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d2fde-ab75-4a8d-8cc5-35c9eff1b4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:18.324470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d2fde-ab75-4a8d-8cc5-35c9eff1b4f5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:18.326487 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 108/207] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:18 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:18.333639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:18.443190 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e373db6-c9cc-4ff8-80b4-b1d42621ea09 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:18.478395 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62346a9a-68ea-4c31-acfc-4478fa90e34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:18.478972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62346a9a-68ea-4c31-acfc-4478fa90e34d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:18.479249 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62346a9a-68ea-4c31-acfc-4478fa90e34d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:18.479519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62346a9a-68ea-4c31-acfc-4478fa90e34d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:18.480483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62346a9a-68ea-4c31-acfc-4478fa90e34d None admin] RBAC: Adding query filter params (role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=cfb2458fae474b03952818a61655107f, user.id=8f2e164a29fa450589ba047adc261334) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:18.480739 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62346a9a-68ea-4c31-acfc-4478fa90e34d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:18.482166 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62346a9a-68ea-4c31-acfc-4478fa90e34d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:18.488743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 100/208] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:18 2022] GET /identity/v3/role_assignments?user.id=8f2e164a29fa450589ba047adc261334&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=abb44eff7ea447f6b105452bacf3892b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:20.595865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb605d-d5e3-4c43-9650-818433e1db60 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.596381 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb605d-d5e3-4c43-9650-818433e1db60 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.596495 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb605d-d5e3-4c43-9650-818433e1db60 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.597784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 109/209] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:20.603355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224ffd-5916-4154-a6e7-53ef83b094a4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.603875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224ffd-5916-4154-a6e7-53ef83b094a4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.604052 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78224ffd-5916-4154-a6e7-53ef83b094a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.621708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-78224ffd-5916-4154-a6e7-53ef83b094a4 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:20.622911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-78224ffd-5916-4154-a6e7-53ef83b094a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:20.637694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678cbd-ec72-4d82-aeb9-bfe175d579f8 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.637984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678cbd-ec72-4d82-aeb9-bfe175d579f8 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.638234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc678cbd-ec72-4d82-aeb9-bfe175d579f8 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.639586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 110/210] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:20.645227 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b33ae-075a-46f8-86df-974a6fb192aa None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.645510 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b33ae-075a-46f8-86df-974a6fb192aa None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.645784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b33ae-075a-46f8-86df-974a6fb192aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.663278 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-2c1b33ae-075a-46f8-86df-974a6fb192aa None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:20.664487 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-2c1b33ae-075a-46f8-86df-974a6fb192aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:20.692047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 101/211] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:20.701560 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061830-cc35-452a-8b22-5f099eafd16a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.704043 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061830-cc35-452a-8b22-5f099eafd16a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.704043 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd061830-cc35-452a-8b22-5f099eafd16a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.704043 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 102/212] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:20.712233 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fd50e-7348-481b-a132-5dc81b1c4d8f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.712730 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fd50e-7348-481b-a132-5dc81b1c4d8f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.713177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fd50e-7348-481b-a132-5dc81b1c4d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.730073 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-296fd50e-7348-481b-a132-5dc81b1c4d8f None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:20.731604 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-296fd50e-7348-481b-a132-5dc81b1c4d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:20.735435 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 111/213] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:20.740650 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b33ae-075a-46f8-86df-974a6fb192aa None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:20.798515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 103/214] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:20.800014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a802-529e-4b6d-9f29-8a5c32c60019 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.800275 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a802-529e-4b6d-9f29-8a5c32c60019 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.800594 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a802-529e-4b6d-9f29-8a5c32c60019 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.801947 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 104/215] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:20.804544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209a802-529e-4b6d-9f29-8a5c32c60019 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:20.837158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b33ae-075a-46f8-86df-974a6fb192aa None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:20.868703 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445ed92-42c7-467f-a4a7-530f5c88b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:20.869414 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ed92-42c7-467f-a4a7-530f5c88b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.869690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ed92-42c7-467f-a4a7-530f5c88b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.869959 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ed92-42c7-467f-a4a7-530f5c88b9f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.880018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445ed92-42c7-467f-a4a7-530f5c88b9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-0445ed92-42c7-467f-a4a7-530f5c88b9f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:20.887448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:20.888360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:20.889159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 112/216] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:20.889849 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1b14-2452-457d-a20d-471a838e97d5 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.890386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1b14-2452-457d-a20d-471a838e97d5 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.890386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc1b14-2452-457d-a20d-471a838e97d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.903006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209a802-529e-4b6d-9f29-8a5c32c60019 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:20.911922 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-3fcc1b14-2452-457d-a20d-471a838e97d5 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:20.913090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-3fcc1b14-2452-457d-a20d-471a838e97d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:20.937087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbd37-ce80-4b02-820d-2ff05c80543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:20.937874 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbd37-ce80-4b02-820d-2ff05c80543f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:20.938157 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbd37-ce80-4b02-820d-2ff05c80543f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:20.938434 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbd37-ce80-4b02-820d-2ff05c80543f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:20.948730 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbbd37-ce80-4b02-820d-2ff05c80543f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-e6bbbd37-ce80-4b02-820d-2ff05c80543f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:20.957763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:20.958647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:20.959455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 105/217] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:20.960184 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbd37-ce80-4b02-820d-2ff05c80543f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:20.983369 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 113/218] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:20.984240 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc1b14-2452-457d-a20d-471a838e97d5 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.056614 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbd37-ce80-4b02-820d-2ff05c80543f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.077267 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc1b14-2452-457d-a20d-471a838e97d5 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.088532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618c39-9527-4354-b330-98212a7302f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.089331 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618c39-9527-4354-b330-98212a7302f7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.089617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618c39-9527-4354-b330-98212a7302f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.089892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c618c39-9527-4354-b330-98212a7302f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.091088 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c618c39-9527-4354-b330-98212a7302f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.092545 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c618c39-9527-4354-b330-98212a7302f7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.094150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 106/219] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:21.095676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618c39-9527-4354-b330-98212a7302f7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.111490 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.112206 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.112487 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.112764 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.113512 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:21.113817 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.115197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.123091 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 114/220] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:21.124652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.195999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c618c39-9527-4354-b330-98212a7302f7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.219003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724e01d-7f4e-490b-8be2-2f6838c551d2 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.232760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.233421 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.233698 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.233968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.234722 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:21.235022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.236625 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.244518 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 107/221] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:21.245108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.252244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257e6c6-2828-4c5b-92c2-c2c2bc9e4943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.253054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e6c6-2828-4c5b-92c2-c2c2bc9e4943 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.253347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e6c6-2828-4c5b-92c2-c2c2bc9e4943 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.253626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e6c6-2828-4c5b-92c2-c2c2bc9e4943 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.263489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257e6c6-2828-4c5b-92c2-c2c2bc9e4943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-4257e6c6-2828-4c5b-92c2-c2c2bc9e4943 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:21.272470 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:21.273410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:21.274196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:21.278337 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 115/222] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:21.279170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257e6c6-2828-4c5b-92c2-c2c2bc9e4943 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.337898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca47392-28a2-42d2-86e1-56f4433d047c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.369231 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f00e2-ab11-4a8c-a9d4-fab5c4613834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.369889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f00e2-ab11-4a8c-a9d4-fab5c4613834 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.370169 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f00e2-ab11-4a8c-a9d4-fab5c4613834 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.370444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f00e2-ab11-4a8c-a9d4-fab5c4613834 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.371150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f00e2-ab11-4a8c-a9d4-fab5c4613834 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.372609 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f00e2-ab11-4a8c-a9d4-fab5c4613834 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.373229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257e6c6-2828-4c5b-92c2-c2c2bc9e4943 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.391120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 108/223] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:21 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:21.392476 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f00e2-ab11-4a8c-a9d4-fab5c4613834 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.407056 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21236313-270f-43f8-ae1e-d283b2e305d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.408824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21236313-270f-43f8-ae1e-d283b2e305d4 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.408824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21236313-270f-43f8-ae1e-d283b2e305d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.409105 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21236313-270f-43f8-ae1e-d283b2e305d4 None admin] PATH_INFO: `/v3/users/8f2e164a29fa450589ba047adc261334` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.410485 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21236313-270f-43f8-ae1e-d283b2e305d4 None admin] RBAC: Authorizing `identity:get_user(user_id=8f2e164a29fa450589ba047adc261334)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.412096 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21236313-270f-43f8-ae1e-d283b2e305d4 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 116/224] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/users/8f2e164a29fa450589ba047adc261334 => generated 283 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:21.419370 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21236313-270f-43f8-ae1e-d283b2e305d4 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.507882 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f00e2-ab11-4a8c-a9d4-fab5c4613834 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.527651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21236313-270f-43f8-ae1e-d283b2e305d4 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.545342 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097a189-614e-4de3-9c6f-ccc554ca224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.546701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097a189-614e-4de3-9c6f-ccc554ca224e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.547215 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097a189-614e-4de3-9c6f-ccc554ca224e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.547692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097a189-614e-4de3-9c6f-ccc554ca224e None admin] PATH_INFO: `/v3/users/7fe7af3857c34049806b291b54e9db28` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.562753 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097a189-614e-4de3-9c6f-ccc554ca224e None admin] RBAC: Authorizing `identity:get_user(user_id=7fe7af3857c34049806b291b54e9db28)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.564908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097a189-614e-4de3-9c6f-ccc554ca224e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.566848 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 109/225] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/users/7fe7af3857c34049806b291b54e9db28 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:21.567580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097a189-614e-4de3-9c6f-ccc554ca224e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.573881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.574807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.575094 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.575369 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.576166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:21.576478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.577943 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.588192 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 117/226] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:21.589035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.669628 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097a189-614e-4de3-9c6f-ccc554ca224e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.694145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d68ef-e259-4b06-a97c-e002f8631583 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.707227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4836e8-9c27-4286-aed6-e1614bb63b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.708129 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4836e8-9c27-4286-aed6-e1614bb63b83 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.708468 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4836e8-9c27-4286-aed6-e1614bb63b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.708743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4836e8-9c27-4286-aed6-e1614bb63b83 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.709997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4836e8-9c27-4286-aed6-e1614bb63b83 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.711878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4836e8-9c27-4286-aed6-e1614bb63b83 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.713815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 110/227] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:21.714607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4836e8-9c27-4286-aed6-e1614bb63b83 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.730189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ff32-20d9-4628-b2e8-626d38657e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.731023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ff32-20d9-4628-b2e8-626d38657e15 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.731687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ff32-20d9-4628-b2e8-626d38657e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.732262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8ff32-20d9-4628-b2e8-626d38657e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.819179 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8ff32-20d9-4628-b2e8-626d38657e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.821128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8ff32-20d9-4628-b2e8-626d38657e15 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.827961 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4836e8-9c27-4286-aed6-e1614bb63b83 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:21.866644 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b8af7-ab0d-49e0-90d4-bfd37b1ec1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:21.868004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8af7-ab0d-49e0-90d4-bfd37b1ec1ea None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:21.868527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8af7-ab0d-49e0-90d4-bfd37b1ec1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:21.869050 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8af7-ab0d-49e0-90d4-bfd37b1ec1ea None admin] PATH_INFO: `/v3/users/8f2e164a29fa450589ba047adc261334` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:21.870580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b8af7-ab0d-49e0-90d4-bfd37b1ec1ea None admin] RBAC: Authorizing `identity:get_user(user_id=8f2e164a29fa450589ba047adc261334)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:21.872392 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b8af7-ab0d-49e0-90d4-bfd37b1ec1ea None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:21.874542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 111/228] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/users/8f2e164a29fa450589ba047adc261334 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:21.875565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b8af7-ab0d-49e0-90d4-bfd37b1ec1ea None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.946144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 118/229] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:21.948580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ff32-20d9-4628-b2e8-626d38657e15 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:21.983737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b8af7-ab0d-49e0-90d4-bfd37b1ec1ea None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:22.019377 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856027f-524a-4202-a67c-37f3d279e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:22.020733 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856027f-524a-4202-a67c-37f3d279e180 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:22.021217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856027f-524a-4202-a67c-37f3d279e180 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:22.021692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856027f-524a-4202-a67c-37f3d279e180 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f/users/8f2e164a29fa450589ba047adc261334/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:22.023980 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856027f-524a-4202-a67c-37f3d279e180 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb2458fae474b03952818a61655107f, user_id=8f2e164a29fa450589ba047adc261334, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:22.025681 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856027f-524a-4202-a67c-37f3d279e180 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:22.051657 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 112/230] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:21 2022] PUT /identity/v3/projects/cfb2458fae474b03952818a61655107f/users/8f2e164a29fa450589ba047adc261334/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:22.051657 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856027f-524a-4202-a67c-37f3d279e180 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:22.086032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8ff32-20d9-4628-b2e8-626d38657e15 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:22.136506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16cd87-9b86-4e57-9ec2-75bc89e81997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:22.137393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16cd87-9b86-4e57-9ec2-75bc89e81997 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:22.137670 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16cd87-9b86-4e57-9ec2-75bc89e81997 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:22.137939 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16cd87-9b86-4e57-9ec2-75bc89e81997 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:22.143241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16cd87-9b86-4e57-9ec2-75bc89e81997 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:22.147292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16cd87-9b86-4e57-9ec2-75bc89e81997 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:22.152509 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 119/231] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:21 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:22.158699 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16cd87-9b86-4e57-9ec2-75bc89e81997 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:22.275951 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856027f-524a-4202-a67c-37f3d279e180 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:22.308353 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16cd87-9b86-4e57-9ec2-75bc89e81997 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:22.327220 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde9a14-6b61-4b6b-83d1-209e211b3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:22.328736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde9a14-6b61-4b6b-83d1-209e211b3600 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:22.329268 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde9a14-6b61-4b6b-83d1-209e211b3600 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:22.329853 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde9a14-6b61-4b6b-83d1-209e211b3600 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:22.331267 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde9a14-6b61-4b6b-83d1-209e211b3600 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:22.333096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde9a14-6b61-4b6b-83d1-209e211b3600 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:22.339852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 113/232] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:22 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:22.341300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde9a14-6b61-4b6b-83d1-209e211b3600 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:22.361729 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2b0ab-7bed-49be-b8f6-f2fc5f34ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:22.361729 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b0ab-7bed-49be-b8f6-f2fc5f34ad27 None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:22.361729 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b0ab-7bed-49be-b8f6-f2fc5f34ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:22.361729 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b0ab-7bed-49be-b8f6-f2fc5f34ad27 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f/users/8f2e164a29fa450589ba047adc261334/roles/abb44eff7ea447f6b105452bacf3892b` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:22.363891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2b0ab-7bed-49be-b8f6-f2fc5f34ad27 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb2458fae474b03952818a61655107f, user_id=8f2e164a29fa450589ba047adc261334, role_id=abb44eff7ea447f6b105452bacf3892b)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:22.365358 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2b0ab-7bed-49be-b8f6-f2fc5f34ad27 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:22.395945 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 120/233] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:22 2022] PUT /identity/v3/projects/cfb2458fae474b03952818a61655107f/users/8f2e164a29fa450589ba047adc261334/roles/abb44eff7ea447f6b105452bacf3892b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:22.471300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde9a14-6b61-4b6b-83d1-209e211b3600 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:22.508058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320ff62-eaf1-4792-ad56-153ba1aa295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:22.508712 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ff62-eaf1-4792-ad56-153ba1aa295c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:22.508990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ff62-eaf1-4792-ad56-153ba1aa295c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:22.509261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320ff62-eaf1-4792-ad56-153ba1aa295c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:22.510092 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ff62-eaf1-4792-ad56-153ba1aa295c None admin] RBAC: Adding query filter params (role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=cfb2458fae474b03952818a61655107f, user.id=7fe7af3857c34049806b291b54e9db28) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:22.510404 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ff62-eaf1-4792-ad56-153ba1aa295c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:22.511875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320ff62-eaf1-4792-ad56-153ba1aa295c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:22.518507 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 114/234] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:22 2022] GET /identity/v3/role_assignments?user.id=7fe7af3857c34049806b291b54e9db28&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:24.142782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bef93-acc0-4f27-becd-8202dccc6d34 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:24.143320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bef93-acc0-4f27-becd-8202dccc6d34 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:24.143320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bef93-acc0-4f27-becd-8202dccc6d34 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:24.144870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 121/235] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:24.155268 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c3da3-8fc4-4852-a6ec-ce6c3bd4068c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:24.155268 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c3da3-8fc4-4852-a6ec-ce6c3bd4068c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:24.155268 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c3da3-8fc4-4852-a6ec-ce6c3bd4068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:24.189338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a87c3da3-8fc4-4852-a6ec-ce6c3bd4068c None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:24.190967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a87c3da3-8fc4-4852-a6ec-ce6c3bd4068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:24.287701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 115/236] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:24.323020 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bef93-acc0-4f27-becd-8202dccc6d34 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:24.348608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdec4c-2dc5-4fe4-8eb6-613cd36042d2 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:24.348906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdec4c-2dc5-4fe4-8eb6-613cd36042d2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:24.349070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdec4c-2dc5-4fe4-8eb6-613cd36042d2 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:24.350432 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 116/237] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:24.357463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823ed2-4fea-4de3-a94b-2094af24a3fc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:24.357752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823ed2-4fea-4de3-a94b-2094af24a3fc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:24.358029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96823ed2-4fea-4de3-a94b-2094af24a3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:24.393819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-96823ed2-4fea-4de3-a94b-2094af24a3fc None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:24.394041 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-96823ed2-4fea-4de3-a94b-2094af24a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:24.560648 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 117/238] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:24.575659 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bef93-acc0-4f27-becd-8202dccc6d34 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:24.600778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96823ed2-4fea-4de3-a94b-2094af24a3fc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:24.681080 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312039b2-c89a-41d9-8277-10833c134f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:24.681898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312039b2-c89a-41d9-8277-10833c134f61 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:24.682178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312039b2-c89a-41d9-8277-10833c134f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:24.682445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312039b2-c89a-41d9-8277-10833c134f61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:24.683839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312039b2-c89a-41d9-8277-10833c134f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:24.685099 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312039b2-c89a-41d9-8277-10833c134f61 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:24.687021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 122/239] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:24.696753 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312039b2-c89a-41d9-8277-10833c134f61 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:24.739386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96823ed2-4fea-4de3-a94b-2094af24a3fc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:24.779856 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd8b3b-0525-4860-bc47-1500c0e7c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:24.780661 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd8b3b-0525-4860-bc47-1500c0e7c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:24.780938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd8b3b-0525-4860-bc47-1500c0e7c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:24.781206 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd8b3b-0525-4860-bc47-1500c0e7c6d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:24.804017 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd8b3b-0525-4860-bc47-1500c0e7c6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-56dd8b3b-0525-4860-bc47-1500c0e7c6d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:24.811662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:24.812596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:24.813393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 118/240] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:24.818602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd8b3b-0525-4860-bc47-1500c0e7c6d4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:24.911354 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312039b2-c89a-41d9-8277-10833c134f61 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:24.983945 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd8b3b-0525-4860-bc47-1500c0e7c6d4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:24.987924 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdba14-4b9a-4169-b660-eba374521eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:24.988619 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdba14-4b9a-4169-b660-eba374521eda None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:24.988900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdba14-4b9a-4169-b660-eba374521eda None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:24.989171 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdba14-4b9a-4169-b660-eba374521eda None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:24.989891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdba14-4b9a-4169-b660-eba374521eda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:24.991375 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdba14-4b9a-4169-b660-eba374521eda None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:25.025319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 123/241] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:24 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:25.044061 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9af4b-0853-4768-9d28-5ec60e73385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:25.044791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9af4b-0853-4768-9d28-5ec60e73385a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.045073 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9af4b-0853-4768-9d28-5ec60e73385a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.045347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9af4b-0853-4768-9d28-5ec60e73385a None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.046108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9af4b-0853-4768-9d28-5ec60e73385a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:25.046412 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9af4b-0853-4768-9d28-5ec60e73385a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:25.048403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9af4b-0853-4768-9d28-5ec60e73385a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:25.058237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 119/242] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:25.064683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdba14-4b9a-4169-b660-eba374521eda None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:25.176690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdba14-4b9a-4169-b660-eba374521eda None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:25.201608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78d33-b54b-4024-a646-74625ae9e6d3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.202580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78d33-b54b-4024-a646-74625ae9e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.203049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee78d33-b54b-4024-a646-74625ae9e6d3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.205771 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 120/243] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:25.211340 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938745-a884-4df3-84fa-a5694be146be None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.211963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938745-a884-4df3-84fa-a5694be146be None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.212432 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da938745-a884-4df3-84fa-a5694be146be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.216062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c09d9-6a20-44e3-a799-4f79f85f14c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:25.217048 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c09d9-6a20-44e3-a799-4f79f85f14c4 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.217336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c09d9-6a20-44e3-a799-4f79f85f14c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.217612 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c09d9-6a20-44e3-a799-4f79f85f14c4 None admin] PATH_INFO: `/v3/users/9b9edcdbb4e84709867935dc85652b21` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.231201 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-da938745-a884-4df3-84fa-a5694be146be None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:25.232428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-da938745-a884-4df3-84fa-a5694be146be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:25.233042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c09d9-6a20-44e3-a799-4f79f85f14c4 None admin] RBAC: Authorizing `identity:get_user(user_id=9b9edcdbb4e84709867935dc85652b21)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:25.234737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c09d9-6a20-44e3-a799-4f79f85f14c4 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:25.237219 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 124/244] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:25 2022] GET /identity/v3/users/9b9edcdbb4e84709867935dc85652b21 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:25.246881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c09d9-6a20-44e3-a799-4f79f85f14c4 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:25.312440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 121/245] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:25.320386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921a29-a40f-4be8-a50b-221e3027e894 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.320386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921a29-a40f-4be8-a50b-221e3027e894 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.320386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921a29-a40f-4be8-a50b-221e3027e894 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.320386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 122/246] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:25.327222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6893-470c-4f0d-ac31-4c138162d6b2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.327560 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6893-470c-4f0d-ac31-4c138162d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.327874 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6893-470c-4f0d-ac31-4c138162d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-82bc6893-470c-4f0d-ac31-4c138162d6b2 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:25.348079 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-82bc6893-470c-4f0d-ac31-4c138162d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:25.380614 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c09d9-6a20-44e3-a799-4f79f85f14c4 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:25.419092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23426e6-a343-44d7-9d83-25e8b51931cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:25.420044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23426e6-a343-44d7-9d83-25e8b51931cc None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.420324 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23426e6-a343-44d7-9d83-25e8b51931cc None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.420589 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23426e6-a343-44d7-9d83-25e8b51931cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.424467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 123/247] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:25.436740 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6893-470c-4f0d-ac31-4c138162d6b2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:25.501586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23426e6-a343-44d7-9d83-25e8b51931cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:25.503094 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23426e6-a343-44d7-9d83-25e8b51931cc None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:25.555326 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6893-470c-4f0d-ac31-4c138162d6b2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:25.589847 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60f2e9-31a9-4344-91bb-69c2cc79130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:25.590710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f2e9-31a9-4344-91bb-69c2cc79130a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.591031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f2e9-31a9-4344-91bb-69c2cc79130a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.591308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f2e9-31a9-4344-91bb-69c2cc79130a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.602386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60f2e9-31a9-4344-91bb-69c2cc79130a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1f60f2e9-31a9-4344-91bb-69c2cc79130a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:25.610785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:25.611676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:25.612538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 124/248] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:25.613678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8fda0-ebb3-4f90-83fa-d586b3e45cdd None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.613846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8fda0-ebb3-4f90-83fa-d586b3e45cdd None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.615405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8fda0-ebb3-4f90-83fa-d586b3e45cdd None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.615405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 125/249] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:25.619686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 125/250] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:02:25.620592 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8fda0-ebb3-4f90-83fa-d586b3e45cdd None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:25.621485 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa942-7e02-4eeb-a45d-1651722d4dc8 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.621772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa942-7e02-4eeb-a45d-1651722d4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.622049 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa942-7e02-4eeb-a45d-1651722d4dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.640918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-521fa942-7e02-4eeb-a45d-1651722d4dc8 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:25.642651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-521fa942-7e02-4eeb-a45d-1651722d4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:25.733254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 126/251] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:25.734039 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa942-7e02-4eeb-a45d-1651722d4dc8 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:25.748271 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8fda0-ebb3-4f90-83fa-d586b3e45cdd None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:25.790735 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989bb25-641d-469e-a32e-f9a22c3ef8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:25.792016 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989bb25-641d-469e-a32e-f9a22c3ef8cd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.792303 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989bb25-641d-469e-a32e-f9a22c3ef8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.792856 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989bb25-641d-469e-a32e-f9a22c3ef8cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.808358 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989bb25-641d-469e-a32e-f9a22c3ef8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-c989bb25-641d-469e-a32e-f9a22c3ef8cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:25.818148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:25.820543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 126/252] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:25.822542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989bb25-641d-469e-a32e-f9a22c3ef8cd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:25.848970 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa942-7e02-4eeb-a45d-1651722d4dc8 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:25.888563 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:25.889708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:25.889996 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:25.890273 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:25.891312 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:25.891695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:25.893967 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:25.904688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 127/253] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:25.905861 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:25.946016 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989bb25-641d-469e-a32e-f9a22c3ef8cd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.005815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf902a6-78cf-4c47-8437-b6305d128de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.007564 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf902a6-78cf-4c47-8437-b6305d128de3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.008389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf902a6-78cf-4c47-8437-b6305d128de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.008851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf902a6-78cf-4c47-8437-b6305d128de3 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.010943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf902a6-78cf-4c47-8437-b6305d128de3 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:26.014222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf902a6-78cf-4c47-8437-b6305d128de3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:26.018076 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 127/254] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:25 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:26.019456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf902a6-78cf-4c47-8437-b6305d128de3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:26.043224 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b639c8-8b4f-434a-b98f-0da54be210cf None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.088796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1714d-25f9-4600-b2c6-d3eb12c19cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.088796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1714d-25f9-4600-b2c6-d3eb12c19cdf None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.088796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1714d-25f9-4600-b2c6-d3eb12c19cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.088796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1714d-25f9-4600-b2c6-d3eb12c19cdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.103828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1714d-25f9-4600-b2c6-d3eb12c19cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-71a1714d-25f9-4600-b2c6-d3eb12c19cdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:26.111306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:26.112754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:26.113564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 128/255] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:26.114223 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1714d-25f9-4600-b2c6-d3eb12c19cdf None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:26.128716 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf902a6-78cf-4c47-8437-b6305d128de3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.163361 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.164150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.164492 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.164829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.165658 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:26.166026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:26.167456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:26.176680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 128/256] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:26.177485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:26.240600 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1714d-25f9-4600-b2c6-d3eb12c19cdf None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.279333 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d44aa-f118-4290-8f12-877d2e39a0a9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.281663 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb6f0e-0e85-45c2-818d-437e20b54020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.283328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb6f0e-0e85-45c2-818d-437e20b54020 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.283607 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb6f0e-0e85-45c2-818d-437e20b54020 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.283910 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb6f0e-0e85-45c2-818d-437e20b54020 None admin] PATH_INFO: `/v3/users/8f2e164a29fa450589ba047adc261334` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.285110 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb6f0e-0e85-45c2-818d-437e20b54020 None admin] RBAC: Authorizing `identity:get_user(user_id=8f2e164a29fa450589ba047adc261334)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:26.286560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb6f0e-0e85-45c2-818d-437e20b54020 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:26.288599 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 129/257] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/users/8f2e164a29fa450589ba047adc261334 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:26.289756 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb6f0e-0e85-45c2-818d-437e20b54020 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:26.315275 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.316036 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.316399 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.316741 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.317686 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] RBAC: Adding query filter params (role.id=097994ff79ef4bb7a76712f02ac27677, scope.project.id=cfb2458fae474b03952818a61655107f, user.id=9b9edcdbb4e84709867935dc85652b21) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:26.318059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:26.319707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:26.325456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 129/258] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/role_assignments?user.id=9b9edcdbb4e84709867935dc85652b21&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=097994ff79ef4bb7a76712f02ac27677 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:26.332902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:26.403922 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb6f0e-0e85-45c2-818d-437e20b54020 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.444114 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.444800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.445076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.445349 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.446661 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:26.446980 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:26.448417 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:26.458590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 130/259] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:26.459617 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:26.581466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c86ca0-4441-41e9-98d2-e2d3ce6d0580 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.582884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7168638-0d67-4649-a367-d886edc0a113 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.623157 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4d023-cf0e-4801-abb5-df5ade4c8a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.623862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4d023-cf0e-4801-abb5-df5ade4c8a78 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.624253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4d023-cf0e-4801-abb5-df5ade4c8a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.624540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4d023-cf0e-4801-abb5-df5ade4c8a78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.625739 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4a0f-3f09-4d42-8c09-da916b0fd8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.627217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4a0f-3f09-4d42-8c09-da916b0fd8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.627507 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4a0f-3f09-4d42-8c09-da916b0fd8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.627791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4a0f-3f09-4d42-8c09-da916b0fd8c6 None admin] PATH_INFO: `/v3/users/8f2e164a29fa450589ba047adc261334` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.635815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c4a0f-3f09-4d42-8c09-da916b0fd8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=8f2e164a29fa450589ba047adc261334)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:26.635815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c4a0f-3f09-4d42-8c09-da916b0fd8c6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:26.635815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 130/260] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/users/8f2e164a29fa450589ba047adc261334 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:26.637138 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4a0f-3f09-4d42-8c09-da916b0fd8c6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:26.746341 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4a0f-3f09-4d42-8c09-da916b0fd8c6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.783124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cdc52-e2db-4746-b3d6-d6d957347a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.784023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdc52-e2db-4746-b3d6-d6d957347a1d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.784300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdc52-e2db-4746-b3d6-d6d957347a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.784571 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdc52-e2db-4746-b3d6-d6d957347a1d None admin] PATH_INFO: `/v3/users/7fe7af3857c34049806b291b54e9db28` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.785777 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cdc52-e2db-4746-b3d6-d6d957347a1d None admin] RBAC: Authorizing `identity:get_user(user_id=7fe7af3857c34049806b291b54e9db28)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:26.787750 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cdc52-e2db-4746-b3d6-d6d957347a1d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:26.789568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 131/261] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/users/7fe7af3857c34049806b291b54e9db28 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:26.790146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cdc52-e2db-4746-b3d6-d6d957347a1d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:26.792616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4d023-cf0e-4801-abb5-df5ade4c8a78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:26.794074 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4d023-cf0e-4801-abb5-df5ade4c8a78 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:26.902528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cdc52-e2db-4746-b3d6-d6d957347a1d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:26.944487 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe9f3-3a4f-4df4-a71d-feb7f166e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:26.945147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe9f3-3a4f-4df4-a71d-feb7f166e80c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:26.945427 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe9f3-3a4f-4df4-a71d-feb7f166e80c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:26.945703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe9f3-3a4f-4df4-a71d-feb7f166e80c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:26.990838 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 131/262] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:26.991713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4d023-cf0e-4801-abb5-df5ade4c8a78 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:27.023408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe9f3-3a4f-4df4-a71d-feb7f166e80c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:27.025196 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe9f3-3a4f-4df4-a71d-feb7f166e80c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:27.131772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 132/263] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:27.133110 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe9f3-3a4f-4df4-a71d-feb7f166e80c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:27.229522 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4d023-cf0e-4801-abb5-df5ade4c8a78 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:27.263642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b7c4f-6d18-48aa-b43c-eae8165b0689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:27.264547 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7c4f-6d18-48aa-b43c-eae8165b0689 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.264834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7c4f-6d18-48aa-b43c-eae8165b0689 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.265111 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7c4f-6d18-48aa-b43c-eae8165b0689 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.266315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b7c4f-6d18-48aa-b43c-eae8165b0689 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:27.268334 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b7c4f-6d18-48aa-b43c-eae8165b0689 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:27.270212 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 132/264] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:26 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:27.270814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b7c4f-6d18-48aa-b43c-eae8165b0689 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:27.274744 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe9f3-3a4f-4df4-a71d-feb7f166e80c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:27.341032 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2551f1-4858-4c5d-9a36-6b77784077df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:27.341906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2551f1-4858-4c5d-9a36-6b77784077df None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.342187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2551f1-4858-4c5d-9a36-6b77784077df None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.342463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2551f1-4858-4c5d-9a36-6b77784077df None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.344550 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2551f1-4858-4c5d-9a36-6b77784077df None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:27.346544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2551f1-4858-4c5d-9a36-6b77784077df None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:27.348305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 133/265] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:27 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:27.349049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2551f1-4858-4c5d-9a36-6b77784077df None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:27.374122 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b7c4f-6d18-48aa-b43c-eae8165b0689 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:27.410105 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39236114-51e2-4803-b996-5f52f013ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:27.411047 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236114-51e2-4803-b996-5f52f013ed2a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.411320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236114-51e2-4803-b996-5f52f013ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.411641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39236114-51e2-4803-b996-5f52f013ed2a None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.412891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39236114-51e2-4803-b996-5f52f013ed2a None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:27.414412 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39236114-51e2-4803-b996-5f52f013ed2a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:27.416145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 133/266] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:27 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:27.416909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39236114-51e2-4803-b996-5f52f013ed2a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:27.518050 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39236114-51e2-4803-b996-5f52f013ed2a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:27.539216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2551f1-4858-4c5d-9a36-6b77784077df None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:27.552547 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:27.553201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.553524 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.553798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.554621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] RBAC: Adding query filter params (role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=cfb2458fae474b03952818a61655107f, user.id=8f2e164a29fa450589ba047adc261334) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:27.554923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:27.556380 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:27.562228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 134/267] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:27 2022] GET /identity/v3/role_assignments?user.id=8f2e164a29fa450589ba047adc261334&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=abb44eff7ea447f6b105452bacf3892b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:27.563006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:27.573633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a162d-9e0a-48a4-97c3-bf281893f414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:27.574539 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a162d-9e0a-48a4-97c3-bf281893f414 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.574818 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a162d-9e0a-48a4-97c3-bf281893f414 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.575092 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a162d-9e0a-48a4-97c3-bf281893f414 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f/users/7fe7af3857c34049806b291b54e9db28/roles/969f252ad8ce4e4e8be6b6d5e6590338` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.577281 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a162d-9e0a-48a4-97c3-bf281893f414 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb2458fae474b03952818a61655107f, user_id=7fe7af3857c34049806b291b54e9db28, role_id=969f252ad8ce4e4e8be6b6d5e6590338)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:27.579037 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a162d-9e0a-48a4-97c3-bf281893f414 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:27.599284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 134/268] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:27 2022] PUT /identity/v3/projects/cfb2458fae474b03952818a61655107f/users/7fe7af3857c34049806b291b54e9db28/roles/969f252ad8ce4e4e8be6b6d5e6590338 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:27.709260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4187-f339-4800-9749-1ad69e2cf570 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:27.760734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11e58d-3c0f-4ed1-a83e-4e99624dab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:27.761431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e58d-3c0f-4ed1-a83e-4e99624dab88 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.761712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e58d-3c0f-4ed1-a83e-4e99624dab88 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.761991 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11e58d-3c0f-4ed1-a83e-4e99624dab88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.762888 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11e58d-3c0f-4ed1-a83e-4e99624dab88 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=cfb2458fae474b03952818a61655107f, user.id=8f2e164a29fa450589ba047adc261334) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:27.763203 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11e58d-3c0f-4ed1-a83e-4e99624dab88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:27.764822 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11e58d-3c0f-4ed1-a83e-4e99624dab88 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:27.777812 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 135/269] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:27 2022] GET /identity/v3/role_assignments?user.id=8f2e164a29fa450589ba047adc261334&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=67227061f74f48f293a12155e904b5fc => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:27.981040 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bdb0a-7a9b-41bb-9ff4-f525c1a0607e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.981406 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bdb0a-7a9b-41bb-9ff4-f525c1a0607e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.981672 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bdb0a-7a9b-41bb-9ff4-f525c1a0607e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.983338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 135/270] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:27.990681 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b4c2-f247-4ef4-b0de-7a644a7552d1 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.990990 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b4c2-f247-4ef4-b0de-7a644a7552d1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.991148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197534c2-6e1e-4060-a99e-7b093aa0d943 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:27.991299 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6b4c2-f247-4ef4-b0de-7a644a7552d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.991461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197534c2-6e1e-4060-a99e-7b093aa0d943 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:27.991604 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197534c2-6e1e-4060-a99e-7b093aa0d943 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:27.993197 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 136/271] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:28.004557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28738545-a6a2-46f7-b8ec-83f7157cb611 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:28.004557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28738545-a6a2-46f7-b8ec-83f7157cb611 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:28.004557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28738545-a6a2-46f7-b8ec-83f7157cb611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:28.010951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-8aa6b4c2-f247-4ef4-b0de-7a644a7552d1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:28.012486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-8aa6b4c2-f247-4ef4-b0de-7a644a7552d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:28.050200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-28738545-a6a2-46f7-b8ec-83f7157cb611 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:28.051363 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-28738545-a6a2-46f7-b8ec-83f7157cb611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:28.095497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 136/272] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:28.127291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6b4c2-f247-4ef4-b0de-7a644a7552d1 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:28.148876 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 137/273] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:28.183087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28738545-a6a2-46f7-b8ec-83f7157cb611 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:28.250303 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6b4c2-f247-4ef4-b0de-7a644a7552d1 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:28.294666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d518c-6793-49d3-9db3-7d9377c61025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:28.296147 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d518c-6793-49d3-9db3-7d9377c61025 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:28.296569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d518c-6793-49d3-9db3-7d9377c61025 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:28.296981 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d518c-6793-49d3-9db3-7d9377c61025 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:28.308992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d518c-6793-49d3-9db3-7d9377c61025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:28.314284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28738545-a6a2-46f7-b8ec-83f7157cb611 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-155d518c-6793-49d3-9db3-7d9377c61025 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:28.319054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:28.319992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:28.320819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:28.323473 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 137/274] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:28.331244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d518c-6793-49d3-9db3-7d9377c61025 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:28.354676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04d3f-adb8-4b7c-b858-5ddc673421a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:28.356130 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04d3f-adb8-4b7c-b858-5ddc673421a9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:28.356562 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04d3f-adb8-4b7c-b858-5ddc673421a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:28.357555 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04d3f-adb8-4b7c-b858-5ddc673421a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:28.359351 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04d3f-adb8-4b7c-b858-5ddc673421a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:28.362442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04d3f-adb8-4b7c-b858-5ddc673421a9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:28.364790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 138/275] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:28.370793 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04d3f-adb8-4b7c-b858-5ddc673421a9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:28.473738 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d518c-6793-49d3-9db3-7d9377c61025 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:28.495624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04d3f-adb8-4b7c-b858-5ddc673421a9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:28.520271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:28.521040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:28.521810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:28.522165 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:28.523256 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:28.523643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:28.525600 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:28.536181 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ceabc-9476-47df-b314-ff8873fec41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:28.537082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ceabc-9476-47df-b314-ff8873fec41a None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:28.537561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ceabc-9476-47df-b314-ff8873fec41a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:28.537711 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 138/276] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:28.539195 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ceabc-9476-47df-b314-ff8873fec41a None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:28.543212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ceabc-9476-47df-b314-ff8873fec41a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:28.543212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ceabc-9476-47df-b314-ff8873fec41a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:28.544433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:28.571871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 139/277] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:28 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:28.674282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317993e5-6a15-4380-a57a-58ed1de6821e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:28.719252 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c18c31-ec36-4b58-86f8-81ff8f099989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:28.721501 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18c31-ec36-4b58-86f8-81ff8f099989 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:28.722019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18c31-ec36-4b58-86f8-81ff8f099989 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:28.722491 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18c31-ec36-4b58-86f8-81ff8f099989 None admin] PATH_INFO: `/v3/users/504a724a5bd7412397ce2416408af74d` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:28.738295 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c18c31-ec36-4b58-86f8-81ff8f099989 None admin] RBAC: Authorizing `identity:get_user(user_id=504a724a5bd7412397ce2416408af74d)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:28.740170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c18c31-ec36-4b58-86f8-81ff8f099989 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:28.742568 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 139/278] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:28 2022] GET /identity/v3/users/504a724a5bd7412397ce2416408af74d => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:28.748728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ceabc-9476-47df-b314-ff8873fec41a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:28.862180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ceabc-9476-47df-b314-ff8873fec41a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:28.898135 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58a876-2071-448b-bb7e-6db6895eb0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:28.899201 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a876-2071-448b-bb7e-6db6895eb0ae None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:28.899704 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a876-2071-448b-bb7e-6db6895eb0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:28.900220 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58a876-2071-448b-bb7e-6db6895eb0ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:28.901246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58a876-2071-448b-bb7e-6db6895eb0ae None admin] RBAC: Adding query filter params (role.id=969f252ad8ce4e4e8be6b6d5e6590338, user.id=504a724a5bd7412397ce2416408af74d, scope.system=all) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:28.901756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58a876-2071-448b-bb7e-6db6895eb0ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:28.903479 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58a876-2071-448b-bb7e-6db6895eb0ae None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:28.909735 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 140/279] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:02:28 2022] GET /identity/v3/role_assignments?user.id=504a724a5bd7412397ce2416408af74d&scope.system=all&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:29.174189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d001d-d826-4e13-a8a3-e2f8b4f51f9c None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:29.174801 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d001d-d826-4e13-a8a3-e2f8b4f51f9c None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:29.175276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d001d-d826-4e13-a8a3-e2f8b4f51f9c None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:29.177168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 140/280] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:29.182285 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb101b-8ea9-4427-867a-2019f99324cf None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:29.182806 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb101b-8ea9-4427-867a-2019f99324cf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:29.183278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb101b-8ea9-4427-867a-2019f99324cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:29.205721 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f1cb101b-8ea9-4427-867a-2019f99324cf None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:29.207265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f1cb101b-8ea9-4427-867a-2019f99324cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:29.285332 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 141/281] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:29.307639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d001d-d826-4e13-a8a3-e2f8b4f51f9c None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:29.444476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d001d-d826-4e13-a8a3-e2f8b4f51f9c None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:29.493086 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e2943-af9d-4d11-aaca-36d51bd2e137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:29.493942 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e2943-af9d-4d11-aaca-36d51bd2e137 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:29.495995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e2943-af9d-4d11-aaca-36d51bd2e137 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:29.495995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e2943-af9d-4d11-aaca-36d51bd2e137 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:29.514557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e2943-af9d-4d11-aaca-36d51bd2e137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-4d2e2943-af9d-4d11-aaca-36d51bd2e137 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:29.522642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:29.523580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:29.524446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 141/282] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:29.529659 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb101b-8ea9-4427-867a-2019f99324cf None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:29.695887 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb101b-8ea9-4427-867a-2019f99324cf None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:29.742769 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:29.743438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:29.743714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:29.744011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:29.744759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:29.745071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:29.746458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:29.759387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 142/283] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:29.764633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e2943-af9d-4d11-aaca-36d51bd2e137 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:29.883201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e2943-af9d-4d11-aaca-36d51bd2e137 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:29.919489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372491-d6f5-4593-bf61-7dbaffbc1cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:29.920789 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372491-d6f5-4593-bf61-7dbaffbc1cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:29.921292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372491-d6f5-4593-bf61-7dbaffbc1cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:29.921760 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35372491-d6f5-4593-bf61-7dbaffbc1cc6 None admin] PATH_INFO: `/v3/users/9b9edcdbb4e84709867935dc85652b21` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:29.923417 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35372491-d6f5-4593-bf61-7dbaffbc1cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=9b9edcdbb4e84709867935dc85652b21)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:29.925105 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35372491-d6f5-4593-bf61-7dbaffbc1cc6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:29.926916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 142/284] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:29 2022] GET /identity/v3/users/9b9edcdbb4e84709867935dc85652b21 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:29.932474 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:30.087165 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68059c5b-be26-4a9e-8fc2-15b18a7bf9ef None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:30.142925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13a9af-60cd-4b73-ab7c-34aa52f37356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:30.143515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a9af-60cd-4b73-ab7c-34aa52f37356 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:30.143811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a9af-60cd-4b73-ab7c-34aa52f37356 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:30.144089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13a9af-60cd-4b73-ab7c-34aa52f37356 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:30.148707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a9af-60cd-4b73-ab7c-34aa52f37356 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:30.150216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13a9af-60cd-4b73-ab7c-34aa52f37356 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:30.152489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 143/285] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:29 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:30.159146 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372491-d6f5-4593-bf61-7dbaffbc1cc6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:30.295843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35372491-d6f5-4593-bf61-7dbaffbc1cc6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:30.329841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef870c80-ef7d-4df7-8568-7cd9492ef284 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:30.330011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef870c80-ef7d-4df7-8568-7cd9492ef284 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:30.330278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef870c80-ef7d-4df7-8568-7cd9492ef284 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:30.332006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 144/286] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:30.334095 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf07191-ce14-43d8-a746-90cb0dcd6379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:30.335606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf07191-ce14-43d8-a746-90cb0dcd6379 None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:30.336122 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf07191-ce14-43d8-a746-90cb0dcd6379 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:30.336643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf07191-ce14-43d8-a746-90cb0dcd6379 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f/users/9b9edcdbb4e84709867935dc85652b21/roles/097994ff79ef4bb7a76712f02ac27677` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:30.337143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a0f0-a377-4ad0-b1f8-aff3cdeb947a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:30.337433 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a0f0-a377-4ad0-b1f8-aff3cdeb947a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:30.337713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a0f0-a377-4ad0-b1f8-aff3cdeb947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:30.339455 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf07191-ce14-43d8-a746-90cb0dcd6379 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb2458fae474b03952818a61655107f, user_id=9b9edcdbb4e84709867935dc85652b21, role_id=097994ff79ef4bb7a76712f02ac27677)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:30.341215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf07191-ce14-43d8-a746-90cb0dcd6379 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:30.360850 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-3069a0f0-a377-4ad0-b1f8-aff3cdeb947a None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:30.362113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-3069a0f0-a377-4ad0-b1f8-aff3cdeb947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:30.370540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 143/287] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:02:30 2022] PUT /identity/v3/projects/cfb2458fae474b03952818a61655107f/users/9b9edcdbb4e84709867935dc85652b21/roles/097994ff79ef4bb7a76712f02ac27677 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:30.448022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 145/288] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:30.480991 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf07191-ce14-43d8-a746-90cb0dcd6379 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:30.627790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf07191-ce14-43d8-a746-90cb0dcd6379 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:30.671173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c27b3-fabe-4d12-aee9-24a2621e45bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:30.672010 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c27b3-fabe-4d12-aee9-24a2621e45bd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:30.672298 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c27b3-fabe-4d12-aee9-24a2621e45bd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:30.672576 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c27b3-fabe-4d12-aee9-24a2621e45bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:30.687500 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c27b3-fabe-4d12-aee9-24a2621e45bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-c15c27b3-fabe-4d12-aee9-24a2621e45bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:30.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:30.696443 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:30.697251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 144/289] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:30.702699 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069a0f0-a377-4ad0-b1f8-aff3cdeb947a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:30.867780 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069a0f0-a377-4ad0-b1f8-aff3cdeb947a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:30.917894 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:30.918489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:30.918772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:30.919048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:30.919808 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:30.920119 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:30.921485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:30.931002 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 146/290] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:30.936263 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c27b3-fabe-4d12-aee9-24a2621e45bd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:31.085018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c27b3-fabe-4d12-aee9-24a2621e45bd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:31.137628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93584500-6042-4cef-bad6-a418b24e358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:31.138510 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584500-6042-4cef-bad6-a418b24e358f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.138792 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584500-6042-4cef-bad6-a418b24e358f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.139069 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584500-6042-4cef-bad6-a418b24e358f None admin] PATH_INFO: `/v3/users/7fe7af3857c34049806b291b54e9db28` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:31.144548 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93584500-6042-4cef-bad6-a418b24e358f None admin] RBAC: Authorizing `identity:get_user(user_id=7fe7af3857c34049806b291b54e9db28)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:31.146016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93584500-6042-4cef-bad6-a418b24e358f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:31.147687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 145/291] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:30 2022] GET /identity/v3/users/7fe7af3857c34049806b291b54e9db28 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:31.153218 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:31.367417 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0df2d-3048-4f75-87af-fa5db457d32e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:31.413385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15add5b-5490-4845-b8cc-f70fea3a7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:31.414053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15add5b-5490-4845-b8cc-f70fea3a7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.414336 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15add5b-5490-4845-b8cc-f70fea3a7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.414610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15add5b-5490-4845-b8cc-f70fea3a7aa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:31.508225 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15add5b-5490-4845-b8cc-f70fea3a7aa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:31.509751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15add5b-5490-4845-b8cc-f70fea3a7aa9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:31.631294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 147/292] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:31.636979 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93584500-6042-4cef-bad6-a418b24e358f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:31.729257 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd58b-19ce-4fcc-981e-5fd73e276eb3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.729777 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd58b-19ce-4fcc-981e-5fd73e276eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.729852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccd58b-19ce-4fcc-981e-5fd73e276eb3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:31.731415 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 148/293] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:31.737150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7555-9b81-4dad-b809-fd0e57a0f163 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.737441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7555-9b81-4dad-b809-fd0e57a0f163 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.737712 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7555-9b81-4dad-b809-fd0e57a0f163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:31.755588 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-60ab7555-9b81-4dad-b809-fd0e57a0f163 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:31.756827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-60ab7555-9b81-4dad-b809-fd0e57a0f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:31.761297 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93584500-6042-4cef-bad6-a418b24e358f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:31.808506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16af3b3-0ae5-452f-987f-fea3f01194b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:31.809394 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16af3b3-0ae5-452f-987f-fea3f01194b2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.809677 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16af3b3-0ae5-452f-987f-fea3f01194b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.809952 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16af3b3-0ae5-452f-987f-fea3f01194b2 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:31.811205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16af3b3-0ae5-452f-987f-fea3f01194b2 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:31.812694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16af3b3-0ae5-452f-987f-fea3f01194b2 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:31.815423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 146/294] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:31 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:31.821267 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16af3b3-0ae5-452f-987f-fea3f01194b2 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:31.831877 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 149/295] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:31.864463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7555-9b81-4dad-b809-fd0e57a0f163 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:31.931577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16af3b3-0ae5-452f-987f-fea3f01194b2 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:31.968492 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4417c-9a62-434d-ac18-ce2707f159af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:31.969248 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4417c-9a62-434d-ac18-ce2707f159af None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.970057 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4417c-9a62-434d-ac18-ce2707f159af None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.970334 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4417c-9a62-434d-ac18-ce2707f159af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:31.971171 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4417c-9a62-434d-ac18-ce2707f159af None admin] RBAC: Adding query filter params (role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=cfb2458fae474b03952818a61655107f, user.id=7fe7af3857c34049806b291b54e9db28) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:31.971483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4417c-9a62-434d-ac18-ce2707f159af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:31.972966 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4417c-9a62-434d-ac18-ce2707f159af None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:31.978389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7555-9b81-4dad-b809-fd0e57a0f163 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:31.982238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 147/296] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:31 2022] GET /identity/v3/role_assignments?user.id=7fe7af3857c34049806b291b54e9db28&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:31.982238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e209-e242-4a70-9e6f-e49071f0eb0a None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.982238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e209-e242-4a70-9e6f-e49071f0eb0a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.982238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8e209-e242-4a70-9e6f-e49071f0eb0a None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:31.982238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 148/297] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:31.983901 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba97c-fa6f-41da-8dbb-1d9e094660ae None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.983901 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba97c-fa6f-41da-8dbb-1d9e094660ae None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.984077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba97c-fa6f-41da-8dbb-1d9e094660ae None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:31.986309 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 149/298] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:31.989152 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0824e7-e518-4cf2-9a03-c874d890303b None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:31.989442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0824e7-e518-4cf2-9a03-c874d890303b None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:31.989721 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0824e7-e518-4cf2-9a03-c874d890303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.014984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-dd0824e7-e518-4cf2-9a03-c874d890303b None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:32.016718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-dd0824e7-e518-4cf2-9a03-c874d890303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:32.039589 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c762a-cec6-419e-9727-8284ab97cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:32.040459 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c762a-cec6-419e-9727-8284ab97cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.040740 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c762a-cec6-419e-9727-8284ab97cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.041014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c762a-cec6-419e-9727-8284ab97cdd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.055266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c762a-cec6-419e-9727-8284ab97cdd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6d6c762a-cec6-419e-9727-8284ab97cdd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:32.065458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:32.066418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:32.067198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:32.071714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 150/299] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:32.073212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442532d-4835-45bb-916b-06c0ca50505d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.073503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442532d-4835-45bb-916b-06c0ca50505d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.073784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442532d-4835-45bb-916b-06c0ca50505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.093381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b442532d-4835-45bb-916b-06c0ca50505d None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:32.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b442532d-4835-45bb-916b-06c0ca50505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:32.102943 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 150/300] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:32.103863 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0824e7-e518-4cf2-9a03-c874d890303b None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:32.207868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 151/301] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:32.207868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442532d-4835-45bb-916b-06c0ca50505d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:32.256385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0824e7-e518-4cf2-9a03-c874d890303b None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:32.301595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:32.301595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.301595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.301595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.302045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:32.302045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:32.302520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:32.314832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 151/302] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:32.315703 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:32.346012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442532d-4835-45bb-916b-06c0ca50505d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:32.397571 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ff52-fff6-4339-9b20-e3dd783afde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:32.399296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ff52-fff6-4339-9b20-e3dd783afde1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.400055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ff52-fff6-4339-9b20-e3dd783afde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.400743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ff52-fff6-4339-9b20-e3dd783afde1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.402790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ff52-fff6-4339-9b20-e3dd783afde1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:32.404987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ff52-fff6-4339-9b20-e3dd783afde1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:32.406913 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 152/303] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:32.409275 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ff52-fff6-4339-9b20-e3dd783afde1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:32.432003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae481961-6089-455b-8f03-315f01ad28e3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:32.476955 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f05f3-5ad4-4392-9ccb-ee58f4e5eace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:32.477678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f05f3-5ad4-4392-9ccb-ee58f4e5eace None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.477964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f05f3-5ad4-4392-9ccb-ee58f4e5eace None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.478243 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f05f3-5ad4-4392-9ccb-ee58f4e5eace None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.491868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f05f3-5ad4-4392-9ccb-ee58f4e5eace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a43f05f3-5ad4-4392-9ccb-ee58f4e5eace None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:32.507290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:32.508276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 152/304] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:32.509070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f05f3-5ad4-4392-9ccb-ee58f4e5eace None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:32.539145 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ff52-fff6-4339-9b20-e3dd783afde1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:32.579264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d325f7-b426-493f-98bd-7b055f03fe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:32.580332 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d325f7-b426-493f-98bd-7b055f03fe5c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.580647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d325f7-b426-493f-98bd-7b055f03fe5c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.580919 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d325f7-b426-493f-98bd-7b055f03fe5c None admin] PATH_INFO: `/v3/users/261275783cb844459e45ca5eb6235654` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.595005 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d325f7-b426-493f-98bd-7b055f03fe5c None admin] RBAC: Authorizing `identity:get_user(user_id=261275783cb844459e45ca5eb6235654)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:32.596493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d325f7-b426-493f-98bd-7b055f03fe5c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:32.598398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 153/305] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:32 2022] GET /identity/v3/users/261275783cb844459e45ca5eb6235654 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:32.600049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d325f7-b426-493f-98bd-7b055f03fe5c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:32.625381 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f05f3-5ad4-4392-9ccb-ee58f4e5eace None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:32.667395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdec35d-624d-437b-aee4-57344e796215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:32.668234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdec35d-624d-437b-aee4-57344e796215 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.668448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdec35d-624d-437b-aee4-57344e796215 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.668636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdec35d-624d-437b-aee4-57344e796215 None admin] PATH_INFO: `/v3/groups` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.669327 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdec35d-624d-437b-aee4-57344e796215 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:32.670832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdec35d-624d-437b-aee4-57344e796215 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:32.690330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 153/306] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 9 15:02:32 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:32.691238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdec35d-624d-437b-aee4-57344e796215 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:32.740646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d325f7-b426-493f-98bd-7b055f03fe5c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:32.799479 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:32.800612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.801190 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.801705 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.802690 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:32.803234 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:32.805213 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:32.821217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 154/307] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:32.826337 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:32.839435 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdec35d-624d-437b-aee4-57344e796215 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:32.893128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e301d-c658-4e48-bd56-3ce06e84c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:32.893823 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e301d-c658-4e48-bd56-3ce06e84c366 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.894108 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e301d-c658-4e48-bd56-3ce06e84c366 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.894386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e301d-c658-4e48-bd56-3ce06e84c366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.895241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e301d-c658-4e48-bd56-3ce06e84c366 None admin] RBAC: Adding query filter params (role.id=097994ff79ef4bb7a76712f02ac27677, user.id=261275783cb844459e45ca5eb6235654, scope.system=all) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:32.895559 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e301d-c658-4e48-bd56-3ce06e84c366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:32.898302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e301d-c658-4e48-bd56-3ce06e84c366 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:32.903628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 154/308] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:02:32 2022] GET /identity/v3/role_assignments?user.id=261275783cb844459e45ca5eb6235654&scope.system=all&role.id=097994ff79ef4bb7a76712f02ac27677 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:32.958394 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad296f3-2a86-4076-97d8-e1e59cbf8bbd None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.958702 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad296f3-2a86-4076-97d8-e1e59cbf8bbd None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.958952 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad296f3-2a86-4076-97d8-e1e59cbf8bbd None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.960348 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 155/309] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:32.966349 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06226-2351-44be-a29e-6d12e2c40daa None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:32.966725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06226-2351-44be-a29e-6d12e2c40daa None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:32.967102 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06226-2351-44be-a29e-6d12e2c40daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:32.974574 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5328dcd-5133-4e53-acfa-264e3970d3af None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:32.987804 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-0ae06226-2351-44be-a29e-6d12e2c40daa None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:32.989259 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-0ae06226-2351-44be-a29e-6d12e2c40daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:33.020365 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd08dd-09a8-46c7-a350-499a169b6c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:33.022255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd08dd-09a8-46c7-a350-499a169b6c3c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:33.022732 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd08dd-09a8-46c7-a350-499a169b6c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:33.023369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd08dd-09a8-46c7-a350-499a169b6c3c None admin] PATH_INFO: `/v3/users/504a724a5bd7412397ce2416408af74d` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:33.025599 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd08dd-09a8-46c7-a350-499a169b6c3c None admin] RBAC: Authorizing `identity:get_user(user_id=504a724a5bd7412397ce2416408af74d)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:33.027697 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd08dd-09a8-46c7-a350-499a169b6c3c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:33.031199 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 155/310] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:32 2022] GET /identity/v3/users/504a724a5bd7412397ce2416408af74d => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:33.036818 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd08dd-09a8-46c7-a350-499a169b6c3c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:33.081922 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 156/311] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:33.112216 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06226-2351-44be-a29e-6d12e2c40daa None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:33.152083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd08dd-09a8-46c7-a350-499a169b6c3c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:33.185450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74110-c1ae-431d-8f16-374d72715b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:33.186499 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74110-c1ae-431d-8f16-374d72715b55 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:33.186902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74110-c1ae-431d-8f16-374d72715b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:33.187261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74110-c1ae-431d-8f16-374d72715b55 None admin] PATH_INFO: `/v3/system/users/504a724a5bd7412397ce2416408af74d/roles/969f252ad8ce4e4e8be6b6d5e6590338` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:33.188967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f74110-c1ae-431d-8f16-374d72715b55 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=504a724a5bd7412397ce2416408af74d, role_id=969f252ad8ce4e4e8be6b6d5e6590338)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:33.190445 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f74110-c1ae-431d-8f16-374d72715b55 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:33.207871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 156/312] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 9 15:02:33 2022] PUT /identity/v3/system/users/504a724a5bd7412397ce2416408af74d/roles/969f252ad8ce4e4e8be6b6d5e6590338 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:33.248308 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06226-2351-44be-a29e-6d12e2c40daa None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:33.288039 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023fc60-79b9-4c9a-997d-a0eeff50dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:33.288775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023fc60-79b9-4c9a-997d-a0eeff50dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:33.289059 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023fc60-79b9-4c9a-997d-a0eeff50dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:33.289337 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023fc60-79b9-4c9a-997d-a0eeff50dcf8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:33.301871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023fc60-79b9-4c9a-997d-a0eeff50dcf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-f023fc60-79b9-4c9a-997d-a0eeff50dcf8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:33.311615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:33.312685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:33.313763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:33.316190 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 157/313] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:33.321110 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74110-c1ae-431d-8f16-374d72715b55 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:33.429995 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74110-c1ae-431d-8f16-374d72715b55 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:33.463737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:33.464438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:33.464719 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:33.464999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:33.465752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:33.466065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:33.467452 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:33.476542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 157/314] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:33.482011 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023fc60-79b9-4c9a-997d-a0eeff50dcf8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:33.586583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023fc60-79b9-4c9a-997d-a0eeff50dcf8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:33.620280 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3152-382d-4d99-bbd0-2ac3c0b5ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:33.621156 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3152-382d-4d99-bbd0-2ac3c0b5ca4c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:33.621441 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3152-382d-4d99-bbd0-2ac3c0b5ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:33.621719 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3152-382d-4d99-bbd0-2ac3c0b5ca4c None admin] PATH_INFO: `/v3/users/9b9edcdbb4e84709867935dc85652b21` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:33.622941 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3152-382d-4d99-bbd0-2ac3c0b5ca4c None admin] RBAC: Authorizing `identity:get_user(user_id=9b9edcdbb4e84709867935dc85652b21)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:33.624431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3152-382d-4d99-bbd0-2ac3c0b5ca4c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:33.627051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 158/315] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:33 2022] GET /identity/v3/users/9b9edcdbb4e84709867935dc85652b21 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:33.632608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:33.736769 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe13e-cb75-4fad-80d3-5b19f3d8168d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:33.769805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7059-18d6-435a-8216-e7ea3853a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:33.771232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7059-18d6-435a-8216-e7ea3853a968 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:33.771710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7059-18d6-435a-8216-e7ea3853a968 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:33.772221 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7059-18d6-435a-8216-e7ea3853a968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:33.839198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7059-18d6-435a-8216-e7ea3853a968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:33.841090 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7059-18d6-435a-8216-e7ea3853a968 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:33.940649 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 158/316] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:33.946451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3152-382d-4d99-bbd0-2ac3c0b5ca4c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:34.052522 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3152-382d-4d99-bbd0-2ac3c0b5ca4c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:34.092478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91f243-44e3-4407-afc0-4755bb926ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:34.093332 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91f243-44e3-4407-afc0-4755bb926ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:34.093615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91f243-44e3-4407-afc0-4755bb926ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:34.093888 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91f243-44e3-4407-afc0-4755bb926ce0 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:34.096175 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91f243-44e3-4407-afc0-4755bb926ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:34.097617 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91f243-44e3-4407-afc0-4755bb926ce0 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:34.099646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 159/317] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:33 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:34.105068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7059-18d6-435a-8216-e7ea3853a968 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:34.212079 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7059-18d6-435a-8216-e7ea3853a968 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:34.246033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08335fe-5834-4000-bb31-ba87221a1b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:34.246689 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08335fe-5834-4000-bb31-ba87221a1b8e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:34.246972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08335fe-5834-4000-bb31-ba87221a1b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:34.247250 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08335fe-5834-4000-bb31-ba87221a1b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:34.248150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08335fe-5834-4000-bb31-ba87221a1b8e None admin] RBAC: Adding query filter params (role.id=097994ff79ef4bb7a76712f02ac27677, scope.project.id=cfb2458fae474b03952818a61655107f, user.id=9b9edcdbb4e84709867935dc85652b21) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:34.248465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08335fe-5834-4000-bb31-ba87221a1b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:34.249898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08335fe-5834-4000-bb31-ba87221a1b8e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:34.256907 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 159/318] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:02:34 2022] GET /identity/v3/role_assignments?user.id=9b9edcdbb4e84709867935dc85652b21&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=097994ff79ef4bb7a76712f02ac27677 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:35.118286 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055577a7-e180-4f47-b21b-4a29fdf9805a None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.118790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055577a7-e180-4f47-b21b-4a29fdf9805a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.118864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055577a7-e180-4f47-b21b-4a29fdf9805a None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.120398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 160/319] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:35.125376 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b27dd0-02ad-4857-850d-0045773b1989 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.126327 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b27dd0-02ad-4857-850d-0045773b1989 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.126518 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b27dd0-02ad-4857-850d-0045773b1989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.143501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-13b27dd0-02ad-4857-850d-0045773b1989 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:35.144722 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-13b27dd0-02ad-4857-850d-0045773b1989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:35.209538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 160/320] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:35.232694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055577a7-e180-4f47-b21b-4a29fdf9805a None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:35.268675 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ed23-944d-40bd-8cf2-46c0acab7712 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.268960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ed23-944d-40bd-8cf2-46c0acab7712 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.269234 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ed23-944d-40bd-8cf2-46c0acab7712 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.270602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 161/321] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:35.275550 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916302-9ead-40dc-9ebb-f9ac587ce64d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.275864 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916302-9ead-40dc-9ebb-f9ac587ce64d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.276146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916302-9ead-40dc-9ebb-f9ac587ce64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.293128 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6b916302-9ead-40dc-9ebb-f9ac587ce64d None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:35.294331 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6b916302-9ead-40dc-9ebb-f9ac587ce64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:35.336955 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055577a7-e180-4f47-b21b-4a29fdf9805a None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:35.370684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 162/322] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:35.377628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41aa36-60af-4b6f-ac1a-5f3833b0e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:35.378432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41aa36-60af-4b6f-ac1a-5f3833b0e766 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.378713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41aa36-60af-4b6f-ac1a-5f3833b0e766 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.378986 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41aa36-60af-4b6f-ac1a-5f3833b0e766 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.380169 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41aa36-60af-4b6f-ac1a-5f3833b0e766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:35.381621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41aa36-60af-4b6f-ac1a-5f3833b0e766 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:35.383447 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 161/323] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:35.387972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b916302-9ead-40dc-9ebb-f9ac587ce64d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:35.388633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41aa36-60af-4b6f-ac1a-5f3833b0e766 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:35.483633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b916302-9ead-40dc-9ebb-f9ac587ce64d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:35.489028 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41aa36-60af-4b6f-ac1a-5f3833b0e766 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:35.518323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf6f4-80da-4c96-94a0-f926047c9cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:35.519102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf6f4-80da-4c96-94a0-f926047c9cec None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.519379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf6f4-80da-4c96-94a0-f926047c9cec None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.519656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf6f4-80da-4c96-94a0-f926047c9cec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.522732 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72d8cf-da58-42b7-b0cf-bd777540c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:35.523387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72d8cf-da58-42b7-b0cf-bd777540c4a8 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.523672 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72d8cf-da58-42b7-b0cf-bd777540c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.523982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72d8cf-da58-42b7-b0cf-bd777540c4a8 None admin] PATH_INFO: `/v3/groups` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.524696 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72d8cf-da58-42b7-b0cf-bd777540c4a8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:35.526141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72d8cf-da58-42b7-b0cf-bd777540c4a8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:35.529175 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbf6f4-80da-4c96-94a0-f926047c9cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-28cbf6f4-80da-4c96-94a0-f926047c9cec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:35.537159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:35.538124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 163/324] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:35.540082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b2dc5-1b07-4235-879a-39f08d488bce None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.540082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b2dc5-1b07-4235-879a-39f08d488bce None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.540234 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b2dc5-1b07-4235-879a-39f08d488bce None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.545917 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 164/325] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:35.545917 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b2dc5-1b07-4235-879a-39f08d488bce None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:35.551606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 162/326] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 9 15:02:35 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:02:35.551606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5f8a3-5554-45a9-863e-f03a30117888 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.551606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5f8a3-5554-45a9-863e-f03a30117888 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.551606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5f8a3-5554-45a9-863e-f03a30117888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.569259 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-7be5f8a3-5554-45a9-863e-f03a30117888 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:35.570559 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-7be5f8a3-5554-45a9-863e-f03a30117888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:35.643395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 163/327] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:35.653715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b2dc5-1b07-4235-879a-39f08d488bce None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:35.666687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5f8a3-5554-45a9-863e-f03a30117888 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:35.688971 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:35.689847 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.690122 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.690394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.691158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:35.691469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:35.692904 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:35.702435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 165/328] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:35.708587 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:35.768359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5f8a3-5554-45a9-863e-f03a30117888 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:35.804862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449602-9760-4684-87d2-4d7c91720ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:35.805796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449602-9760-4684-87d2-4d7c91720ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.806084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449602-9760-4684-87d2-4d7c91720ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.806365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449602-9760-4684-87d2-4d7c91720ec9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.819320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa449602-9760-4684-87d2-4d7c91720ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:35.825048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf3bd8-057c-4200-88c3-d4a5b1e9e753 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-aa449602-9760-4684-87d2-4d7c91720ec9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:35.827134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:35.828319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:35.829718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 164/329] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:35.835516 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449602-9760-4684-87d2-4d7c91720ec9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:35.871544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab5e4-714a-4fdb-9f5c-6ddfe85c6fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:35.872558 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab5e4-714a-4fdb-9f5c-6ddfe85c6fdd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:35.872841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab5e4-714a-4fdb-9f5c-6ddfe85c6fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:35.873113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab5e4-714a-4fdb-9f5c-6ddfe85c6fdd None admin] PATH_INFO: `/v3/users/261275783cb844459e45ca5eb6235654` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:35.874334 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ab5e4-714a-4fdb-9f5c-6ddfe85c6fdd None admin] RBAC: Authorizing `identity:get_user(user_id=261275783cb844459e45ca5eb6235654)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:35.876023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ab5e4-714a-4fdb-9f5c-6ddfe85c6fdd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:35.878122 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 166/330] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:35 2022] GET /identity/v3/users/261275783cb844459e45ca5eb6235654 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:35.884080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab5e4-714a-4fdb-9f5c-6ddfe85c6fdd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:35.952824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449602-9760-4684-87d2-4d7c91720ec9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:36.000127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ab5e4-714a-4fdb-9f5c-6ddfe85c6fdd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:36.006026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:36.006796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:36.007150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:36.007499 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:36.008366 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:36.008674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:36.010061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:36.019912 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 165/331] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:36.025139 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:36.038287 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d432-0ee9-4dd6-a6c6-0567ea4305bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:36.039413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d432-0ee9-4dd6-a6c6-0567ea4305bd None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:36.039896 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d432-0ee9-4dd6-a6c6-0567ea4305bd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:36.040176 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d432-0ee9-4dd6-a6c6-0567ea4305bd None admin] PATH_INFO: `/v3/system/users/261275783cb844459e45ca5eb6235654/roles/097994ff79ef4bb7a76712f02ac27677` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:36.041689 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d432-0ee9-4dd6-a6c6-0567ea4305bd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=261275783cb844459e45ca5eb6235654, role_id=097994ff79ef4bb7a76712f02ac27677)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:36.043101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d432-0ee9-4dd6-a6c6-0567ea4305bd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:36.055493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 167/332] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 9 15:02:35 2022] PUT /identity/v3/system/users/261275783cb844459e45ca5eb6235654/roles/097994ff79ef4bb7a76712f02ac27677 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:02:36.156983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c521a-b9af-40da-bc1e-7f679c44a271 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:36.196220 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7272782-dd5c-43f9-9261-1ae641413eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:36.197462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7272782-dd5c-43f9-9261-1ae641413eef None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:36.197925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7272782-dd5c-43f9-9261-1ae641413eef None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:36.198386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7272782-dd5c-43f9-9261-1ae641413eef None admin] PATH_INFO: `/v3/users/504a724a5bd7412397ce2416408af74d` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:36.199940 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7272782-dd5c-43f9-9261-1ae641413eef None admin] RBAC: Authorizing `identity:get_user(user_id=504a724a5bd7412397ce2416408af74d)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:36.201602 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7272782-dd5c-43f9-9261-1ae641413eef None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:36.207343 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 166/333] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:36 2022] GET /identity/v3/users/504a724a5bd7412397ce2416408af74d => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:36.212957 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d432-0ee9-4dd6-a6c6-0567ea4305bd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:36.338011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d432-0ee9-4dd6-a6c6-0567ea4305bd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:36.377919 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e6c1-32ec-4577-b091-acb558df9ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:36.378974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6c1-32ec-4577-b091-acb558df9ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:36.379474 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6c1-32ec-4577-b091-acb558df9ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:36.379981 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e6c1-32ec-4577-b091-acb558df9ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:36.381031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e6c1-32ec-4577-b091-acb558df9ab3 None admin] RBAC: Adding query filter params (role.id=969f252ad8ce4e4e8be6b6d5e6590338, user.id=504a724a5bd7412397ce2416408af74d, scope.system=all) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:36.381553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e6c1-32ec-4577-b091-acb558df9ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:36.383184 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e6c1-32ec-4577-b091-acb558df9ab3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:36.402084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 168/334] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:02:36 2022] GET /identity/v3/role_assignments?user.id=504a724a5bd7412397ce2416408af74d&scope.system=all&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:38.385815 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783278dd-2f58-4642-9ff4-06ed6beb3587 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:38.386777 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783278dd-2f58-4642-9ff4-06ed6beb3587 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:38.387298 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783278dd-2f58-4642-9ff4-06ed6beb3587 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:38.389331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 167/335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:38.398146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298bd8-0e6f-4a87-8550-02d536d015af None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:38.399043 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298bd8-0e6f-4a87-8550-02d536d015af None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:38.399528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298bd8-0e6f-4a87-8550-02d536d015af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:38.420822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-fb298bd8-0e6f-4a87-8550-02d536d015af None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:38.423114 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-fb298bd8-0e6f-4a87-8550-02d536d015af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:38.509780 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 169/336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:38.537528 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783278dd-2f58-4642-9ff4-06ed6beb3587 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:38.661501 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783278dd-2f58-4642-9ff4-06ed6beb3587 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:38.707594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea601f-3813-4ca7-b3ad-3157e8a611bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:38.708821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea601f-3813-4ca7-b3ad-3157e8a611bc None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:38.709314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea601f-3813-4ca7-b3ad-3157e8a611bc None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:38.709795 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea601f-3813-4ca7-b3ad-3157e8a611bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:38.725327 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea601f-3813-4ca7-b3ad-3157e8a611bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-15ea601f-3813-4ca7-b3ad-3157e8a611bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:38.733708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:38.734646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:38.736140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:38.742962 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 168/337] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:38.744322 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb298bd8-0e6f-4a87-8550-02d536d015af None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:38.789736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2347b1-02c4-4d07-94de-b727c7a81d72 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:38.790406 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2347b1-02c4-4d07-94de-b727c7a81d72 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:38.790899 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2347b1-02c4-4d07-94de-b727c7a81d72 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:38.792781 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 169/338] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:38.803694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a622-8b55-44a1-8ab0-cffcef660f68 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:38.804677 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a622-8b55-44a1-8ab0-cffcef660f68 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:38.804677 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03a622-8b55-44a1-8ab0-cffcef660f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:38.837637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-5d03a622-8b55-44a1-8ab0-cffcef660f68 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:38.839160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-5d03a622-8b55-44a1-8ab0-cffcef660f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:38.930553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb298bd8-0e6f-4a87-8550-02d536d015af None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:38.942059 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 170/339] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:38.985596 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03a622-8b55-44a1-8ab0-cffcef660f68 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:38.988123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:38.988811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:38.989094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:38.989373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:38.990552 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:38.990552 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:38.991944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:39.007799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 170/340] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:39.009369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:39.145051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03a622-8b55-44a1-8ab0-cffcef660f68 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:39.194017 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebafa5-eaeb-4c72-99d7-4db8a46d0a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:39.194751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebafa5-eaeb-4c72-99d7-4db8a46d0a7c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:39.195033 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebafa5-eaeb-4c72-99d7-4db8a46d0a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:39.195310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebafa5-eaeb-4c72-99d7-4db8a46d0a7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:39.213395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebafa5-eaeb-4c72-99d7-4db8a46d0a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-e0ebafa5-eaeb-4c72-99d7-4db8a46d0a7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:39.226135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:39.227084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:39.228361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 171/341] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:39.234745 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a387775-fc0e-45a8-bb38-636dbe4ef13c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:39.235727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebafa5-eaeb-4c72-99d7-4db8a46d0a7c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:39.310049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b372a-cdf9-4db4-abf9-5f42614348a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:39.311109 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b372a-cdf9-4db4-abf9-5f42614348a8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:39.311592 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b372a-cdf9-4db4-abf9-5f42614348a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:39.312099 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b372a-cdf9-4db4-abf9-5f42614348a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:39.358851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebafa5-eaeb-4c72-99d7-4db8a46d0a7c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:39.405626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:39.406413 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:39.406590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:39.407410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:39.408404 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:39.408718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:39.410166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:39.424222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 172/342] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:39.432632 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:39.469132 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b372a-cdf9-4db4-abf9-5f42614348a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:39.472140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b372a-cdf9-4db4-abf9-5f42614348a8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:39.596201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44101a-1b81-4f2b-830e-1b35c863f244 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:39.657842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fde23-cb51-43a2-b038-2b3e0b27b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:39.658696 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fde23-cb51-43a2-b038-2b3e0b27b891 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:39.658971 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fde23-cb51-43a2-b038-2b3e0b27b891 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:39.659251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fde23-cb51-43a2-b038-2b3e0b27b891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:39.702824 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 171/343] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:02:39.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5451ca-c66e-478a-b2d7-db264fd392b8 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:39.709715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5451ca-c66e-478a-b2d7-db264fd392b8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:39.709991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5451ca-c66e-478a-b2d7-db264fd392b8 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:39.712128 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 172/344] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:39.717548 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12823-21eb-4364-994e-448f118b52c5 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:39.717835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12823-21eb-4364-994e-448f118b52c5 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:39.718111 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12823-21eb-4364-994e-448f118b52c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:39.747141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-46f12823-21eb-4364-994e-448f118b52c5 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:39.748276 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-46f12823-21eb-4364-994e-448f118b52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:39.769691 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fde23-cb51-43a2-b038-2b3e0b27b891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:39.771434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fde23-cb51-43a2-b038-2b3e0b27b891 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:39.816309 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 173/345] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:39.817534 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8970-549c-4850-bd17-7e3b41f876a4 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:39.817830 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8970-549c-4850-bd17-7e3b41f876a4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:39.818111 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8970-549c-4850-bd17-7e3b41f876a4 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:39.819371 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 174/346] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:39.828948 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed8970-549c-4850-bd17-7e3b41f876a4 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:39.880807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 173/347] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:02:39.882618 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b46d-d1a3-4908-a763-bf21973b90fa None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:39.883093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b46d-d1a3-4908-a763-bf21973b90fa None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:39.883541 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b46d-d1a3-4908-a763-bf21973b90fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:39.901975 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-aec3b46d-d1a3-4908-a763-bf21973b90fa None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:39.903589 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-aec3b46d-d1a3-4908-a763-bf21973b90fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:39.955438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed8970-549c-4850-bd17-7e3b41f876a4 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:39.978828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 174/348] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:39.979973 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3b46d-d1a3-4908-a763-bf21973b90fa None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.000277 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730221d-2bcc-4114-8fa8-e066bd98c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.001956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730221d-2bcc-4114-8fa8-e066bd98c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.002314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730221d-2bcc-4114-8fa8-e066bd98c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.002594 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730221d-2bcc-4114-8fa8-e066bd98c3a8 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.008555 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730221d-2bcc-4114-8fa8-e066bd98c3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:40.010026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730221d-2bcc-4114-8fa8-e066bd98c3a8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:40.011744 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 175/349] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:39 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:40.012694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730221d-2bcc-4114-8fa8-e066bd98c3a8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.090870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3b46d-d1a3-4908-a763-bf21973b90fa None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.127989 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730221d-2bcc-4114-8fa8-e066bd98c3a8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.131721 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75483d08-aa1f-4a93-b658-d20661a0839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.132626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75483d08-aa1f-4a93-b658-d20661a0839f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.132908 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75483d08-aa1f-4a93-b658-d20661a0839f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.133177 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75483d08-aa1f-4a93-b658-d20661a0839f None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.134372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75483d08-aa1f-4a93-b658-d20661a0839f None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:40.135855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75483d08-aa1f-4a93-b658-d20661a0839f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:40.139858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 175/350] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:39 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:40.140696 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75483d08-aa1f-4a93-b658-d20661a0839f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.179108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d913-54eb-43fe-90b9-31af828a36ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.180269 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d913-54eb-43fe-90b9-31af828a36ce None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.180553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d913-54eb-43fe-90b9-31af828a36ce None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.180824 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d913-54eb-43fe-90b9-31af828a36ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.194824 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595d913-54eb-43fe-90b9-31af828a36ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-4595d913-54eb-43fe-90b9-31af828a36ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:40.202408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:40.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 176/351] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:40.205665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d913-54eb-43fe-90b9-31af828a36ce None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.276770 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75483d08-aa1f-4a93-b658-d20661a0839f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.320523 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f777afe-116d-4f0c-923b-abab6794ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.321394 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777afe-116d-4f0c-923b-abab6794ec9a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.321672 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777afe-116d-4f0c-923b-abab6794ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.321940 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f777afe-116d-4f0c-923b-abab6794ec9a None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.334086 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f777afe-116d-4f0c-923b-abab6794ec9a None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:40.335336 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d913-54eb-43fe-90b9-31af828a36ce None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.336129 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f777afe-116d-4f0c-923b-abab6794ec9a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:40.338345 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 176/352] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:40.339925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e52b-c59b-4604-a867-88ee3e7b646a None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.340382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e52b-c59b-4604-a867-88ee3e7b646a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.340851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e52b-c59b-4604-a867-88ee3e7b646a None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.347404 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 177/353] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:40.348503 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73e52b-c59b-4604-a867-88ee3e7b646a None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.382800 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697145-613b-423e-805f-aef5ed355deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.383628 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697145-613b-423e-805f-aef5ed355deb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.383930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697145-613b-423e-805f-aef5ed355deb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.384207 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697145-613b-423e-805f-aef5ed355deb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.398163 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697145-613b-423e-805f-aef5ed355deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2c697145-613b-423e-805f-aef5ed355deb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:40.408373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:40.410497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 177/354] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:40.411314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697145-613b-423e-805f-aef5ed355deb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.476292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73e52b-c59b-4604-a867-88ee3e7b646a None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.513223 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec0e07-e1bd-4c02-bbc7-5a0079c82d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.514359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec0e07-e1bd-4c02-bbc7-5a0079c82d4e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.514803 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec0e07-e1bd-4c02-bbc7-5a0079c82d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.515244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec0e07-e1bd-4c02-bbc7-5a0079c82d4e None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.516674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec0e07-e1bd-4c02-bbc7-5a0079c82d4e None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:40.518260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec0e07-e1bd-4c02-bbc7-5a0079c82d4e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:40.520147 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 178/355] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:40.521125 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec0e07-e1bd-4c02-bbc7-5a0079c82d4e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.531020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697145-613b-423e-805f-aef5ed355deb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.568141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292fd5-2fd5-4d4d-924b-c62e38d030c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.568813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292fd5-2fd5-4d4d-924b-c62e38d030c7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.569096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292fd5-2fd5-4d4d-924b-c62e38d030c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.569374 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292fd5-2fd5-4d4d-924b-c62e38d030c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.570141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c292fd5-2fd5-4d4d-924b-c62e38d030c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:40.570435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c292fd5-2fd5-4d4d-924b-c62e38d030c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:40.571900 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c292fd5-2fd5-4d4d-924b-c62e38d030c7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:40.582058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 178/356] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:40.583684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45df34-0ffc-482e-b711-e30c0e338cbf None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.583684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45df34-0ffc-482e-b711-e30c0e338cbf None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.583950 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45df34-0ffc-482e-b711-e30c0e338cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.601154 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9c45df34-0ffc-482e-b711-e30c0e338cbf None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:40.602671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9c45df34-0ffc-482e-b711-e30c0e338cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:40.644495 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec0e07-e1bd-4c02-bbc7-5a0079c82d4e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.674616 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 179/357] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:40.674616 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45df34-0ffc-482e-b711-e30c0e338cbf None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.685944 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.686613 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.687960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.687960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.688193 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] RBAC: Adding query filter params (group.id=a0b0a47128c049e0a72480d50bb89846, role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:40.688402 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:40.689841 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:40.696719 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 179/358] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/role_assignments?group.id=a0b0a47128c049e0a72480d50bb89846&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=abb44eff7ea447f6b105452bacf3892b => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:40.697532 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.813556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45df34-0ffc-482e-b711-e30c0e338cbf None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.834080 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba3db7-5301-4d44-977c-fd3e696f4d78 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:40.862981 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59633b17-b20a-4c48-aa89-ebee295fcee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.864106 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59633b17-b20a-4c48-aa89-ebee295fcee6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.864106 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59633b17-b20a-4c48-aa89-ebee295fcee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.864274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59633b17-b20a-4c48-aa89-ebee295fcee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.866473 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59633b17-b20a-4c48-aa89-ebee295fcee6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:40.866473 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59633b17-b20a-4c48-aa89-ebee295fcee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:40.866685 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59633b17-b20a-4c48-aa89-ebee295fcee6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:40.876947 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 180/359] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:40.878144 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838441d-efb6-48da-aaf4-beb3e0bbac33 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.878900 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838441d-efb6-48da-aaf4-beb3e0bbac33 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.879195 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838441d-efb6-48da-aaf4-beb3e0bbac33 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.880795 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 181/360] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:40.885839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838441d-efb6-48da-aaf4-beb3e0bbac33 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:40.888463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:40.889134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:40.889424 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:40.889700 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:40.890606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] RBAC: Adding query filter params (group.id=a0b0a47128c049e0a72480d50bb89846, role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:40.890920 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:40.892695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:40.900061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 180/361] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/role_assignments?group.id=a0b0a47128c049e0a72480d50bb89846&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:40.900892 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.024806 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838441d-efb6-48da-aaf4-beb3e0bbac33 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.038484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7f973-d9da-47dd-ae5e-b2656e22dd3b None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.066626 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19facd-10eb-4b0a-8ba2-70b517d2a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.067440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19facd-10eb-4b0a-8ba2-70b517d2a075 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.067789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19facd-10eb-4b0a-8ba2-70b517d2a075 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.068078 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19facd-10eb-4b0a-8ba2-70b517d2a075 None admin] PATH_INFO: `/v3/users/261275783cb844459e45ca5eb6235654` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.069406 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19facd-10eb-4b0a-8ba2-70b517d2a075 None admin] RBAC: Authorizing `identity:get_user(user_id=261275783cb844459e45ca5eb6235654)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:41.070884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19facd-10eb-4b0a-8ba2-70b517d2a075 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:41.073535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 182/362] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/users/261275783cb844459e45ca5eb6235654 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:41.074067 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19facd-10eb-4b0a-8ba2-70b517d2a075 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.098137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb1a4-2087-42fa-875d-dd9acf91673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.099565 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb1a4-2087-42fa-875d-dd9acf91673b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.100578 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb1a4-2087-42fa-875d-dd9acf91673b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.101226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb1a4-2087-42fa-875d-dd9acf91673b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.118773 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb1a4-2087-42fa-875d-dd9acf91673b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-954bb1a4-2087-42fa-875d-dd9acf91673b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:41.130843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:41.132205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:41.133032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 181/363] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:41.133718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f2554-4f64-44b7-8985-06dc734517fe None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.134116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f2554-4f64-44b7-8985-06dc734517fe None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.134219 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f2554-4f64-44b7-8985-06dc734517fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.160488 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-cb2f2554-4f64-44b7-8985-06dc734517fe None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:41.161672 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-cb2f2554-4f64-44b7-8985-06dc734517fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:41.235352 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19facd-10eb-4b0a-8ba2-70b517d2a075 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.236560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 182/364] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:41.237242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f2554-4f64-44b7-8985-06dc734517fe None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.289053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253500c-7b2a-4237-b672-ccee156701d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.290362 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253500c-7b2a-4237-b672-ccee156701d4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.290851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253500c-7b2a-4237-b672-ccee156701d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.291491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253500c-7b2a-4237-b672-ccee156701d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.365680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f2554-4f64-44b7-8985-06dc734517fe None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.381990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253500c-7b2a-4237-b672-ccee156701d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:41.383938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253500c-7b2a-4237-b672-ccee156701d4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:41.404876 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.406107 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.406637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.407280 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.408387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] RBAC: Adding query filter params (role.id=097994ff79ef4bb7a76712f02ac27677, user.id=261275783cb844459e45ca5eb6235654, scope.system=all) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:41.408906 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:41.410578 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:41.423251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 183/365] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:02:41 2022] GET /identity/v3/role_assignments?user.id=261275783cb844459e45ca5eb6235654&scope.system=all&role.id=097994ff79ef4bb7a76712f02ac27677 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:41.424444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.493177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 183/366] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:41.493939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253500c-7b2a-4237-b672-ccee156701d4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.535173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab1631-fa25-4fa5-8ed7-c65982e93bb6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.581314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.582210 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.582500 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.582776 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.584551 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:41.584875 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:41.586279 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:41.596203 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 184/367] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:41.596898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.634858 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253500c-7b2a-4237-b672-ccee156701d4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.680592 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d96af-325b-4d2e-b19a-8e1732341a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.681687 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d96af-325b-4d2e-b19a-8e1732341a4f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.682114 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d96af-325b-4d2e-b19a-8e1732341a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.682543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d96af-325b-4d2e-b19a-8e1732341a4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.694740 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d96af-325b-4d2e-b19a-8e1732341a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-4e8d96af-325b-4d2e-b19a-8e1732341a4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:41.703200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:41.704784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:41.705692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:41.708177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 184/368] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:41.709221 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d96af-325b-4d2e-b19a-8e1732341a4f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.723967 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279412d2-54b3-4543-9027-30c5cb65545a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.760973 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621ed81-0071-454e-9864-6ab5d1797d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.761881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621ed81-0071-454e-9864-6ab5d1797d6d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.762161 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621ed81-0071-454e-9864-6ab5d1797d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.762488 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621ed81-0071-454e-9864-6ab5d1797d6d None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.764220 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621ed81-0071-454e-9864-6ab5d1797d6d None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:41.765751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621ed81-0071-454e-9864-6ab5d1797d6d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:41.769215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 185/369] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:41 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:41.770465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621ed81-0071-454e-9864-6ab5d1797d6d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.825400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d96af-325b-4d2e-b19a-8e1732341a4f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.869006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327d979-cdc9-4866-9a60-f9ae2d05fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.870034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d979-cdc9-4866-9a60-f9ae2d05fb4b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.870378 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d979-cdc9-4866-9a60-f9ae2d05fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.870655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327d979-cdc9-4866-9a60-f9ae2d05fb4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.889311 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621ed81-0071-454e-9864-6ab5d1797d6d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:41.941044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:41.941270 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:41.941495 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:41.941757 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:41.942506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:41.942813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:41.944750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:41.954891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 186/370] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:41.955644 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:41.961846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327d979-cdc9-4866-9a60-f9ae2d05fb4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:41.963639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327d979-cdc9-4866-9a60-f9ae2d05fb4b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.101900 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 185/371] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:42.102117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4456a-baf2-486e-8072-145cacf4c195 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:42.103085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327d979-cdc9-4866-9a60-f9ae2d05fb4b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:42.159608 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674e5ad-a0fe-4955-aa3b-c32e09db7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:42.160424 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674e5ad-a0fe-4955-aa3b-c32e09db7b45 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:42.160707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674e5ad-a0fe-4955-aa3b-c32e09db7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:42.160982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674e5ad-a0fe-4955-aa3b-c32e09db7b45 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:42.162292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674e5ad-a0fe-4955-aa3b-c32e09db7b45 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:42.163748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674e5ad-a0fe-4955-aa3b-c32e09db7b45 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.166995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 187/372] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:41 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:42.168628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674e5ad-a0fe-4955-aa3b-c32e09db7b45 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:42.232853 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327d979-cdc9-4866-9a60-f9ae2d05fb4b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:42.278338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16d7f-83bc-418d-86fd-7b8a20b955aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:42.279003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16d7f-83bc-418d-86fd-7b8a20b955aa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:42.279703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16d7f-83bc-418d-86fd-7b8a20b955aa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:42.280006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16d7f-83bc-418d-86fd-7b8a20b955aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:42.304228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674e5ad-a0fe-4955-aa3b-c32e09db7b45 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:42.341675 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368645d-2bc8-4153-8fda-145cadff718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:42.342884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368645d-2bc8-4153-8fda-145cadff718b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:42.343411 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368645d-2bc8-4153-8fda-145cadff718b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:42.343943 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368645d-2bc8-4153-8fda-145cadff718b None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:42.345403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368645d-2bc8-4153-8fda-145cadff718b None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:42.347143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368645d-2bc8-4153-8fda-145cadff718b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.350552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 188/373] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:42 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:42.351680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368645d-2bc8-4153-8fda-145cadff718b None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:42.357438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16d7f-83bc-418d-86fd-7b8a20b955aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:42.358900 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16d7f-83bc-418d-86fd-7b8a20b955aa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.453788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368645d-2bc8-4153-8fda-145cadff718b None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:42.459025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 186/374] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:42.459945 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16d7f-83bc-418d-86fd-7b8a20b955aa None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:42.493211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:42.494210 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:42.494716 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:42.495218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:42.496330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] RBAC: Adding query filter params (group.id=a0b0a47128c049e0a72480d50bb89846, role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=cfb2458fae474b03952818a61655107f) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:42.496836 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:42.498439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.505225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 189/375] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:42 2022] GET /identity/v3/role_assignments?group.id=a0b0a47128c049e0a72480d50bb89846&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:42.506451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:42.572098 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16d7f-83bc-418d-86fd-7b8a20b955aa None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:42.608850 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb5ddf-bc84-473f-94a0-b219e154ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:42.610239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb5ddf-bc84-473f-94a0-b219e154ed68 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:42.610549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb5ddf-bc84-473f-94a0-b219e154ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:42.610822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb5ddf-bc84-473f-94a0-b219e154ed68 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:42.612080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb5ddf-bc84-473f-94a0-b219e154ed68 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:42.613642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb5ddf-bc84-473f-94a0-b219e154ed68 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.615171 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 187/376] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:42 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:42.620786 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb5ddf-bc84-473f-94a0-b219e154ed68 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:42.621293 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3cdc1-ea93-44e9-888a-5d8d0e1456cf None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:42.658863 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006eac4-31e5-49f5-8452-a011b9fad54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:42.660122 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006eac4-31e5-49f5-8452-a011b9fad54c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:42.660640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006eac4-31e5-49f5-8452-a011b9fad54c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:42.661108 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006eac4-31e5-49f5-8452-a011b9fad54c None admin] PATH_INFO: `/v3/projects/7440b284bbab42b8b509df6ef55b7d5c` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:42.662555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006eac4-31e5-49f5-8452-a011b9fad54c None admin] RBAC: Authorizing `identity:get_project(project_id=7440b284bbab42b8b509df6ef55b7d5c)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:42.664239 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006eac4-31e5-49f5-8452-a011b9fad54c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.666583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 190/377] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:42 2022] GET /identity/v3/projects/7440b284bbab42b8b509df6ef55b7d5c => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:42.673660 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006eac4-31e5-49f5-8452-a011b9fad54c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:42.743615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb5ddf-bc84-473f-94a0-b219e154ed68 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:42.794514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:42.795454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:42.797002 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:42.798012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:42.799741 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] RBAC: Adding query filter params (group.id=a0b0a47128c049e0a72480d50bb89846, role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=cfb2458fae474b03952818a61655107f) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:42.802040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006eac4-31e5-49f5-8452-a011b9fad54c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:42.802590 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:42.804238 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.821685 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 188/378] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:42 2022] GET /identity/v3/role_assignments?group.id=a0b0a47128c049e0a72480d50bb89846&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=abb44eff7ea447f6b105452bacf3892b => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:42.857014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64c3dd-7ca3-4a55-81c4-95de69d61d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:42.858179 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64c3dd-7ca3-4a55-81c4-95de69d61d22 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:42.858602 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64c3dd-7ca3-4a55-81c4-95de69d61d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:42.859022 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64c3dd-7ca3-4a55-81c4-95de69d61d22 None admin] PATH_INFO: `/v3/groups/8ba397009bd846839032bc5051a19e05` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:42.865119 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64c3dd-7ca3-4a55-81c4-95de69d61d22 None admin] RBAC: Authorizing `identity:get_group(group_id=8ba397009bd846839032bc5051a19e05)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:42.866833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64c3dd-7ca3-4a55-81c4-95de69d61d22 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:42.869008 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 191/379] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:42 2022] GET /identity/v3/groups/8ba397009bd846839032bc5051a19e05 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:42.874903 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:42.993921 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bede84c-2f62-4bea-b4d1-8a0029168f6f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:43.036217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b0f2e-8fa0-4b66-97bb-0c7c1171eb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:43.036894 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0f2e-8fa0-4b66-97bb-0c7c1171eb33 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:43.037177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0f2e-8fa0-4b66-97bb-0c7c1171eb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:43.037450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0f2e-8fa0-4b66-97bb-0c7c1171eb33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:43.038285 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b0f2e-8fa0-4b66-97bb-0c7c1171eb33 None admin] RBAC: Adding query filter params (group.id=8ba397009bd846839032bc5051a19e05, role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=7440b284bbab42b8b509df6ef55b7d5c) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:43.038596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b0f2e-8fa0-4b66-97bb-0c7c1171eb33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:43.040063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b0f2e-8fa0-4b66-97bb-0c7c1171eb33 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:43.053418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 189/380] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:42 2022] GET /identity/v3/role_assignments?group.id=8ba397009bd846839032bc5051a19e05&scope.project.id=7440b284bbab42b8b509df6ef55b7d5c&role.id=67227061f74f48f293a12155e904b5fc => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:43.439953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1833-55eb-4280-84e3-1337f69ad726 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:43.440323 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1833-55eb-4280-84e3-1337f69ad726 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:43.440516 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1833-55eb-4280-84e3-1337f69ad726 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:43.441880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 192/381] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:43.449332 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdb1f8-dd8d-4693-a1c3-d02355031635 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:43.449622 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdb1f8-dd8d-4693-a1c3-d02355031635 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:43.449905 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdb1f8-dd8d-4693-a1c3-d02355031635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:43.468574 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-63bdb1f8-dd8d-4693-a1c3-d02355031635 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:43.470085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-63bdb1f8-dd8d-4693-a1c3-d02355031635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:43.562490 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 190/382] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:43.599102 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1833-55eb-4280-84e3-1337f69ad726 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:43.718921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1833-55eb-4280-84e3-1337f69ad726 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:43.761533 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aae11-a5b8-4343-a03f-9bf5d22bf71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:43.762345 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aae11-a5b8-4343-a03f-9bf5d22bf71c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:43.762627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aae11-a5b8-4343-a03f-9bf5d22bf71c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:43.762902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aae11-a5b8-4343-a03f-9bf5d22bf71c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:43.779424 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981aae11-a5b8-4343-a03f-9bf5d22bf71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-981aae11-a5b8-4343-a03f-9bf5d22bf71c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:43.788003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:43.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:43.790378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 193/383] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:43.795122 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdb1f8-dd8d-4693-a1c3-d02355031635 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:43.917096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdb1f8-dd8d-4693-a1c3-d02355031635 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:43.954134 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e80e5-2a9e-468f-8e2c-a08e841a75e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:43.955336 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e80e5-2a9e-468f-8e2c-a08e841a75e9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:43.955621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e80e5-2a9e-468f-8e2c-a08e841a75e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:43.955927 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e80e5-2a9e-468f-8e2c-a08e841a75e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:43.956688 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e80e5-2a9e-468f-8e2c-a08e841a75e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:43.956995 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e80e5-2a9e-468f-8e2c-a08e841a75e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:43.958388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e80e5-2a9e-468f-8e2c-a08e841a75e9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:43.968185 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 191/384] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:43.975258 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aae11-a5b8-4343-a03f-9bf5d22bf71c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:44.028533 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf1dea-2354-46bd-8c2f-26fb82925354 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:44.028861 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf1dea-2354-46bd-8c2f-26fb82925354 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:44.029095 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf1dea-2354-46bd-8c2f-26fb82925354 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:44.030596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 192/385] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:44.037598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20008a-447b-4190-8200-88042a3e28aa None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:44.037888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20008a-447b-4190-8200-88042a3e28aa None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:44.038168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20008a-447b-4190-8200-88042a3e28aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:44.073720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-df20008a-447b-4190-8200-88042a3e28aa None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:44.074925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-df20008a-447b-4190-8200-88042a3e28aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:44.130660 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aae11-a5b8-4343-a03f-9bf5d22bf71c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:44.160953 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 193/386] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:44.168964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e45c0-53a2-44f2-903d-c747c1c86b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:44.169846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e45c0-53a2-44f2-903d-c747c1c86b85 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:44.170128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e45c0-53a2-44f2-903d-c747c1c86b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:44.170405 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e45c0-53a2-44f2-903d-c747c1c86b85 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:44.171607 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e45c0-53a2-44f2-903d-c747c1c86b85 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:44.173368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e45c0-53a2-44f2-903d-c747c1c86b85 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:44.175102 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 194/387] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:43 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:44.180759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20008a-447b-4190-8200-88042a3e28aa None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:44.192828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e45c0-53a2-44f2-903d-c747c1c86b85 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:44.362150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e45c0-53a2-44f2-903d-c747c1c86b85 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:44.390102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20008a-447b-4190-8200-88042a3e28aa None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:44.409975 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aba3b2-9a2b-4d79-b6e0-e287091ff5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:44.410790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba3b2-9a2b-4d79-b6e0-e287091ff5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:44.411075 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba3b2-9a2b-4d79-b6e0-e287091ff5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:44.411350 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aba3b2-9a2b-4d79-b6e0-e287091ff5c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:44.434837 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aba3b2-9a2b-4d79-b6e0-e287091ff5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-d4aba3b2-9a2b-4d79-b6e0-e287091ff5c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:44.443318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:44.444310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:44.445545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 195/388] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:44.452837 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aba3b2-9a2b-4d79-b6e0-e287091ff5c5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:44.460164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24017cd-683d-4591-91b2-9c282dde6af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:44.461363 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24017cd-683d-4591-91b2-9c282dde6af4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:44.461846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24017cd-683d-4591-91b2-9c282dde6af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:44.462362 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24017cd-683d-4591-91b2-9c282dde6af4 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:44.464941 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24017cd-683d-4591-91b2-9c282dde6af4 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:44.466983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24017cd-683d-4591-91b2-9c282dde6af4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:44.475518 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 194/389] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:44 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:44.477236 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24017cd-683d-4591-91b2-9c282dde6af4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:44.611463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24017cd-683d-4591-91b2-9c282dde6af4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:44.653912 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288b84-e441-4626-a369-897cea46b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:44.655142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288b84-e441-4626-a369-897cea46b0ee None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:44.656395 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288b84-e441-4626-a369-897cea46b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:44.657453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288b84-e441-4626-a369-897cea46b0ee None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/groups/a0b0a47128c049e0a72480d50bb89846/roles/abb44eff7ea447f6b105452bacf3892b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:44.664176 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13288b84-e441-4626-a369-897cea46b0ee None admin] RBAC: Authorizing `identity:create_grant(project_id=e14d0e2f8bff42f98671631097e2d1f6, group_id=a0b0a47128c049e0a72480d50bb89846, role_id=abb44eff7ea447f6b105452bacf3892b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:44.665899 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13288b84-e441-4626-a369-897cea46b0ee None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:44.671974 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aba3b2-9a2b-4d79-b6e0-e287091ff5c5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:44.707065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 195/390] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:02:44 2022] PUT /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/groups/a0b0a47128c049e0a72480d50bb89846/roles/abb44eff7ea447f6b105452bacf3892b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:44.721492 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:44.722881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:44.723389 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:44.723912 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:44.724901 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:44.725436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:44.727081 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:44.737785 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 196/391] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:44.743133 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288b84-e441-4626-a369-897cea46b0ee None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:44.867087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288b84-e441-4626-a369-897cea46b0ee None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:44.908363 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b775-f467-4940-81a8-123dcdcac055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:44.909527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b775-f467-4940-81a8-123dcdcac055 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:44.909987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b775-f467-4940-81a8-123dcdcac055 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:44.910475 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b775-f467-4940-81a8-123dcdcac055 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:44.912551 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b775-f467-4940-81a8-123dcdcac055 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:44.914226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b775-f467-4940-81a8-123dcdcac055 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:44.916871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 196/392] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:44 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:44.921627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:45.034262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84872f-ef92-4c2d-b8ca-70c0cb9fe8c2 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:45.072939 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a8f9b-71cf-4334-8d47-6645e457a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:45.074124 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a8f9b-71cf-4334-8d47-6645e457a2ab None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:45.074590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a8f9b-71cf-4334-8d47-6645e457a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:45.075068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a8f9b-71cf-4334-8d47-6645e457a2ab None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:45.076497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a8f9b-71cf-4334-8d47-6645e457a2ab None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:45.078405 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a8f9b-71cf-4334-8d47-6645e457a2ab None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:45.083790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 197/393] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:44 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:45.086939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b775-f467-4940-81a8-123dcdcac055 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:45.201989 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b775-f467-4940-81a8-123dcdcac055 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:45.237918 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989a7a-fcc2-4d12-86cd-feba44a8ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:45.238801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989a7a-fcc2-4d12-86cd-feba44a8ee02 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:45.239083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989a7a-fcc2-4d12-86cd-feba44a8ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:45.239357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989a7a-fcc2-4d12-86cd-feba44a8ee02 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/groups/a0b0a47128c049e0a72480d50bb89846/roles/969f252ad8ce4e4e8be6b6d5e6590338` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:45.242402 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989a7a-fcc2-4d12-86cd-feba44a8ee02 None admin] RBAC: Authorizing `identity:create_grant(project_id=e14d0e2f8bff42f98671631097e2d1f6, group_id=a0b0a47128c049e0a72480d50bb89846, role_id=969f252ad8ce4e4e8be6b6d5e6590338)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:45.243886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989a7a-fcc2-4d12-86cd-feba44a8ee02 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:45.274775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 197/394] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:02:45 2022] PUT /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6/groups/a0b0a47128c049e0a72480d50bb89846/roles/969f252ad8ce4e4e8be6b6d5e6590338 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:02:45.394170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4908a6-3ef1-4150-bb45-238df3fc4ea8 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:45.394526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4908a6-3ef1-4150-bb45-238df3fc4ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:45.394731 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4908a6-3ef1-4150-bb45-238df3fc4ea8 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:45.396188 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 198/395] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:45.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e0908-adc4-4586-8622-0983c7c47c00 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:45.402347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e0908-adc4-4586-8622-0983c7c47c00 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:45.402631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e0908-adc4-4586-8622-0983c7c47c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:45.428926 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b81e0908-adc4-4586-8622-0983c7c47c00 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:45.430159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b81e0908-adc4-4586-8622-0983c7c47c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:45.524470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 198/396] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:45.548862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4908a6-3ef1-4150-bb45-238df3fc4ea8 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:45.661329 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4908a6-3ef1-4150-bb45-238df3fc4ea8 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:45.706429 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f96e-d88f-4499-8356-3ad15f1a19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:45.707243 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f96e-d88f-4499-8356-3ad15f1a19b7 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:45.707528 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f96e-d88f-4499-8356-3ad15f1a19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:45.707827 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2f96e-d88f-4499-8356-3ad15f1a19b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:45.725485 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2f96e-d88f-4499-8356-3ad15f1a19b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-21b2f96e-d88f-4499-8356-3ad15f1a19b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:45.733451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:45.734347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:45.736403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 199/397] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:45.743278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e0908-adc4-4586-8622-0983c7c47c00 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:45.878872 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e0908-adc4-4586-8622-0983c7c47c00 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:45.919269 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d456c-fd3b-4f15-b7d1-316f185bc93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:45.919968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d456c-fd3b-4f15-b7d1-316f185bc93e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:45.920247 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d456c-fd3b-4f15-b7d1-316f185bc93e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:45.920519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d456c-fd3b-4f15-b7d1-316f185bc93e None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:45.921268 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d456c-fd3b-4f15-b7d1-316f185bc93e None admin] RBAC: Adding query filter params (name=member) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:45.921575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d456c-fd3b-4f15-b7d1-316f185bc93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:45.923600 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d456c-fd3b-4f15-b7d1-316f185bc93e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:45.932232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 199/398] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:45.938897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f96e-d88f-4499-8356-3ad15f1a19b7 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.034251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f3bd-a76b-4cb0-b788-cc292556825b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.034574 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f3bd-a76b-4cb0-b788-cc292556825b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.034810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798f3bd-a76b-4cb0-b788-cc292556825b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.036850 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 200/399] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:46.042355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44ccd-04df-4f9d-921c-13c1658786af None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.042639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44ccd-04df-4f9d-921c-13c1658786af None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.042921 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44ccd-04df-4f9d-921c-13c1658786af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.069164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e9f44ccd-04df-4f9d-921c-13c1658786af None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:46.070354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e9f44ccd-04df-4f9d-921c-13c1658786af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:46.080304 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2f96e-d88f-4499-8356-3ad15f1a19b7 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:46.127029 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff564d-5d67-4aa7-a673-535ad29a25f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:46.127946 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff564d-5d67-4aa7-a673-535ad29a25f8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.128225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff564d-5d67-4aa7-a673-535ad29a25f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.128496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff564d-5d67-4aa7-a673-535ad29a25f8 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.129988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff564d-5d67-4aa7-a673-535ad29a25f8 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:46.131406 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff564d-5d67-4aa7-a673-535ad29a25f8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:46.133848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 200/400] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:45 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:46.139142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff564d-5d67-4aa7-a673-535ad29a25f8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.200978 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 201/401] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:46.270343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44ccd-04df-4f9d-921c-13c1658786af None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.279656 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff564d-5d67-4aa7-a673-535ad29a25f8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:46.316312 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbb79-a22d-4205-8e8f-011aab8af651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:46.317188 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbb79-a22d-4205-8e8f-011aab8af651 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.317469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbb79-a22d-4205-8e8f-011aab8af651 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.317744 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbb79-a22d-4205-8e8f-011aab8af651 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.318942 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbbb79-a22d-4205-8e8f-011aab8af651 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:46.320406 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbbb79-a22d-4205-8e8f-011aab8af651 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:46.322846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 201/402] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:46 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:46.329849 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbb79-a22d-4205-8e8f-011aab8af651 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.409372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44ccd-04df-4f9d-921c-13c1658786af None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:46.436828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbb79-a22d-4205-8e8f-011aab8af651 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:46.444994 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27391d3a-5005-4aed-8235-a6738a0262ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:46.445864 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391d3a-5005-4aed-8235-a6738a0262ff None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.446147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391d3a-5005-4aed-8235-a6738a0262ff None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.446423 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391d3a-5005-4aed-8235-a6738a0262ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.458719 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27391d3a-5005-4aed-8235-a6738a0262ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-27391d3a-5005-4aed-8235-a6738a0262ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:46.471035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:46.472068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:46.472890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:46.473506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399e18f-b511-4631-86c8-9e811b3506c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:46.473506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e18f-b511-4631-86c8-9e811b3506c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.473506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e18f-b511-4631-86c8-9e811b3506c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.473717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399e18f-b511-4631-86c8-9e811b3506c7 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f/groups/a0b0a47128c049e0a72480d50bb89846/roles/969f252ad8ce4e4e8be6b6d5e6590338` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.476225 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 202/403] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:46.477168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2277eb-058c-41ff-b5be-9dd247b1ab0c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.478004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2277eb-058c-41ff-b5be-9dd247b1ab0c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.478285 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2277eb-058c-41ff-b5be-9dd247b1ab0c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.479601 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 203/404] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:46.480506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399e18f-b511-4631-86c8-9e811b3506c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb2458fae474b03952818a61655107f, group_id=a0b0a47128c049e0a72480d50bb89846, role_id=969f252ad8ce4e4e8be6b6d5e6590338)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:46.481928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399e18f-b511-4631-86c8-9e811b3506c7 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:46.485184 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2277eb-058c-41ff-b5be-9dd247b1ab0c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.511977 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 202/405] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:02:46 2022] PUT /identity/v3/projects/cfb2458fae474b03952818a61655107f/groups/a0b0a47128c049e0a72480d50bb89846/roles/969f252ad8ce4e4e8be6b6d5e6590338 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:46.513810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e21277-db13-4f22-be9d-3ed5cffd4df9 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.514220 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e21277-db13-4f22-be9d-3ed5cffd4df9 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.514582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e21277-db13-4f22-be9d-3ed5cffd4df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.542995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-d0e21277-db13-4f22-be9d-3ed5cffd4df9 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:46.552647 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-d0e21277-db13-4f22-be9d-3ed5cffd4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:46.599382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2277eb-058c-41ff-b5be-9dd247b1ab0c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:46.635436 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:46.636148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.636430 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.636706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.637476 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:46.637784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:46.639200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:46.648234 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 204/406] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:46.653797 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.726471 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 203/407] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:46.759812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ab419-d665-4892-a6eb-7a2976c4236f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:46.760292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e21277-db13-4f22-be9d-3ed5cffd4df9 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.795353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d6c2f-f7d9-426e-9304-d3f59b0858c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:46.796246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d6c2f-f7d9-426e-9304-d3f59b0858c7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.796527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d6c2f-f7d9-426e-9304-d3f59b0858c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.796803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d6c2f-f7d9-426e-9304-d3f59b0858c7 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.798363 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d6c2f-f7d9-426e-9304-d3f59b0858c7 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:46.799910 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d6c2f-f7d9-426e-9304-d3f59b0858c7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:46.801869 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 205/408] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:46 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:46.807394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d6c2f-f7d9-426e-9304-d3f59b0858c7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.926308 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e21277-db13-4f22-be9d-3ed5cffd4df9 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:46.938123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d6c2f-f7d9-426e-9304-d3f59b0858c7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:46.964772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813375fa-2558-4085-b90a-a92d32155a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:46.965566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813375fa-2558-4085-b90a-a92d32155a68 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.965843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813375fa-2558-4085-b90a-a92d32155a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.966113 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813375fa-2558-4085-b90a-a92d32155a68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.972775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e09b-8449-48b6-86ad-dac2c2920277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:46.973631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e09b-8449-48b6-86ad-dac2c2920277 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:46.974083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e09b-8449-48b6-86ad-dac2c2920277 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:46.974363 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e09b-8449-48b6-86ad-dac2c2920277 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:46.975879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e09b-8449-48b6-86ad-dac2c2920277 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:46.977415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813375fa-2558-4085-b90a-a92d32155a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:46.977616 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e09b-8449-48b6-86ad-dac2c2920277 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:46.979597 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 206/409] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:46 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:46.985894 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e09b-8449-48b6-86ad-dac2c2920277 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-813375fa-2558-4085-b90a-a92d32155a68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:46.986272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:46.988489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:46.990415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:46.991951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 204/410] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:46.999822 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813375fa-2558-4085-b90a-a92d32155a68 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:47.102290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813375fa-2558-4085-b90a-a92d32155a68 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:47.106070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e09b-8449-48b6-86ad-dac2c2920277 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:47.151583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d8130-67a6-4a35-aa64-d70e392b1f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:47.152503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8130-67a6-4a35-aa64-d70e392b1f18 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.152784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8130-67a6-4a35-aa64-d70e392b1f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.153058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d8130-67a6-4a35-aa64-d70e392b1f18 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f/groups/a0b0a47128c049e0a72480d50bb89846/roles/abb44eff7ea447f6b105452bacf3892b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:47.159843 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d8130-67a6-4a35-aa64-d70e392b1f18 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfb2458fae474b03952818a61655107f, group_id=a0b0a47128c049e0a72480d50bb89846, role_id=abb44eff7ea447f6b105452bacf3892b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:47.161299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d8130-67a6-4a35-aa64-d70e392b1f18 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:47.173287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:47.177330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.177908 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:47.181526 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 207/411] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:02:46 2022] PUT /identity/v3/projects/cfb2458fae474b03952818a61655107f/groups/a0b0a47128c049e0a72480d50bb89846/roles/abb44eff7ea447f6b105452bacf3892b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:47.181860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:47.182179 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:47.183671 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:47.198902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 205/412] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:47.205661 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d8130-67a6-4a35-aa64-d70e392b1f18 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:47.327478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d8130-67a6-4a35-aa64-d70e392b1f18 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:47.371506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9ae4c-13b4-4f42-b550-32ba12e442fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:47.372391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ae4c-13b4-4f42-b550-32ba12e442fa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.372670 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ae4c-13b4-4f42-b550-32ba12e442fa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.372946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ae4c-13b4-4f42-b550-32ba12e442fa None admin] PATH_INFO: `/v3/groups/8ba397009bd846839032bc5051a19e05` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:47.376541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9ae4c-13b4-4f42-b550-32ba12e442fa None admin] RBAC: Authorizing `identity:get_group(group_id=8ba397009bd846839032bc5051a19e05)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:47.377990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9ae4c-13b4-4f42-b550-32ba12e442fa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:47.379695 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 208/413] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:47 2022] GET /identity/v3/groups/8ba397009bd846839032bc5051a19e05 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:47.385622 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:47.497115 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84f7c2-875d-404f-b2c3-86a9a1c4a28f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:47.537519 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c83df-bd1e-44d2-8c3b-2c9641eb75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:47.538402 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c83df-bd1e-44d2-8c3b-2c9641eb75c3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.538684 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c83df-bd1e-44d2-8c3b-2c9641eb75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.538959 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c83df-bd1e-44d2-8c3b-2c9641eb75c3 None admin] PATH_INFO: `/v3/projects/7440b284bbab42b8b509df6ef55b7d5c` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:47.540268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c83df-bd1e-44d2-8c3b-2c9641eb75c3 None admin] RBAC: Authorizing `identity:get_project(project_id=7440b284bbab42b8b509df6ef55b7d5c)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:47.541720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c83df-bd1e-44d2-8c3b-2c9641eb75c3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:47.543501 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 206/414] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:47 2022] GET /identity/v3/projects/7440b284bbab42b8b509df6ef55b7d5c => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:47.550076 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9ae4c-13b4-4f42-b550-32ba12e442fa None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:47.668155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9ae4c-13b4-4f42-b550-32ba12e442fa None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:47.709432 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c717-64aa-4711-baca-8268abc7224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:47.710735 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c717-64aa-4711-baca-8268abc7224c None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.711214 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c717-64aa-4711-baca-8268abc7224c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.711681 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c717-64aa-4711-baca-8268abc7224c None admin] PATH_INFO: `/v3/projects/7440b284bbab42b8b509df6ef55b7d5c/groups/8ba397009bd846839032bc5051a19e05/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:47.714078 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c717-64aa-4711-baca-8268abc7224c None admin] RBAC: Authorizing `identity:create_grant(project_id=7440b284bbab42b8b509df6ef55b7d5c, group_id=8ba397009bd846839032bc5051a19e05, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:47.715845 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c717-64aa-4711-baca-8268abc7224c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:47.743936 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 209/415] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:02:47 2022] PUT /identity/v3/projects/7440b284bbab42b8b509df6ef55b7d5c/groups/8ba397009bd846839032bc5051a19e05/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:02:47.958375 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e89b8-2aa8-4aed-8c84-53cfd8525c26 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.958892 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e89b8-2aa8-4aed-8c84-53cfd8525c26 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.958970 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e89b8-2aa8-4aed-8c84-53cfd8525c26 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:47.960542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 207/416] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:47.965977 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b16c1-c17b-467a-86bb-06a87f51e6d9 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.966385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b16c1-c17b-467a-86bb-06a87f51e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.966553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b16c1-c17b-467a-86bb-06a87f51e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:47.980253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f977-b569-476b-b735-11aa6adf8628 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.980525 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f977-b569-476b-b735-11aa6adf8628 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.980798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75f977-b569-476b-b735-11aa6adf8628 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:47.982322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 208/417] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:47.987805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-693b16c1-c17b-467a-86bb-06a87f51e6d9 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:47.989019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7badb8-7988-4484-aaf7-f33d139d1cc0 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:47.989143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-693b16c1-c17b-467a-86bb-06a87f51e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:47.989364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7badb8-7988-4484-aaf7-f33d139d1cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:47.989654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7badb8-7988-4484-aaf7-f33d139d1cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:48.012064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-8f7badb8-7988-4484-aaf7-f33d139d1cc0 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:48.013262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-8f7badb8-7988-4484-aaf7-f33d139d1cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:48.071822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 210/418] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:48.101494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 209/419] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:48.110716 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b16c1-c17b-467a-86bb-06a87f51e6d9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:48.138363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7badb8-7988-4484-aaf7-f33d139d1cc0 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:48.243594 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b16c1-c17b-467a-86bb-06a87f51e6d9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:48.281043 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bff2a8-3a66-4463-9a8b-2840bae24452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:48.282405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bff2a8-3a66-4463-9a8b-2840bae24452 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:48.282685 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bff2a8-3a66-4463-9a8b-2840bae24452 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:48.282958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bff2a8-3a66-4463-9a8b-2840bae24452 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:48.303575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bff2a8-3a66-4463-9a8b-2840bae24452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-66bff2a8-3a66-4463-9a8b-2840bae24452 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:48.312838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:48.313778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:48.314581 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 211/420] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:48.321178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bff2a8-3a66-4463-9a8b-2840bae24452 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:48.335529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7badb8-7988-4484-aaf7-f33d139d1cc0 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:48.393941 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753b84-360c-45c5-8d91-0399505472eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:48.395211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753b84-360c-45c5-8d91-0399505472eb None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:48.395717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753b84-360c-45c5-8d91-0399505472eb None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:48.396213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753b84-360c-45c5-8d91-0399505472eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:48.416432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a753b84-360c-45c5-8d91-0399505472eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-1a753b84-360c-45c5-8d91-0399505472eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:48.426322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:48.427291 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:48.428144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:48.431270 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 210/421] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:48.436805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753b84-360c-45c5-8d91-0399505472eb None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:48.482120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bff2a8-3a66-4463-9a8b-2840bae24452 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:48.524194 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:48.524784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:48.525059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:48.525333 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:48.526078 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:48.526386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:48.527755 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:48.540208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 212/422] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:48.549243 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:48.606642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753b84-360c-45c5-8d91-0399505472eb None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:48.641355 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:48.642026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:48.642308 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:48.642583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:48.643331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:48.643636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:48.645045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:48.653788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 211/423] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:48.658924 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:48.706210 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad709457-e0d0-4bcb-98fe-bd12bb8f7e0f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:48.742091 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db40a4-cb8b-4ae7-8fc9-7c7056a1fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:48.742741 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db40a4-cb8b-4ae7-8fc9-7c7056a1fd59 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:48.743022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db40a4-cb8b-4ae7-8fc9-7c7056a1fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:48.743295 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db40a4-cb8b-4ae7-8fc9-7c7056a1fd59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:48.818010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db40a4-cb8b-4ae7-8fc9-7c7056a1fd59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:48.819521 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db40a4-cb8b-4ae7-8fc9-7c7056a1fd59 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:48.905566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70238e-f010-4e16-865d-aad52b4bd6cd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:48.923111 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 213/424] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:48.928897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db40a4-cb8b-4ae7-8fc9-7c7056a1fd59 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:48.961456 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268446-4086-49af-bd8f-e22e668815e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:48.962820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268446-4086-49af-bd8f-e22e668815e6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:48.963318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268446-4086-49af-bd8f-e22e668815e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:48.963800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268446-4086-49af-bd8f-e22e668815e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.083690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268446-4086-49af-bd8f-e22e668815e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:49.086837 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268446-4086-49af-bd8f-e22e668815e6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:49.107205 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db40a4-cb8b-4ae7-8fc9-7c7056a1fd59 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:49.143908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747dbb-1876-4724-a387-10bbd4140ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:49.144760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747dbb-1876-4724-a387-10bbd4140ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.145034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747dbb-1876-4724-a387-10bbd4140ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.145301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747dbb-1876-4724-a387-10bbd4140ac3 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.146484 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747dbb-1876-4724-a387-10bbd4140ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:49.147929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747dbb-1876-4724-a387-10bbd4140ac3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:49.149942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 214/425] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:48 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:49.155155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747dbb-1876-4724-a387-10bbd4140ac3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:49.241581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 212/426] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:02:49.248894 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268446-4086-49af-bd8f-e22e668815e6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:49.256636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747dbb-1876-4724-a387-10bbd4140ac3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:49.319914 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461f70-1b83-4c7f-80e5-eb5a0ace3658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:49.320777 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461f70-1b83-4c7f-80e5-eb5a0ace3658 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.321053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461f70-1b83-4c7f-80e5-eb5a0ace3658 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.321323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88461f70-1b83-4c7f-80e5-eb5a0ace3658 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.324121 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88461f70-1b83-4c7f-80e5-eb5a0ace3658 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:49.325556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88461f70-1b83-4c7f-80e5-eb5a0ace3658 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:49.327149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 215/427] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:49 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:49.344818 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461f70-1b83-4c7f-80e5-eb5a0ace3658 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:49.434566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268446-4086-49af-bd8f-e22e668815e6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:49.469785 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a91ea-6858-4266-8819-43ccc6722d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:49.471019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a91ea-6858-4266-8819-43ccc6722d69 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.471499 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a91ea-6858-4266-8819-43ccc6722d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.472007 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a91ea-6858-4266-8819-43ccc6722d69 None admin] PATH_INFO: `/v3/projects/e14d0e2f8bff42f98671631097e2d1f6` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.473435 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a91ea-6858-4266-8819-43ccc6722d69 None admin] RBAC: Authorizing `identity:get_project(project_id=e14d0e2f8bff42f98671631097e2d1f6)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:49.475087 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a91ea-6858-4266-8819-43ccc6722d69 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:49.475870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88461f70-1b83-4c7f-80e5-eb5a0ace3658 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:49.477539 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 213/428] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:49 2022] GET /identity/v3/projects/e14d0e2f8bff42f98671631097e2d1f6 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:49.478997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589c56-89c9-4eb6-a3b5-ebfb4039d88e None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.479499 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589c56-89c9-4eb6-a3b5-ebfb4039d88e None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.479998 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5589c56-89c9-4eb6-a3b5-ebfb4039d88e None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.486053 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 214/429] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:49.487088 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5589c56-89c9-4eb6-a3b5-ebfb4039d88e None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:49.516766 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821241d1-8c76-4c15-916e-8fc7bb059177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:49.517868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821241d1-8c76-4c15-916e-8fc7bb059177 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.518352 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821241d1-8c76-4c15-916e-8fc7bb059177 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.519149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821241d1-8c76-4c15-916e-8fc7bb059177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.520856 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821241d1-8c76-4c15-916e-8fc7bb059177 None admin] RBAC: Adding query filter params (group.id=a0b0a47128c049e0a72480d50bb89846, role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:49.521328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821241d1-8c76-4c15-916e-8fc7bb059177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:49.523722 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821241d1-8c76-4c15-916e-8fc7bb059177 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:49.535039 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 216/430] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:49 2022] GET /identity/v3/role_assignments?group.id=a0b0a47128c049e0a72480d50bb89846&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=abb44eff7ea447f6b105452bacf3892b => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:49.537703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b828-9b3d-45b3-a254-e3a3eaa3ad95 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.538127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b828-9b3d-45b3-a254-e3a3eaa3ad95 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.538533 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512b828-9b3d-45b3-a254-e3a3eaa3ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.569366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e512b828-9b3d-45b3-a254-e3a3eaa3ad95 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:49.571410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e512b828-9b3d-45b3-a254-e3a3eaa3ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:49.602346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5589c56-89c9-4eb6-a3b5-ebfb4039d88e None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:49.640711 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69874ecb-623c-4181-8796-1b6c47d741f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:49.642121 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69874ecb-623c-4181-8796-1b6c47d741f1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.642644 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69874ecb-623c-4181-8796-1b6c47d741f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.643121 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69874ecb-623c-4181-8796-1b6c47d741f1 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.645040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69874ecb-623c-4181-8796-1b6c47d741f1 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:49.647856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69874ecb-623c-4181-8796-1b6c47d741f1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:49.650231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 215/431] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:49 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:49.656121 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69874ecb-623c-4181-8796-1b6c47d741f1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:49.667499 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 217/432] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:49.720766 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512b828-9b3d-45b3-a254-e3a3eaa3ad95 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:49.801150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69874ecb-623c-4181-8796-1b6c47d741f1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:49.853429 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:49.853991 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.854462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.854921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.857397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] RBAC: Adding query filter params (group.id=a0b0a47128c049e0a72480d50bb89846, role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=e14d0e2f8bff42f98671631097e2d1f6) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:49.857940 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:49.862325 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:49.871673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 216/433] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:49 2022] GET /identity/v3/role_assignments?group.id=a0b0a47128c049e0a72480d50bb89846&scope.project.id=e14d0e2f8bff42f98671631097e2d1f6&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:49.886016 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512b828-9b3d-45b3-a254-e3a3eaa3ad95 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:49.928360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e3b01-412e-4aa7-8eca-3c8bc44c3d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:49.929547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e3b01-412e-4aa7-8eca-3c8bc44c3d27 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:49.930022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e3b01-412e-4aa7-8eca-3c8bc44c3d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:49.930507 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e3b01-412e-4aa7-8eca-3c8bc44c3d27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:49.943609 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e3b01-412e-4aa7-8eca-3c8bc44c3d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b22e3b01-412e-4aa7-8eca-3c8bc44c3d27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:49.953239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:49.954554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:02:49.955355 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:49.958485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 218/434] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:49.964643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.094573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e223ac-4a27-418d-8e52-de8e35ea2c35 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:50.130947 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852f504-68b2-4828-8c29-e580b9d77194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:50.131554 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852f504-68b2-4828-8c29-e580b9d77194 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.131881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852f504-68b2-4828-8c29-e580b9d77194 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.132159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852f504-68b2-4828-8c29-e580b9d77194 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.132934 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852f504-68b2-4828-8c29-e580b9d77194 None admin] RBAC: Adding query filter params (name=member) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:50.133247 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852f504-68b2-4828-8c29-e580b9d77194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:50.134671 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852f504-68b2-4828-8c29-e580b9d77194 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:50.145188 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 217/435] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:02:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:50.151549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e3b01-412e-4aa7-8eca-3c8bc44c3d27 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.265199 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e3b01-412e-4aa7-8eca-3c8bc44c3d27 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:50.301089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b962f3-9bae-48c3-a0b1-5ed263df28b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:50.301751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b962f3-9bae-48c3-a0b1-5ed263df28b7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.302033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b962f3-9bae-48c3-a0b1-5ed263df28b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.302304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b962f3-9bae-48c3-a0b1-5ed263df28b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.344534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ee82-06aa-4a67-9587-ffa223256e92 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.344867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ee82-06aa-4a67-9587-ffa223256e92 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.345093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ee82-06aa-4a67-9587-ffa223256e92 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.346716 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 218/436] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:50.352090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340940c-3a8e-424d-94fa-be3adc2d2d66 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.352375 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340940c-3a8e-424d-94fa-be3adc2d2d66 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.352648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340940c-3a8e-424d-94fa-be3adc2d2d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.369938 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-6340940c-3a8e-424d-94fa-be3adc2d2d66 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:50.371113 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-6340940c-3a8e-424d-94fa-be3adc2d2d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:50.384508 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b962f3-9bae-48c3-a0b1-5ed263df28b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:50.385930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b962f3-9bae-48c3-a0b1-5ed263df28b7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:50.445783 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 219/437] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:50.447126 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc717-9211-4fbe-aa98-23bc6a52fe77 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.447409 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc717-9211-4fbe-aa98-23bc6a52fe77 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.447683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc717-9211-4fbe-aa98-23bc6a52fe77 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.449983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 220/438] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:50.456182 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f3e5-2fe7-4193-8051-266538679a22 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.456467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f3e5-2fe7-4193-8051-266538679a22 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.456745 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3f3e5-2fe7-4193-8051-266538679a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.475022 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-feb3f3e5-2fe7-4193-8051-266538679a22 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:50.476227 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-feb3f3e5-2fe7-4193-8051-266538679a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:50.501386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 219/439] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:02:50.501386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b962f3-9bae-48c3-a0b1-5ed263df28b7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.551035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 221/440] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:50.552647 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f3e5-2fe7-4193-8051-266538679a22 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.617871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b962f3-9bae-48c3-a0b1-5ed263df28b7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:50.657289 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4922c-8925-43d0-b734-ab168322544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:50.658004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4922c-8925-43d0-b734-ab168322544a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.658281 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4922c-8925-43d0-b734-ab168322544a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.658551 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4922c-8925-43d0-b734-ab168322544a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.660288 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3f3e5-2fe7-4193-8051-266538679a22 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:50.668087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4922c-8925-43d0-b734-ab168322544a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-e7b4922c-8925-43d0-b734-ab168322544a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:50.676047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:50.677085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:50.677898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 220/441] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:50.678569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4922c-8925-43d0-b734-ab168322544a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.693396 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a5ba3-f155-4e46-bb7a-8e4d4c8acf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:50.694260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a5ba3-f155-4e46-bb7a-8e4d4c8acf39 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.694542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a5ba3-f155-4e46-bb7a-8e4d4c8acf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.694817 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a5ba3-f155-4e46-bb7a-8e4d4c8acf39 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.696017 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a5ba3-f155-4e46-bb7a-8e4d4c8acf39 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:50.697466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a5ba3-f155-4e46-bb7a-8e4d4c8acf39 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:50.699304 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 222/442] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:50.700087 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a5ba3-f155-4e46-bb7a-8e4d4c8acf39 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.776488 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4922c-8925-43d0-b734-ab168322544a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:50.795540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a5ba3-f155-4e46-bb7a-8e4d4c8acf39 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:50.808032 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a34eb-3af5-4b68-abc1-10957371c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:50.808819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a34eb-3af5-4b68-abc1-10957371c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.809102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a34eb-3af5-4b68-abc1-10957371c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.809382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a34eb-3af5-4b68-abc1-10957371c9d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.819531 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a34eb-3af5-4b68-abc1-10957371c9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-344a34eb-3af5-4b68-abc1-10957371c9d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:50.827142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:50.828891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:50.829791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 221/443] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:50.830456 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:50.830542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a34eb-3af5-4b68-abc1-10957371c9d0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.830618 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.830618 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.830618 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.831320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:50.831627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:50.833051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:50.841092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 223/444] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:50.841883 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.937133 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a34eb-3af5-4b68-abc1-10957371c9d0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:50.937629 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeb3e0-2b89-4415-b542-cb9aae7477d8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:50.972068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:50.972751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b9a3e-28de-42ce-aedb-ee7ed5ada42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:50.972859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.973011 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.973212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9a3e-28de-42ce-aedb-ee7ed5ada42a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:50.973317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.973489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9a3e-28de-42ce-aedb-ee7ed5ada42a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:50.973761 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b9a3e-28de-42ce-aedb-ee7ed5ada42a None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:50.974019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:50.974330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:50.974921 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b9a3e-28de-42ce-aedb-ee7ed5ada42a None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:50.975710 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:50.976361 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b9a3e-28de-42ce-aedb-ee7ed5ada42a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:50.977955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 222/445] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:50.978696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b9a3e-28de-42ce-aedb-ee7ed5ada42a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:50.988720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 224/446] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:50.988720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:51.070907 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b9a3e-28de-42ce-aedb-ee7ed5ada42a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.081862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd838ef-2ae7-4557-9e7e-0f9a483083cf None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.103691 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8122c6-0ac4-4d40-b872-6c910c9cc88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.104391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8122c6-0ac4-4d40-b872-6c910c9cc88e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.104679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8122c6-0ac4-4d40-b872-6c910c9cc88e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.104958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8122c6-0ac4-4d40-b872-6c910c9cc88e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.114846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.115498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.115805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.116088 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.116917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] RBAC: Adding query filter params (group.id=a0b0a47128c049e0a72480d50bb89846, role.id=969f252ad8ce4e4e8be6b6d5e6590338, scope.project.id=cfb2458fae474b03952818a61655107f) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:51.117229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.118658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.124277 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 225/447] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/role_assignments?group.id=a0b0a47128c049e0a72480d50bb89846&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=969f252ad8ce4e4e8be6b6d5e6590338 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:51.125215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:51.174495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8122c6-0ac4-4d40-b872-6c910c9cc88e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.176141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8122c6-0ac4-4d40-b872-6c910c9cc88e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.232898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6df5d5-fc4b-40fd-9af1-68e7ebbd9cb9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.268424 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321bb9-c925-4b36-8098-01260f8176d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.269084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321bb9-c925-4b36-8098-01260f8176d6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.269373 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321bb9-c925-4b36-8098-01260f8176d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.269650 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83321bb9-c925-4b36-8098-01260f8176d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.281908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 223/448] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:51.283700 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8122c6-0ac4-4d40-b872-6c910c9cc88e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:51.348445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83321bb9-c925-4b36-8098-01260f8176d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.349860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83321bb9-c925-4b36-8098-01260f8176d6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.394449 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8122c6-0ac4-4d40-b872-6c910c9cc88e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.433424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637413bd-f7a1-4548-a2e5-f43060a3d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.434736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637413bd-f7a1-4548-a2e5-f43060a3d632 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.434736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637413bd-f7a1-4548-a2e5-f43060a3d632 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.434908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637413bd-f7a1-4548-a2e5-f43060a3d632 None admin] PATH_INFO: `/v3/projects/cfb2458fae474b03952818a61655107f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.436002 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637413bd-f7a1-4548-a2e5-f43060a3d632 None admin] RBAC: Authorizing `identity:get_project(project_id=cfb2458fae474b03952818a61655107f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.437967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637413bd-f7a1-4548-a2e5-f43060a3d632 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.439984 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 224/449] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:51 2022] GET /identity/v3/projects/cfb2458fae474b03952818a61655107f => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:51.445541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637413bd-f7a1-4548-a2e5-f43060a3d632 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:51.462833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 226/450] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:02:51.468557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321bb9-c925-4b36-8098-01260f8176d6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:51.552222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637413bd-f7a1-4548-a2e5-f43060a3d632 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.572752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83321bb9-c925-4b36-8098-01260f8176d6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.586187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4153d-ca3c-4605-82c0-4b0e1d6073c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.587032 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4153d-ca3c-4605-82c0-4b0e1d6073c2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.587311 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4153d-ca3c-4605-82c0-4b0e1d6073c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.587582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4153d-ca3c-4605-82c0-4b0e1d6073c2 None admin] PATH_INFO: `/v3/groups/a0b0a47128c049e0a72480d50bb89846` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.588777 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4153d-ca3c-4605-82c0-4b0e1d6073c2 None admin] RBAC: Authorizing `identity:get_group(group_id=a0b0a47128c049e0a72480d50bb89846)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.590226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4153d-ca3c-4605-82c0-4b0e1d6073c2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.591822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 225/451] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:51 2022] GET /identity/v3/groups/a0b0a47128c049e0a72480d50bb89846 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:51.598059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4153d-ca3c-4605-82c0-4b0e1d6073c2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:51.606060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196f1f-9df5-456b-a6f5-7aa6c85c51e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.606912 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196f1f-9df5-456b-a6f5-7aa6c85c51e5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.607194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196f1f-9df5-456b-a6f5-7aa6c85c51e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.607469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce196f1f-9df5-456b-a6f5-7aa6c85c51e5 None admin] PATH_INFO: `/v3/projects/7440b284bbab42b8b509df6ef55b7d5c` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.608680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce196f1f-9df5-456b-a6f5-7aa6c85c51e5 None admin] RBAC: Authorizing `identity:get_project(project_id=7440b284bbab42b8b509df6ef55b7d5c)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.610636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce196f1f-9df5-456b-a6f5-7aa6c85c51e5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.612329 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 227/452] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:02:51 2022] GET /identity/v3/projects/7440b284bbab42b8b509df6ef55b7d5c => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:51.617686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196f1f-9df5-456b-a6f5-7aa6c85c51e5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:51.692225 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4153d-ca3c-4605-82c0-4b0e1d6073c2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.713097 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce196f1f-9df5-456b-a6f5-7aa6c85c51e5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.725537 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.726174 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.726477 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.726750 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.727565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] RBAC: Adding query filter params (group.id=a0b0a47128c049e0a72480d50bb89846, role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=cfb2458fae474b03952818a61655107f) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:51.727914 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.729324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.735329 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 226/453] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:51 2022] GET /identity/v3/role_assignments?group.id=a0b0a47128c049e0a72480d50bb89846&scope.project.id=cfb2458fae474b03952818a61655107f&role.id=abb44eff7ea447f6b105452bacf3892b => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:51.745601 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ca33f-22ef-440c-915e-0ed671cc4214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.746475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca33f-22ef-440c-915e-0ed671cc4214 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.746751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca33f-22ef-440c-915e-0ed671cc4214 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.747021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca33f-22ef-440c-915e-0ed671cc4214 None admin] PATH_INFO: `/v3/groups/8ba397009bd846839032bc5051a19e05` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.748299 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ca33f-22ef-440c-915e-0ed671cc4214 None admin] RBAC: Authorizing `identity:get_group(group_id=8ba397009bd846839032bc5051a19e05)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.749781 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ca33f-22ef-440c-915e-0ed671cc4214 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.751851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 228/454] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:02:51 2022] GET /identity/v3/groups/8ba397009bd846839032bc5051a19e05 => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:02:51.757856 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:51.860586 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d62325-8eb9-4ccb-a06e-b9e4fe9f7e7c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:51.895385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba19af-86a7-4970-9831-07a25068ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:51.896074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba19af-86a7-4970-9831-07a25068ad91 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:51.896361 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba19af-86a7-4970-9831-07a25068ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:51.896636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba19af-86a7-4970-9831-07a25068ad91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:51.897482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba19af-86a7-4970-9831-07a25068ad91 None admin] RBAC: Adding query filter params (group.id=8ba397009bd846839032bc5051a19e05, role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=7440b284bbab42b8b509df6ef55b7d5c) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:51.897797 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba19af-86a7-4970-9831-07a25068ad91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:51.899262 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba19af-86a7-4970-9831-07a25068ad91 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:51.905616 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 227/455] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:02:51 2022] GET /identity/v3/role_assignments?group.id=8ba397009bd846839032bc5051a19e05&scope.project.id=7440b284bbab42b8b509df6ef55b7d5c&role.id=67227061f74f48f293a12155e904b5fc => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:54.750343 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475853-1dc1-4857-8cac-9a0b1647435b None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:54.750893 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475853-1dc1-4857-8cac-9a0b1647435b None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:54.750972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0475853-1dc1-4857-8cac-9a0b1647435b None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:54.752570 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 229/456] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:54.757986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6d2a-3fa9-4787-b682-56486cd8a68f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:54.758810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6d2a-3fa9-4787-b682-56486cd8a68f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:54.759299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6d2a-3fa9-4787-b682-56486cd8a68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:54.777041 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-33db6d2a-3fa9-4787-b682-56486cd8a68f None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:54.778524 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-33db6d2a-3fa9-4787-b682-56486cd8a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:54.847004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 228/457] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:54.861898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d578e-7458-4c55-9394-ea2462db239e None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:54.862535 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d578e-7458-4c55-9394-ea2462db239e None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:54.863003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d578e-7458-4c55-9394-ea2462db239e None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:54.864810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 230/458] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:54.869887 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5796-9815-4902-b19c-84f179f4ac29 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:54.870177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5796-9815-4902-b19c-84f179f4ac29 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:54.870457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5796-9815-4902-b19c-84f179f4ac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:54.892799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9bed5796-9815-4902-b19c-84f179f4ac29 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:54.894001 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9bed5796-9815-4902-b19c-84f179f4ac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:54.929933 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d578e-7458-4c55-9394-ea2462db239e None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:54.967189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 229/459] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:54.969089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9f9b-81e5-4c64-99b7-07707b05019a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:54.969386 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9f9b-81e5-4c64-99b7-07707b05019a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:54.969666 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9f9b-81e5-4c64-99b7-07707b05019a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:54.970944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 230/460] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:54.976487 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc416db-5575-4400-93f6-bcb8345fec76 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:54.976946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc416db-5575-4400-93f6-bcb8345fec76 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:54.977378 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc416db-5575-4400-93f6-bcb8345fec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:54.997430 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4dc416db-5575-4400-93f6-bcb8345fec76 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:54.998596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4dc416db-5575-4400-93f6-bcb8345fec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:55.068075 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d578e-7458-4c55-9394-ea2462db239e None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.075798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 231/461] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:55.075798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc416db-5575-4400-93f6-bcb8345fec76 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.129525 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.130686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.131160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.146312 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.148476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:02:55.173186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:55.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:55.175397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:02:55.175397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:02:55.175397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:55.175397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:55.177302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 231/462] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:55.178836 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.197414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc416db-5575-4400-93f6-bcb8345fec76 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.233470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.234317 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.234841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.234841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.245716 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.247216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:02:55.267836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:55.268759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:55.269646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:02:55.269646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:02:55.269646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:55.269646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:55.272290 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 232/463] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:55.272884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.297739 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1d69-4eaf-4970-a193-593f1aecf206 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.330724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230aebd-e2ee-45b9-8d9c-47d45306f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.331444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230aebd-e2ee-45b9-8d9c-47d45306f29a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.331717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230aebd-e2ee-45b9-8d9c-47d45306f29a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.332014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230aebd-e2ee-45b9-8d9c-47d45306f29a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.341651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230aebd-e2ee-45b9-8d9c-47d45306f29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.343070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230aebd-e2ee-45b9-8d9c-47d45306f29a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-1230aebd-e2ee-45b9-8d9c-47d45306f29a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:02:55.360633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:55.361542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:55.362407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:02:55.362407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:02:55.362407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:55.362407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:55.362407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 232/464] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:55.363099 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d09f-6062-4f3c-85b1-e734cd90806c None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.363332 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d09f-6062-4f3c-85b1-e734cd90806c None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.363741 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d09f-6062-4f3c-85b1-e734cd90806c None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.365667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 233/465] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:55.365874 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1d09f-6062-4f3c-85b1-e734cd90806c None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.374785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd372d5-9c0d-442c-8985-27d127339bed None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.408531 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.409188 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.409470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.409748 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.410463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:55.410768 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.412175 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.423806 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 233/466] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:55.424159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.474251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1d09f-6062-4f3c-85b1-e734cd90806c None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.514299 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82de76f-ad40-4860-a186-3b45c4f9f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.515011 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de76f-ad40-4860-a186-3b45c4f9f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.515290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de76f-ad40-4860-a186-3b45c4f9f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.515753 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de76f-ad40-4860-a186-3b45c4f9f1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.516641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de76f-ad40-4860-a186-3b45c4f9f1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:55.516944 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de76f-ad40-4860-a186-3b45c4f9f1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.518311 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82de76f-ad40-4860-a186-3b45c4f9f1e1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.526338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70be859-27d6-4b77-ac6f-8286a912693e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.534093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 234/467] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:55.534093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3080-73c7-4ac2-a76c-ac5b10a701b7 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.534093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3080-73c7-4ac2-a76c-ac5b10a701b7 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.534093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3080-73c7-4ac2-a76c-ac5b10a701b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.552138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-085d3080-73c7-4ac2-a76c-ac5b10a701b7 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:55.553324 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-085d3080-73c7-4ac2-a76c-ac5b10a701b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:55.563882 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.565183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.565888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.566373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.567440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:55.568337 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.570314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.584443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 234/468] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:55.585535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.623743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 235/469] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:55.627468 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3080-73c7-4ac2-a76c-ac5b10a701b7 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.687994 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06251fe-fef1-447e-a9bf-2474d94865f3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.722224 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cbb4b-a391-4548-91ad-a0cafacb51aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.723193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cbb4b-a391-4548-91ad-a0cafacb51aa None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.723687 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cbb4b-a391-4548-91ad-a0cafacb51aa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.724139 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cbb4b-a391-4548-91ad-a0cafacb51aa None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.724994 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cbb4b-a391-4548-91ad-a0cafacb51aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.726626 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cbb4b-a391-4548-91ad-a0cafacb51aa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.727188 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3080-73c7-4ac2-a76c-ac5b10a701b7 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.748038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 235/470] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:55 2022] POST /identity/v3/users => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:55.749055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cbb4b-a391-4548-91ad-a0cafacb51aa None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.772808 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1053460-e630-4c5d-9b5c-d37079749141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.774099 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1053460-e630-4c5d-9b5c-d37079749141 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.774531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1053460-e630-4c5d-9b5c-d37079749141 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.774981 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1053460-e630-4c5d-9b5c-d37079749141 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.775903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1053460-e630-4c5d-9b5c-d37079749141 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.777631 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1053460-e630-4c5d-9b5c-d37079749141 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.803802 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 236/471] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:55 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:55.805469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1053460-e630-4c5d-9b5c-d37079749141 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:55.873046 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cbb4b-a391-4548-91ad-a0cafacb51aa None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.911081 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e607d-1ae1-49eb-8254-e8cc6ca8cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.912034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e607d-1ae1-49eb-8254-e8cc6ca8cddf None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.912417 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e607d-1ae1-49eb-8254-e8cc6ca8cddf None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.912805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e607d-1ae1-49eb-8254-e8cc6ca8cddf None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.913645 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e607d-1ae1-49eb-8254-e8cc6ca8cddf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.915258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e607d-1ae1-49eb-8254-e8cc6ca8cddf None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:55.935387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1053460-e630-4c5d-9b5c-d37079749141 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:55.939638 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 236/472] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:55 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:55.978836 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b280d38-0afb-42b6-b2f6-e52c37f3e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:55.980052 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280d38-0afb-42b6-b2f6-e52c37f3e318 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:55.980498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280d38-0afb-42b6-b2f6-e52c37f3e318 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:55.980937 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b280d38-0afb-42b6-b2f6-e52c37f3e318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:55.995523 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b280d38-0afb-42b6-b2f6-e52c37f3e318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:55.997328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b280d38-0afb-42b6-b2f6-e52c37f3e318 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-8b280d38-0afb-42b6-b2f6-e52c37f3e318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:02:56.019643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:56.020820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:56.021921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:02:56.021921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:02:56.021921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:56.021921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:56.028132 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 237/473] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:56.030400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e607d-1ae1-49eb-8254-e8cc6ca8cddf None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:56.181695 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e607d-1ae1-49eb-8254-e8cc6ca8cddf None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:56.187156 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985692-ae54-4d0b-94e9-00ceeca7d346 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:56.188613 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985692-ae54-4d0b-94e9-00ceeca7d346 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:56.189116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b985692-ae54-4d0b-94e9-00ceeca7d346 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:56.190746 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 238/474] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:02:56.196904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d3cfa-3e42-46ab-857b-49db5f48d8b1 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:56.197211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d3cfa-3e42-46ab-857b-49db5f48d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:56.197454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d3cfa-3e42-46ab-857b-49db5f48d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:56.221570 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-8a5d3cfa-3e42-46ab-857b-49db5f48d8b1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:56.222759 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-8a5d3cfa-3e42-46ab-857b-49db5f48d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:56.223261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:56.224145 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:56.224596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:56.225069 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:56.225973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:56.226277 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:56.227719 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:56.243230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 237/475] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:56.248690 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:56.313351 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 239/476] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:56.337797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d3cfa-3e42-46ab-857b-49db5f48d8b1 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:56.370927 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8f64d-5776-43a0-9844-eb4ace680082 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:56.410394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba022-5779-46b3-9df4-0bcb53974629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:56.411079 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba022-5779-46b3-9df4-0bcb53974629 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:56.411567 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba022-5779-46b3-9df4-0bcb53974629 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:56.411874 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba022-5779-46b3-9df4-0bcb53974629 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:56.413181 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba022-5779-46b3-9df4-0bcb53974629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:56.415119 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba022-5779-46b3-9df4-0bcb53974629 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:56.443058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 238/477] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:02:56 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:02:56.460864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d3cfa-3e42-46ab-857b-49db5f48d8b1 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:56.501258 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:56.501892 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:56.502168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:56.502489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:56.503265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:56.504712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:56.512257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.sql.core [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:02:56.512257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:02:56.512257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [parameters: {'id': '9f2a787768ca4a7488738113cebb8fc8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:02:56.512257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application conn.query(q) May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result.read() May 09 15:02:56.530265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return ref.to_dict() May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:02:56.531246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application next(self.gen) May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application yield resource May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application next(self.gen) May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise self.value May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application session.commit() May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:02:56.532184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.session.flush() May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application compat.raise_( May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:02:56.533038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:02:56.533897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application conn.query(q) May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result.read() May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:02:56.534724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [parameters: {'id': '9f2a787768ca4a7488738113cebb8fc8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:56.535497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:02:56.538205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:56.540185 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 240/478] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:02:56 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:56.540320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba022-5779-46b3-9df4-0bcb53974629 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:56.723902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba022-5779-46b3-9df4-0bcb53974629 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:56.762147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c02a60-ff90-4365-b181-6824b9c5d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:56.762965 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02a60-ff90-4365-b181-6824b9c5d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:56.763248 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02a60-ff90-4365-b181-6824b9c5d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:56.763523 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02a60-ff90-4365-b181-6824b9c5d8d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:56.774331 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c02a60-ff90-4365-b181-6824b9c5d8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-09c02a60-ff90-4365-b181-6824b9c5d8d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:56.782960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:56.785189 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:56.787075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 239/479] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:02:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:56.790676 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:56.914807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d632f60-7bcd-4d19-a9f4-2b165af2f71c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:56.955170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310750c0-733c-4416-bbbf-817a03a21c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:56.955890 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310750c0-733c-4416-bbbf-817a03a21c02 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:56.956176 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310750c0-733c-4416-bbbf-817a03a21c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:56.956456 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310750c0-733c-4416-bbbf-817a03a21c02 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:56.957219 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310750c0-733c-4416-bbbf-817a03a21c02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:56.957527 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310750c0-733c-4416-bbbf-817a03a21c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:56.959010 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310750c0-733c-4416-bbbf-817a03a21c02 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:56.968016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 241/480] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:02:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:58.607316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388795a8-2181-41d2-84d0-cc50529eda5a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:58.608187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388795a8-2181-41d2-84d0-cc50529eda5a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:58.608618 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388795a8-2181-41d2-84d0-cc50529eda5a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:58.610682 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 240/481] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:58.615677 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1fdc-92f0-446e-8318-5c8ae124d6aa None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:58.616557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1fdc-92f0-446e-8318-5c8ae124d6aa None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:58.617040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1fdc-92f0-446e-8318-5c8ae124d6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:58.644778 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-a40c1fdc-92f0-446e-8318-5c8ae124d6aa None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:58.646404 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-a40c1fdc-92f0-446e-8318-5c8ae124d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:58.693403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11b32-a480-4819-bf44-22f6348a3980 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:58.693721 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11b32-a480-4819-bf44-22f6348a3980 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:58.693954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e11b32-a480-4819-bf44-22f6348a3980 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:58.695351 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 241/482] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:58.708743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4742-d383-4446-bc2b-5b1f0937130d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:58.709023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4742-d383-4446-bc2b-5b1f0937130d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:58.709503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a4742-d383-4446-bc2b-5b1f0937130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:58.728804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-495a4742-d383-4446-bc2b-5b1f0937130d None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:58.730910 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-495a4742-d383-4446-bc2b-5b1f0937130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:58.772540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 242/483] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:58.822362 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 242/484] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:02:58.829042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c1fdc-92f0-446e-8318-5c8ae124d6aa None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:58.861975 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a4742-d383-4446-bc2b-5b1f0937130d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:58.952050 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c1fdc-92f0-446e-8318-5c8ae124d6aa None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:58.962729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a4742-d383-4446-bc2b-5b1f0937130d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:58.986853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bbdf5-2349-421f-af0c-c758f45115e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:58.988002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bbdf5-2349-421f-af0c-c758f45115e2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:58.988543 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bbdf5-2349-421f-af0c-c758f45115e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:58.989016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bbdf5-2349-421f-af0c-c758f45115e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:58.996907 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143e793-efd5-4dbc-874a-2f2433643487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:58.997911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143e793-efd5-4dbc-874a-2f2433643487 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:58.998339 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143e793-efd5-4dbc-874a-2f2433643487 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:58.998755 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143e793-efd5-4dbc-874a-2f2433643487 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.000947 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bbdf5-2349-421f-af0c-c758f45115e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-793bbdf5-2349-421f-af0c-c758f45115e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:59.009172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:59.010054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:02:59.010877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:59.011480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143e793-efd5-4dbc-874a-2f2433643487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:59.013598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 243/485] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:59.015079 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b9294-811c-4946-ace5-b53a91680f57 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.016347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b9294-811c-4946-ace5-b53a91680f57 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.016885 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b9294-811c-4946-ace5-b53a91680f57 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.022420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 244/486] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2143e793-efd5-4dbc-874a-2f2433643487 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:59.022540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:59.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:59.024284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 243/487] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:02:59.024944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143e793-efd5-4dbc-874a-2f2433643487 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.026486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e71a9-c002-4173-af3c-20649905106a None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.026916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e71a9-c002-4173-af3c-20649905106a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.027333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e71a9-c002-4173-af3c-20649905106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.049838 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-3d3e71a9-c002-4173-af3c-20649905106a None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:59.051278 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-3d3e71a9-c002-4173-af3c-20649905106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:59.131160 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143e793-efd5-4dbc-874a-2f2433643487 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.132576 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 245/488] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:59.133550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e71a9-c002-4173-af3c-20649905106a None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.177741 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.178789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.179699 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.180208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.181505 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:59.182042 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.184277 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.196446 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 244/489] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:59.197583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.245625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e71a9-c002-4173-af3c-20649905106a None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.280579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.282115 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.282595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.283059 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.284026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:59.284561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.286116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.294569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 246/490] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:59.300487 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.303846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5744e4-53c7-4a4b-9481-2da7089ed599 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.340739 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f5c9-6ddc-4c37-b940-9891ffc78e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.341810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f5c9-6ddc-4c37-b940-9891ffc78e39 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.342288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f5c9-6ddc-4c37-b940-9891ffc78e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.342709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12f5c9-6ddc-4c37-b940-9891ffc78e39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.354096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12f5c9-6ddc-4c37-b940-9891ffc78e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ac12f5c9-6ddc-4c37-b940-9891ffc78e39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:02:59.363008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:59.363979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:02:59.364799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:59.368140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 245/491] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:59.369091 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f5c9-6ddc-4c37-b940-9891ffc78e39 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.409424 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc3e7-8614-46b8-8e84-a0b565cdb7e9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.444671 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.446013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.446013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.446335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.459073 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.460768 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:02:59.479530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:59.480497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:59.481372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:02:59.481372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:02:59.481372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:59.481372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:59.486309 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 247/492] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:59.487256 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.487381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12f5c9-6ddc-4c37-b940-9891ffc78e39 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.524187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.525287 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.525906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.526364 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.539250 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.541216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:02:59.560370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:59.561297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:59.562274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:02:59.562274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:02:59.562274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:59.562274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:59.565349 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 246/493] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:59.566438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.603870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564333d-c834-4041-9445-e289ca1ce764 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.646494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.647154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.647436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.647710 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.648491 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:59.648799 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.650164 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.660153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 248/494] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:59.661257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.680502 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5b1f1-a224-40bf-9885-05c17942790d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.713678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf1234-8071-4702-8d5a-79ba6f2f153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.714336 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf1234-8071-4702-8d5a-79ba6f2f153b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.714619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf1234-8071-4702-8d5a-79ba6f2f153b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.714893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf1234-8071-4702-8d5a-79ba6f2f153b None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.715608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf1234-8071-4702-8d5a-79ba6f2f153b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:59.715971 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf1234-8071-4702-8d5a-79ba6f2f153b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.717307 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf1234-8071-4702-8d5a-79ba6f2f153b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.729447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 247/495] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:59.730770 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35c20-9a63-4b8b-be2c-5cca6e19e428 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.731056 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35c20-9a63-4b8b-be2c-5cca6e19e428 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.731332 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35c20-9a63-4b8b-be2c-5cca6e19e428 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.735806 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 248/496] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:59.735806 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d35c20-9a63-4b8b-be2c-5cca6e19e428 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.769950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c0c0e-5f20-4507-bd3d-c57a80d24650 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.802422 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.803085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.803369 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.803642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.804395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:02:59.804701 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.806206 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.818308 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 249/497] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:02:59.819109 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.835316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d35c20-9a63-4b8b-be2c-5cca6e19e428 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.868196 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec91090-640a-4aab-8a06-ed153a3a1902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.868977 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec91090-640a-4aab-8a06-ed153a3a1902 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.869261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec91090-640a-4aab-8a06-ed153a3a1902 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.869538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec91090-640a-4aab-8a06-ed153a3a1902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.879346 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec91090-640a-4aab-8a06-ed153a3a1902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.880815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec91090-640a-4aab-8a06-ed153a3a1902 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-dec91090-640a-4aab-8a06-ed153a3a1902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:02:59.897891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:59.898946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:59.900183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:02:59.900183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:02:59.900183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:02:59.900183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:02:59.900183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 249/498] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:59.900453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242e50-b4ef-4aa0-a216-39574d1c3424 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.900609 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242e50-b4ef-4aa0-a216-39574d1c3424 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.900858 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47242e50-b4ef-4aa0-a216-39574d1c3424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.915695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f57771-4c2b-4729-9e83-71baca651732 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:02:59.917530 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-47242e50-b4ef-4aa0-a216-39574d1c3424 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:02:59.918696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-47242e50-b4ef-4aa0-a216-39574d1c3424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:02:59.948369 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4a16-bda5-47dc-9609-c992000887e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:02:59.949142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4a16-bda5-47dc-9609-c992000887e0 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.949419 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4a16-bda5-47dc-9609-c992000887e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.949696 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4a16-bda5-47dc-9609-c992000887e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.956809 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b4a16-bda5-47dc-9609-c992000887e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:02:59.958234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b4a16-bda5-47dc-9609-c992000887e0 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-ca2b4a16-bda5-47dc-9609-c992000887e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:02:59.973797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:02:59.974884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 250/499] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18115eb1-dcd5-4975-aab7-92bc085c41e7 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:02:59.980385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18115eb1-dcd5-4975-aab7-92bc085c41e7 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:02:59.981085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18115eb1-dcd5-4975-aab7-92bc085c41e7 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:02:59.981085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 251/500] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:02:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:02:59.981085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18115eb1-dcd5-4975-aab7-92bc085c41e7 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:02:59.991576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 250/501] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:02:59.992637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242e50-b4ef-4aa0-a216-39574d1c3424 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.085320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18115eb1-dcd5-4975-aab7-92bc085c41e7 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.100872 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47242e50-b4ef-4aa0-a216-39574d1c3424 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.118660 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.119455 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.119736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.120046 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.127031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.128516 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.133529 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9e03-6bf7-4339-a695-f6a69217e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.134182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9e03-6bf7-4339-a695-f6a69217e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.134462 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9e03-6bf7-4339-a695-f6a69217e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.134736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9e03-6bf7-4339-a695-f6a69217e2e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.135450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9e03-6bf7-4339-a695-f6a69217e2e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:00.135757 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9e03-6bf7-4339-a695-f6a69217e2e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.137134 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9e03-6bf7-4339-a695-f6a69217e2e9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:00.142857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:00.143927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:03:00.145130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:00.147925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 252/502] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:00.148744 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.151039 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 251/503] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:00.153232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5d6f-89a1-4dec-9fa1-fde4161d9b6f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.153514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5d6f-89a1-4dec-9fa1-fde4161d9b6f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.153783 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b5d6f-89a1-4dec-9fa1-fde4161d9b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.170310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-705b5d6f-89a1-4dec-9fa1-fde4161d9b6f None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:00.171411 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-705b5d6f-89a1-4dec-9fa1-fde4161d9b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:00.235058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 252/504] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:00.235938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b5d6f-89a1-4dec-9fa1-fde4161d9b6f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.243530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f18c5-0aaf-472b-95a7-13b64194b7a6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.277215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.277883 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.278163 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.279270 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:00.279576 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.281765 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.317917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 253/505] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:00.318750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.332855 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b5d6f-89a1-4dec-9fa1-fde4161d9b6f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.364833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561af3f-eae1-4bed-8efa-4651b49c0d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.365619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561af3f-eae1-4bed-8efa-4651b49c0d84 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.365956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561af3f-eae1-4bed-8efa-4651b49c0d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.366234 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561af3f-eae1-4bed-8efa-4651b49c0d84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.375895 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561af3f-eae1-4bed-8efa-4651b49c0d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-c561af3f-eae1-4bed-8efa-4651b49c0d84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:00.383454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:00.384546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:00.385357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 253/506] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:00.386045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561af3f-eae1-4bed-8efa-4651b49c0d84 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.415037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6467a3f-5535-423e-a7dc-a943991d1f83 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.447878 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.448540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.448823 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.449096 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.449925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:00.450234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.451688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.468460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 254/507] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:00.469299 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.478595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561af3f-eae1-4bed-8efa-4651b49c0d84 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.510354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.511132 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.511512 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.511828 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.519033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.520489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:00.535305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:00.536375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 254/508] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:00.537366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.570643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ecc08-810a-4f63-aeab-aaba354750ce None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.605367 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.606152 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.606432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.606705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.617021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.618469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.632152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a93d9-90b3-4945-9e68-070d71bcf146 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:00.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:00.637494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:00.638322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:00.638322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:00.638322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:00.638322 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:00.638782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 255/509] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:00.639604 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.665367 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44068690-f0be-41d3-a4c5-a819c7f760e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.666006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44068690-f0be-41d3-a4c5-a819c7f760e0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.666287 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44068690-f0be-41d3-a4c5-a819c7f760e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.666561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44068690-f0be-41d3-a4c5-a819c7f760e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.731654 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44068690-f0be-41d3-a4c5-a819c7f760e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.733068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44068690-f0be-41d3-a4c5-a819c7f760e0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.735091 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04162f-a47d-45b1-bd49-8c52cf5ad5ad None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.772321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.772989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.773269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.773541 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.774278 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:00.774583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.775972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.783702 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 256/510] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:00.784514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.826907 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 255/511] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:00.828701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44068690-f0be-41d3-a4c5-a819c7f760e0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:00.878653 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11948a-d3bb-490c-965e-20812b2b6fd2 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.910752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6da37b-a44f-456d-804a-02f2f6b351bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.911392 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da37b-a44f-456d-804a-02f2f6b351bd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.911678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da37b-a44f-456d-804a-02f2f6b351bd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.912114 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da37b-a44f-456d-804a-02f2f6b351bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.919615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44068690-f0be-41d3-a4c5-a819c7f760e0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:00.951578 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:00.952264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:00.952544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:00.953872 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:00.954859 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:00.955174 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.956620 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.977085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6da37b-a44f-456d-804a-02f2f6b351bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:00.978530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6da37b-a44f-456d-804a-02f2f6b351bd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:00.992773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 256/512] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:00.993536 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.079726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 257/513] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:01.080416 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6da37b-a44f-456d-804a-02f2f6b351bd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.089932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8296c3-360d-4451-b36d-11698e648f54 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.123272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.123966 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.124250 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.124633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.126033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:01.126368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.127747 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.138434 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 257/514] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:01.139214 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.182684 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6da37b-a44f-456d-804a-02f2f6b351bd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.215181 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.215994 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.216275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.216545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.226243 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.227673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.232173 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c639d22-2ca2-4888-aae7-e3385fa1e34c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:01.244865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:01.245735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:01.246591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:01.246591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:01.246591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:01.246591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:01.246591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 258/515] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:01.246865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.269153 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.269940 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.270221 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.270498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.280569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.282372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:01.299323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:01.300328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:01.301222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:01.301222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:01.301222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:01.301222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:01.301222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 258/516] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:01.301494 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.346881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66426669-1c48-4ee6-af97-ea974a069920 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.383284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90a14-58ad-4ec0-90f0-99fbe1b0b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.383951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90a14-58ad-4ec0-90f0-99fbe1b0b9bf None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.384231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90a14-58ad-4ec0-90f0-99fbe1b0b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.384500 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90a14-58ad-4ec0-90f0-99fbe1b0b9bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.396594 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3af7d3-e9ec-4070-a444-b80f448c3b77 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.428860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.429639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.429922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.430204 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.440452 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.441906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.449521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90a14-58ad-4ec0-90f0-99fbe1b0b9bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.450989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90a14-58ad-4ec0-90f0-99fbe1b0b9bf None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:01.458542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:01.459522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:01.460420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:01.460420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:01.460420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:01.460420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:01.460420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 259/517] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:01.460683 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.547497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 259/518] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:01.548290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90a14-58ad-4ec0-90f0-99fbe1b0b9bf None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.556804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11517b2-8b3f-415c-b41c-2b6f531aa816 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.588564 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672b65-d2f0-440c-9421-9eb00ad74d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.589226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672b65-d2f0-440c-9421-9eb00ad74d88 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.589510 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672b65-d2f0-440c-9421-9eb00ad74d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.589794 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98672b65-d2f0-440c-9421-9eb00ad74d88 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.590486 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98672b65-d2f0-440c-9421-9eb00ad74d88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.591942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98672b65-d2f0-440c-9421-9eb00ad74d88 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.612082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 260/519] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:03:01 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:01.612886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672b65-d2f0-440c-9421-9eb00ad74d88 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.650153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90a14-58ad-4ec0-90f0-99fbe1b0b9bf None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.687366 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.688120 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.688396 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.688669 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.689482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:01.689701 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.691108 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.708435 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 260/520] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:01.708435 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.724287 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98672b65-d2f0-440c-9421-9eb00ad74d88 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.759788 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.760576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.760759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.761017 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.761752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:01.762056 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.763456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.780485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 261/521] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:01.780485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.814932 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5b879-3ee7-4d86-ab53-16ab9da170b9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.859360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.860069 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.860347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.860621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.861336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:01.861635 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.862990 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.875624 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 261/522] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:01.876557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.896204 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eeeed-7456-40d3-9cad-c160d89e65ce None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:01.929924 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:01.930769 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:01.930976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:01.931244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:01.941950 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:01.943396 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:01.960871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:01.961762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:01.962612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:01.962612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:01.962612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:01.962612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:01.966759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 262/523] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:01.967443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:01.974768 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cbbef-1c6c-4775-a0a8-6b285eaad8f7 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.009201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.010001 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.010284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.010559 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.018708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.020197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:02.035257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:02.036481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 262/524] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:02.037594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.072830 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8624c7f-3109-45e3-9415-9fa6d40abd89 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.110244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.111029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.111470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.111743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.118524 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.119988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:02.134360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:02.135278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:02.136143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:02.136143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:02.136143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:02.136143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:02.136143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:02.136143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:02.136143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:02.136143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:02.137742 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b57d4f-1af4-4d58-8c14-b5d4d93fc76a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.140904 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 263/525] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:02.141826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.174410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.175203 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.175474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.175749 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.182428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.183910 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:02.198685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:02.199582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:02.200465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 263/526] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:02.201569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.249316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe5630-7680-4184-8ee2-0d4b93b11a9f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.282279 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.282933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.283213 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.283485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.284226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:02.284532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.285891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.301762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 264/527] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:02.301762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.302009 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afba31-ce00-4b40-ba08-dc1bd0fbae8e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.333930 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.334524 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.334802 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.335072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.335939 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:02.336246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.337677 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.355496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 264/528] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:02.356158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.403889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff45a7-928c-4e0d-bbb1-60df04e7d8a0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.440394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.441053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.441329 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.441601 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.442376 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:02.442693 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.444129 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.456220 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4186aa7-9ec1-42dc-b133-55c49c20daf1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.462115 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 265/529] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:02.463235 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.490883 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.491984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.492331 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.492608 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.493393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:02.493700 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.495139 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.518555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 265/530] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:02.518555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.567876 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7ca51-15ec-4ef1-89a7-03d809863c53 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.601230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.601942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.602500 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.609710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.610194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68096917-2ef7-4e5b-b5f2-fffa9b4b4fab None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.611177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:02.625315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:02.626305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 266/531] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:02.627932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.648347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b30f-cad6-4f69-a68e-597766f396d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.649092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b30f-cad6-4f69-a68e-597766f396d3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.649447 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b30f-cad6-4f69-a68e-597766f396d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.649791 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b30f-cad6-4f69-a68e-597766f396d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.717139 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804b30f-cad6-4f69-a68e-597766f396d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.719140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804b30f-cad6-4f69-a68e-597766f396d3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.728014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c0894-9b34-47f6-a51b-9415fe3167d8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.761590 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.762337 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.762524 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.762791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.763617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=4b31cba57e024daf84c6359b7e6a81cc) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:02.763959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.766202 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.780083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 267/532] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/role_assignments?user.id=4b31cba57e024daf84c6359b7e6a81cc&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:02.780083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.824583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 266/533] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:02.825559 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b30f-cad6-4f69-a68e-597766f396d3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.897182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b96d01-6d83-4921-affa-fe48625da9a6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.934500 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.935202 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.935480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.935753 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.936641 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=22338defb3ca46c28a1ad7b526ab48ac) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:02.937478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.938898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b30f-cad6-4f69-a68e-597766f396d3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:02.939041 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.945570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 268/534] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/role_assignments?user.id=22338defb3ca46c28a1ad7b526ab48ac&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:02.946553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:02.978982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:02.980265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:02.980770 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:02.981236 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:02.982235 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:02.982759 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:02.985043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:02.998626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 267/535] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:03.006254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:03.058038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e573a4e-5108-4dee-b3c5-898ccb9ffb85 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:03.107972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:03.108826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:03.109691 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:03.109959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:03.121647 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fc024-f8a7-4a86-9e7e-b766d13fc91d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:03.124181 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:03.125890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:03.144463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:03.145413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:03.146364 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:03.146364 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:03.146364 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:03.146364 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:03.146364 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 269/536] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:03.151939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:03.162182 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:03.163106 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:03.163557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:03.164071 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:03.165125 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=05cd4cbad8ee4541b53068f7a4916db4) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:03.165637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:03.167507 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:03.174148 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 268/537] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:03 2022] GET /identity/v3/role_assignments?user.id=05cd4cbad8ee4541b53068f7a4916db4&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:03.266706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be81b18-ec54-4dcb-bf32-769b860ddeb9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:03.304038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:03.304779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:03.305060 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:03.305337 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:03.306123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:03.306435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:03.307875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:03.322074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 270/538] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:03.327157 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:03.477524 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91444-2d9c-4f77-b513-34d9873edf4a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:03.513711 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:03.514851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:03.515529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:03.516017 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:03.523365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:03.525184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:03.541044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:03.541927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:03.542782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:03.542782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:03.542782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:03.542782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:03.542782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:03.542782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:03.542782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:03.542782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:03.545226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 269/539] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:03.550969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:03.679676 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58b6a2-e58f-4a5a-b132-1d11d88284ca None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:03.713680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3933a-1155-4251-bae4-5a636e78cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:03.714352 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3933a-1155-4251-bae4-5a636e78cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:03.714632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3933a-1155-4251-bae4-5a636e78cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:03.714908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3933a-1155-4251-bae4-5a636e78cfc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:03.715698 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3933a-1155-4251-bae4-5a636e78cfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:03.716042 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3933a-1155-4251-bae4-5a636e78cfc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:03.717483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3933a-1155-4251-bae4-5a636e78cfc6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:03.730477 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 271/540] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:03.736284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:03.850356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7f0a4-43de-4828-948c-305dfdaaba9d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:03.906038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61354e-3389-4c0d-96b0-9733586844d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:03.906478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61354e-3389-4c0d-96b0-9733586844d6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:03.906692 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61354e-3389-4c0d-96b0-9733586844d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:03.906953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61354e-3389-4c0d-96b0-9733586844d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:03.907891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61354e-3389-4c0d-96b0-9733586844d6 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=2243986a25be4ad0866b80d488ab5d7f) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:03.908204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61354e-3389-4c0d-96b0-9733586844d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:03.909696 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61354e-3389-4c0d-96b0-9733586844d6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:03.915820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 270/541] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:03 2022] GET /identity/v3/role_assignments?user.id=2243986a25be4ad0866b80d488ab5d7f&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:04.065053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaacfe0-e4b5-48c6-8afa-194f188047e9 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:04.065548 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaacfe0-e4b5-48c6-8afa-194f188047e9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:04.065641 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaacfe0-e4b5-48c6-8afa-194f188047e9 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:04.067450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 272/542] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:04.073005 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d360b-60a5-41b2-ba2b-9ebe19242d42 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:04.073293 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d360b-60a5-41b2-ba2b-9ebe19242d42 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:04.073573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d360b-60a5-41b2-ba2b-9ebe19242d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:04.106985 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-5a5d360b-60a5-41b2-ba2b-9ebe19242d42 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:04.108242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-5a5d360b-60a5-41b2-ba2b-9ebe19242d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:04.201393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 271/543] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:03:04.227217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaacfe0-e4b5-48c6-8afa-194f188047e9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:04.368931 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaacfe0-e4b5-48c6-8afa-194f188047e9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:04.412047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2f4a-d881-4245-8f5b-490e4b3d4b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:04.412866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2f4a-d881-4245-8f5b-490e4b3d4b44 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:04.413146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2f4a-d881-4245-8f5b-490e4b3d4b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:04.413418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2f4a-d881-4245-8f5b-490e4b3d4b44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:04.429448 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b2f4a-d881-4245-8f5b-490e4b3d4b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-355b2f4a-d881-4245-8f5b-490e4b3d4b44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:04.437857 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:04.440141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:04.442034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:04.447809 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 273/544] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:04.447998 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d360b-60a5-41b2-ba2b-9ebe19242d42 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:04.602098 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d360b-60a5-41b2-ba2b-9ebe19242d42 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:04.636344 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:04.636935 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:04.637210 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:04.637476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:04.638218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:04.638516 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:04.639890 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:04.648877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 272/545] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:04.654048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2f4a-d881-4245-8f5b-490e4b3d4b44 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:04.765995 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2f4a-d881-4245-8f5b-490e4b3d4b44 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:04.803226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:04.803976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:04.804260 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:04.804533 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:04.818930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:04.820429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:04.844684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:04.845557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:04.846403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:04.846403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:04.846403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:04.846403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:04.846403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 274/546] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:04.851336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:05.006878 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f728e-88c2-4954-a41c-9874519e1817 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:05.054825 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:05.055535 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:05.055839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:05.056157 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:05.056937 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:05.057242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:05.058601 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:05.078767 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 273/547] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:05.092897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:05.243884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc35e89-4a92-448b-93c2-bf05f2291da7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:05.291496 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:05.292238 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:05.292518 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:05.292791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:05.303203 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:05.304669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:05.322089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:05.323035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:05.324575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 275/548] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:05.332859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:05.483619 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b517a2c-c741-473e-a889-786d78c4cd2e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:05.528483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:05.529208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:05.529487 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:05.529756 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:05.530624 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:05.530931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:05.532445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:05.560338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 274/549] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:03:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:05.566527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:05.697498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd6db6-dea4-461c-8b49-b3e299795d97 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:05.739324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1623d-5f81-41ed-b8ee-33e5d58a871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:05.740425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1623d-5f81-41ed-b8ee-33e5d58a871f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:05.740910 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1623d-5f81-41ed-b8ee-33e5d58a871f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:05.741380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1623d-5f81-41ed-b8ee-33e5d58a871f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:05.817790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1623d-5f81-41ed-b8ee-33e5d58a871f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:05.819582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1623d-5f81-41ed-b8ee-33e5d58a871f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:05.918662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 276/550] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:05.924279 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:05.942347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f94544-26eb-49ab-ba8e-22bbca332e8a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:05.942658 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f94544-26eb-49ab-ba8e-22bbca332e8a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:05.942966 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f94544-26eb-49ab-ba8e-22bbca332e8a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:05.944724 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 277/551] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:05.945728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93dbc1-1e00-4ac9-8dfb-f9ec3beab229 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:05.946010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93dbc1-1e00-4ac9-8dfb-f9ec3beab229 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:05.946285 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93dbc1-1e00-4ac9-8dfb-f9ec3beab229 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:05.947819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 278/552] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:05.950971 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4bc75-164c-47d6-8d03-c363c084c5f4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:05.951260 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4bc75-164c-47d6-8d03-c363c084c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:05.951538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4bc75-164c-47d6-8d03-c363c084c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:05.973435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7ee4bc75-164c-47d6-8d03-c363c084c5f4 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:05.975113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7ee4bc75-164c-47d6-8d03-c363c084c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:06.045726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733258-7712-4ea8-8934-d5e46e5f5eda None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.055803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 279/553] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:03:06.055803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad621b-a7ed-4e50-96e8-8e606c1765c0 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.055803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad621b-a7ed-4e50-96e8-8e606c1765c0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.055803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad621b-a7ed-4e50-96e8-8e606c1765c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.077227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a0ad621b-a7ed-4e50-96e8-8e606c1765c0 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:06.077227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a0ad621b-a7ed-4e50-96e8-8e606c1765c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:06.087381 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50271e-63de-46ea-9011-3c7a4b55796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.088236 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50271e-63de-46ea-9011-3c7a4b55796a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.088521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50271e-63de-46ea-9011-3c7a4b55796a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.088794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50271e-63de-46ea-9011-3c7a4b55796a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.100230 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50271e-63de-46ea-9011-3c7a4b55796a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:06.101679 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50271e-63de-46ea-9011-3c7a4b55796a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-7c50271e-63de-46ea-9011-3c7a4b55796a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:06.120769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:06.121680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:06.122531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:06.122531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:06.122531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:06.122531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:06.123171 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 275/554] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:06.124478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5683d8-8f5e-40e1-aa71-ae01ce2d2a86 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.124758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5683d8-8f5e-40e1-aa71-ae01ce2d2a86 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.130569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5683d8-8f5e-40e1-aa71-ae01ce2d2a86 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.135799 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 276/555] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:06.135799 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5683d8-8f5e-40e1-aa71-ae01ce2d2a86 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.163677 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 280/556] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:06.164392 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad621b-a7ed-4e50-96e8-8e606c1765c0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.245897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5683d8-8f5e-40e1-aa71-ae01ce2d2a86 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.269526 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad621b-a7ed-4e50-96e8-8e606c1765c0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.279579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d45e2d-cf35-4807-8d59-9ebe64fbc74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.280395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45e2d-cf35-4807-8d59-9ebe64fbc74e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.281292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45e2d-cf35-4807-8d59-9ebe64fbc74e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.281578 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d45e2d-cf35-4807-8d59-9ebe64fbc74e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.291305 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d45e2d-cf35-4807-8d59-9ebe64fbc74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-01d45e2d-cf35-4807-8d59-9ebe64fbc74e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:06.299316 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:06.300338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:06.301168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 277/557] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:06.301925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca864ed-d1a7-42bd-af94-e798adbce0b6 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.301925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca864ed-d1a7-42bd-af94-e798adbce0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.302192 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca864ed-d1a7-42bd-af94-e798adbce0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.308851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.309505 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.309780 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.310048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.310761 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:06.311062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:06.312538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:06.321055 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-6ca864ed-d1a7-42bd-af94-e798adbce0b6 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:06.322449 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-6ca864ed-d1a7-42bd-af94-e798adbce0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:06.323907 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 281/558] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:06.324715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.394090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 278/559] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:06.394680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca864ed-d1a7-42bd-af94-e798adbce0b6 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.436278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870cd3-e9cb-4050-851c-b73c7437ff93 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.476507 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790f470-dc11-449b-a25e-a8448aa4fc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.477315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790f470-dc11-449b-a25e-a8448aa4fc65 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.477599 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790f470-dc11-449b-a25e-a8448aa4fc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.478216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790f470-dc11-449b-a25e-a8448aa4fc65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.490630 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790f470-dc11-449b-a25e-a8448aa4fc65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0790f470-dc11-449b-a25e-a8448aa4fc65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:06.498568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:06.500318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:06.501178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 282/560] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:06.502384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790f470-dc11-449b-a25e-a8448aa4fc65 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.507501 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca864ed-d1a7-42bd-af94-e798adbce0b6 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.544800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.545475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.545754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.546023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.547385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:06.547690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:06.549145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:06.562556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 279/561] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:06.562556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.608387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790f470-dc11-449b-a25e-a8448aa4fc65 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.640979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.641768 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.642048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.642320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.648818 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:06.650183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:06.657034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59252de5-71eb-428f-9769-b0a895e11950 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:06.664387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:06.665272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 283/562] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:06.671053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.698609 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658bdb1-b4dd-456e-bb09-ab8b5957d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.699407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658bdb1-b4dd-456e-bb09-ab8b5957d4ca None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.699689 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658bdb1-b4dd-456e-bb09-ab8b5957d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.699989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658bdb1-b4dd-456e-bb09-ab8b5957d4ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.715411 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658bdb1-b4dd-456e-bb09-ab8b5957d4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-5658bdb1-b4dd-456e-bb09-ab8b5957d4ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:06.723630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:06.725292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 280/563] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:06.726241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658bdb1-b4dd-456e-bb09-ab8b5957d4ca None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.765816 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741bb2-f6da-4c28-bbb4-6052c5e1ad63 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.799276 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.799961 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.800248 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.800525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.801268 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:06.801576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:06.802941 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:06.810656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 284/564] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:06.811519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.826220 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658bdb1-b4dd-456e-bb09-ab8b5957d4ca None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.859494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24985-3397-457c-80cf-1f57f7143c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.860310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24985-3397-457c-80cf-1f57f7143c8d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.860591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24985-3397-457c-80cf-1f57f7143c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.860862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24985-3397-457c-80cf-1f57f7143c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.870924 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24985-3397-457c-80cf-1f57f7143c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:06.872407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24985-3397-457c-80cf-1f57f7143c8d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-24f24985-3397-457c-80cf-1f57f7143c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:06.888727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:06.889726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:06.890872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:06.890872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:06.890872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:06.890872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:06.890872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 281/565] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:06.891168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22efe4-58f5-499b-81e8-44404be227bf None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.891489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22efe4-58f5-499b-81e8-44404be227bf None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.891664 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22efe4-58f5-499b-81e8-44404be227bf None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.893087 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 282/566] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:06.894797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22efe4-58f5-499b-81e8-44404be227bf None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.910023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807799a-0616-43a1-86b8-b23fdcd568b9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:06.941883 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:06.942539 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:06.942824 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:06.943096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:06.943920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:06.944233 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:06.945655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:06.957785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 285/567] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:06.958580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:06.992147 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22efe4-58f5-499b-81e8-44404be227bf None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.024146 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.024803 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.025086 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.025363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.026098 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:07.026403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.027785 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.036385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 283/568] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:07.037091 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.050227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e991d1a-738b-4878-a525-1f3000143d45 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.082443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b68982-78a4-4cf0-8993-1132476cc572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.083347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b68982-78a4-4cf0-8993-1132476cc572 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.083627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b68982-78a4-4cf0-8993-1132476cc572 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.083932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b68982-78a4-4cf0-8993-1132476cc572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.094338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b68982-78a4-4cf0-8993-1132476cc572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.095784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b68982-78a4-4cf0-8993-1132476cc572 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-07b68982-78a4-4cf0-8993-1132476cc572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:07.112631 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:07.113514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:07.114413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:07.114413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:07.114413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:07.114413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:07.114413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 286/569] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:07.114967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4373439-d7d7-4167-9f9b-9d6a303f68c8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.115273 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4373439-d7d7-4167-9f9b-9d6a303f68c8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.115514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4373439-d7d7-4167-9f9b-9d6a303f68c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.131015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b4373439-d7d7-4167-9f9b-9d6a303f68c8 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:07.132221 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b4373439-d7d7-4167-9f9b-9d6a303f68c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:07.139708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee01df-3aac-488b-bc4c-bbcbe8e812b1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.172675 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.173257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.173534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.173803 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.174510 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:07.174811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.176189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.187344 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 284/570] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:07.188121 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.196540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 287/571] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:07.197379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4373439-d7d7-4167-9f9b-9d6a303f68c8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.283227 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9dfc4-e43a-4687-8a1a-272f9f74b8ce None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.290776 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4373439-d7d7-4167-9f9b-9d6a303f68c8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.314700 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.315347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.315623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.315936 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.316756 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=56dd93adf7bc4781b6af5b40e4bc6c6b) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:07.317064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.318488 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.322353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.323137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.323421 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.323695 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.323875 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 285/572] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/role_assignments?user.id=56dd93adf7bc4781b6af5b40e4bc6c6b&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:07.324662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.335345 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.336882 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:07.356440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:07.357799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:07.358954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:07.358954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:07.358954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:07.358954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:07.358954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 288/573] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:07.358954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.442333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9b86f-5b76-4728-925e-7eaceb21176f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.465298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0705ad-0191-429d-a7ee-43ffb070fc68 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.478546 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.479224 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.479506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.479807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.480540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:07.480848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.482270 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.495969 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 286/574] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:07.496995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.516905 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.518050 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.518335 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.518610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.525946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.527394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:07.543543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:07.544810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 289/575] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:07.545772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.605752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301aa424-6fa7-4f0c-b0ee-b955f1e27f0c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.640614 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d47bd0-2ffe-428f-bf40-3cd28a8a4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.641418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47bd0-2ffe-428f-bf40-3cd28a8a4202 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.641697 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47bd0-2ffe-428f-bf40-3cd28a8a4202 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.641970 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47bd0-2ffe-428f-bf40-3cd28a8a4202 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.647260 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64ca96-5b91-4a71-9ceb-ab5b25312673 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.651781 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d47bd0-2ffe-428f-bf40-3cd28a8a4202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a6d47bd0-2ffe-428f-bf40-3cd28a8a4202 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:07.659442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:07.660605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:07.661708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:07.665413 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 287/576] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:07.666333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d47bd0-2ffe-428f-bf40-3cd28a8a4202 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.685203 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.686119 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.686567 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.688124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.688852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:07.689165 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.690548 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.706871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 290/577] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:07.706871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.764933 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d47bd0-2ffe-428f-bf40-3cd28a8a4202 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.799371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.800201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.800480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.800754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.805688 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7b65c-4442-43bf-95a7-bd88c72e9fdc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.808543 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.810048 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:07.826310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:07.827462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:07.828736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:07.832093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 288/578] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:07.832956 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.840668 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.841343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.841626 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.841903 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.842744 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:07.843150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.844908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.862530 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 291/579] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:07.863604 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:07.945654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a602d6-030d-46b4-8859-93684a00a037 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.964222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013160f2-f89a-483c-8fc8-7f9cffd445ba None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:07.979484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:07.980276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:07.980629 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:07.980983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:07.981799 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:07.982174 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:07.983602 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:07.996768 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 289/580] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:07.996768 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.003633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.004483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.004762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.005034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.012508 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.013947 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:08.029410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:08.030390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:08.032150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 292/581] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:08.032776 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.108076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c364afa-faee-40fb-9bde-b3e1210488fa None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.139757 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a91f7-56c2-4bac-adc8-37eb7f2b9eb6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.143244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.143951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.144232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.144503 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.145342 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:08.145651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.147085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.166020 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 290/582] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:03:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:08.167742 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.179798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.179798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.179798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.179798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.188045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.189578 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:08.207294 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:08.208839 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:08.209967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:08.209967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:08.209967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:08.209967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:08.209967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 293/583] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:08.214321 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.272510 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba133b-1541-4d9e-b851-ffd409aa4d2c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.306835 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.307952 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.308245 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.308494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.309980 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c507b17-35f9-4eea-a7bf-3b2c44cf3c33 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.319059 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.320529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:08.338474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:08.339420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:08.340444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:08.340444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:08.340444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:08.340444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:08.340444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 291/584] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:08.340444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.349216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.349879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.350164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.350429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.351256 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:08.351559 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.352982 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.375159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 294/585] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:08.376092 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.438859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d24bb-03ce-4df1-ae60-6fd3a492a23f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.474122 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e196-720e-40bb-97b6-a908c0878818 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.475920 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.476714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.476989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.477261 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.487635 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.489142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:08.507714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:08.508717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:08.510378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:08.510378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:08.510378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:08.510378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:08.510378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 292/586] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:08.510378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.515544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242427-e580-4125-a408-1804ec59c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.516243 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242427-e580-4125-a408-1804ec59c270 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.516520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242427-e580-4125-a408-1804ec59c270 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.516789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56242427-e580-4125-a408-1804ec59c270 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.517504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242427-e580-4125-a408-1804ec59c270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:08.517808 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242427-e580-4125-a408-1804ec59c270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.519178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56242427-e580-4125-a408-1804ec59c270 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.530379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 295/587] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:08.531390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242427-e580-4125-a408-1804ec59c270 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.610859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c831-a8a9-4c3b-a0a3-3b6b4c437ea1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.630591 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56242427-e580-4125-a408-1804ec59c270 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.645620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.646274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.646550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.646823 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.647534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:08.647862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.649222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.660399 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 293/588] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:08.661545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.667385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.668996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.669280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.669552 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.683079 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.684785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:08.702240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:08.703617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:08.704565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:08.704565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:08.704565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:08.704565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:08.708310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 296/589] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:08.709383 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.762027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2730c-341e-4025-8ba2-90df1bd7b492 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.794550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.795203 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.795480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.795750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.797056 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:08.797352 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.798709 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.808410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c8328-0d34-4b5c-8a69-bf529ec81abf None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.815008 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 294/590] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:08.815008 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.842885 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.844909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.845195 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.845469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.852164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.853606 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:08.868087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:08.869022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:08.870557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 297/591] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:08.871071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:08.916961 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b4e58-6302-4ed5-8a84-06e64e8dbcf6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.950092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:08.950885 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:08.951162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:08.951431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:08.959037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:08.960522 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:08.971394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e86d6-4d75-4bb3-b51b-87083014c6e0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:08.975428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:08.976433 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:08.977368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 295/592] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:08.978038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.008824 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d363d-c575-425f-a782-67d63efc821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.009705 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d363d-c575-425f-a782-67d63efc821e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.009990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d363d-c575-425f-a782-67d63efc821e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.010272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d363d-c575-425f-a782-67d63efc821e None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.011048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d363d-c575-425f-a782-67d63efc821e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:09.011362 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d363d-c575-425f-a782-67d63efc821e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.012879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d363d-c575-425f-a782-67d63efc821e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.028874 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 298/593] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:09.028874 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d363d-c575-425f-a782-67d63efc821e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.089914 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6181f20-edf8-4716-bcac-54da229f8e20 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.121960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d363d-c575-425f-a782-67d63efc821e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.123791 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.125317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.125791 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.126074 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.132928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.134373 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:09.148953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:09.149866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:09.150748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:09.150748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:09.150748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:09.150748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:09.150748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:09.150748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:09.150748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:09.150748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:09.154798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 296/594] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:09.155682 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.157556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.158216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.158497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.158772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.159560 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:09.159904 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.161338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.177963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 299/595] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:09.177963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.257704 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbbe28-65d7-44e0-80e7-cb88a331ad68 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.269175 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d59b4-9f9d-4904-98e1-c017ffb10e16 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.293478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.294137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.294411 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.294677 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.295499 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:09.295870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.298029 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.302223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.303012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.303290 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.303562 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.310117 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.311556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.319747 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 297/596] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:03:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:09.319747 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:09.329223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:09.330137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:09.331023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 300/597] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:09.331516 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.425194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f05fd-d709-4402-acb4-5947f3428b19 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.434366 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dc517-bf07-4a9e-9809-1b1ab557bd64 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.459153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.459842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.460133 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.460413 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.461196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:09.461506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.462920 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.467297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b84a6-9706-42dd-aa4d-a6ae4f49a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.468314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b84a6-9706-42dd-aa4d-a6ae4f49a6dd None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.468648 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b84a6-9706-42dd-aa4d-a6ae4f49a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.468948 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b84a6-9706-42dd-aa4d-a6ae4f49a6dd None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/22338defb3ca46c28a1ad7b526ab48ac/roles/24a80586c13847a5b38391521300ce84` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.479108 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 298/598] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:09.479108 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.487179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b84a6-9706-42dd-aa4d-a6ae4f49a6dd None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=22338defb3ca46c28a1ad7b526ab48ac, role_id=24a80586c13847a5b38391521300ce84)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.488651 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b84a6-9706-42dd-aa4d-a6ae4f49a6dd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.511795 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 301/599] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:09 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/22338defb3ca46c28a1ad7b526ab48ac/roles/24a80586c13847a5b38391521300ce84 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:03:09.511795 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b84a6-9706-42dd-aa4d-a6ae4f49a6dd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.609390 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8b891-9d6e-4604-b0aa-36d54f98f5c3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.613583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b84a6-9706-42dd-aa4d-a6ae4f49a6dd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.645533 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339fdb-a420-489c-ab42-4207eac92d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.646621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339fdb-a420-489c-ab42-4207eac92d7b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.646895 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339fdb-a420-489c-ab42-4207eac92d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.647162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339fdb-a420-489c-ab42-4207eac92d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.649799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.650475 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.650755 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.651028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.651870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:09.652182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.653639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.659634 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339fdb-a420-489c-ab42-4207eac92d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.661138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339fdb-a420-489c-ab42-4207eac92d7b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 302/600] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:09.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-54339fdb-a420-489c-ab42-4207eac92d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:09.678830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:09.680143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:09.681064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:09.681064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:09.681064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:09.681064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:09.681064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 299/601] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:09.686238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cbec-67aa-4c21-87cc-78d6070685d1 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.686238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cbec-67aa-4c21-87cc-78d6070685d1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.686238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4cbec-67aa-4c21-87cc-78d6070685d1 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.686238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 300/602] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:09.686238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4cbec-67aa-4c21-87cc-78d6070685d1 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.776699 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbb8a5-f83b-4c0d-8dc3-acaf32dfe4d0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.797502 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4cbec-67aa-4c21-87cc-78d6070685d1 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:09.810584 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6ca77-8bb5-41a9-86f2-24345ca07311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.811468 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6ca77-8bb5-41a9-86f2-24345ca07311 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.812303 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6ca77-8bb5-41a9-86f2-24345ca07311 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.812557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6ca77-8bb5-41a9-86f2-24345ca07311 None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/4b31cba57e024daf84c6359b7e6a81cc/roles/24a80586c13847a5b38391521300ce84` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.826569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6ca77-8bb5-41a9-86f2-24345ca07311 None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=4b31cba57e024daf84c6359b7e6a81cc, role_id=24a80586c13847a5b38391521300ce84)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.828651 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6ca77-8bb5-41a9-86f2-24345ca07311 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.831499 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772f354-3979-4c47-9674-b1f3414b3cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:09.832413 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f354-3979-4c47-9674-b1f3414b3cfd None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.832770 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f354-3979-4c47-9674-b1f3414b3cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.833102 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772f354-3979-4c47-9674-b1f3414b3cfd None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/05cd4cbad8ee4541b53068f7a4916db4/roles/24a80586c13847a5b38391521300ce84` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.842341 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 303/603] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:09 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/4b31cba57e024daf84c6359b7e6a81cc/roles/24a80586c13847a5b38391521300ce84 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:03:09.844048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6ca77-8bb5-41a9-86f2-24345ca07311 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:09.861867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772f354-3979-4c47-9674-b1f3414b3cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=05cd4cbad8ee4541b53068f7a4916db4, role_id=24a80586c13847a5b38391521300ce84)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:09.863607 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772f354-3979-4c47-9674-b1f3414b3cfd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:09.888216 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 301/604] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:09 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/05cd4cbad8ee4541b53068f7a4916db4/roles/24a80586c13847a5b38391521300ce84 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:03:09.890140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2670ed-c3c6-481e-84b9-5d66a5e4d3b8 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:09.890545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2670ed-c3c6-481e-84b9-5d66a5e4d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:09.891000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2670ed-c3c6-481e-84b9-5d66a5e4d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:09.922059 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-6d2670ed-c3c6-481e-84b9-5d66a5e4d3b8 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:09.923519 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-6d2670ed-c3c6-481e-84b9-5d66a5e4d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:09.961311 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6ca77-8bb5-41a9-86f2-24345ca07311 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:10.003276 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:10.004442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:10.004929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:10.005681 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:10.007218 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:10.007971 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:10.011308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:10.037843 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 304/605] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:10.043895 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:10.053837 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 302/606] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:10.080211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2670ed-c3c6-481e-84b9-5d66a5e4d3b8 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:10.179869 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe49ae-690e-40d4-aa7a-8b62b4e76c54 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:10.206754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2670ed-c3c6-481e-84b9-5d66a5e4d3b8 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:10.211650 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:10.212481 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:10.212762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:10.213036 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:10.220714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:10.222171 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:10.240491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:10.241443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:10.242997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 305/607] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:10.246007 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93490c4-4b84-4e22-befd-fd1c4f15c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:10.246007 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93490c4-4b84-4e22-befd-fd1c4f15c06f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:10.246007 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93490c4-4b84-4e22-befd-fd1c4f15c06f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:10.246007 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93490c4-4b84-4e22-befd-fd1c4f15c06f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:10.247240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:10.257845 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93490c4-4b84-4e22-befd-fd1c4f15c06f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-d93490c4-4b84-4e22-befd-fd1c4f15c06f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:10.266625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:10.268909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:10.270880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 303/608] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:10.278223 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93490c4-4b84-4e22-befd-fd1c4f15c06f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:10.425904 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a637134-42d1-40a3-a2de-ecdbb7d64644 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:10.442466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93490c4-4b84-4e22-befd-fd1c4f15c06f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:10.476821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:10.477505 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:10.477790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:10.478063 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:10.478810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:10.479124 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:10.480518 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:10.489748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 304/609] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:10.495193 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:10.513023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:10.513705 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:10.513990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:10.514265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:10.515211 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:10.515526 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:10.517037 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:10.534845 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 306/610] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:10.540944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:10.648689 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c245daa-fc88-4683-84b0-d7ee17bf48a5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:10.672179 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18426a24-00d5-46ac-8285-9b7c6249983a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:10.710308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946807-36c5-4efc-95ce-778ec39c2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:10.711423 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946807-36c5-4efc-95ce-778ec39c2891 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:10.711897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946807-36c5-4efc-95ce-778ec39c2891 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:10.712310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946807-36c5-4efc-95ce-778ec39c2891 None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/2243986a25be4ad0866b80d488ab5d7f/roles/24a80586c13847a5b38391521300ce84` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:10.738615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea946807-36c5-4efc-95ce-778ec39c2891 None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=2243986a25be4ad0866b80d488ab5d7f, role_id=24a80586c13847a5b38391521300ce84)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:10.741236 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea946807-36c5-4efc-95ce-778ec39c2891 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:10.745173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:10.746269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:10.746691 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:10.747102 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:10.766338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:10.770176 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 307/611] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:10 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/2243986a25be4ad0866b80d488ab5d7f/roles/24a80586c13847a5b38391521300ce84 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:03:10.771149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:10.799178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:10.800197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:10.801398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:10.801398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:10.801398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:10.801398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:10.801398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 305/612] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:10.811738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946807-36c5-4efc-95ce-778ec39c2891 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:10.949147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946807-36c5-4efc-95ce-778ec39c2891 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:10.988232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:10.988827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:10.989109 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:10.989383 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:10.990112 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:10.990417 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:10.991898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:11.004703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 308/613] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:11.010427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:11.121049 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e7b8e-4a01-43f3-9b14-32e81632ecf5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:11.162359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:11.163162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:11.163441 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:11.163712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:11.173746 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:11.175192 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:11.196992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:11.198031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:11.198958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:11.200203 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 306/614] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:11.206611 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:11.342360 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6201e0-f0ce-4de0-8506-f70c3b403e85 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:11.389334 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:11.390149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:11.390423 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:11.391181 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:11.392090 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:11.392402 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:11.393833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:11.415460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 309/615] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:03:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:11.421131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:11.563751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f342e52-07ca-4baf-8fa8-147db9457cee None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:11.603306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:11.604094 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:11.604396 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:11.604674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:11.616793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:11.618249 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:11.646018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:11.648225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:11.650434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:11.650434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:11.650434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:11.650434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:11.650434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 307/616] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:11.653255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:11.803516 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2b731-a364-4a28-a245-275024090bc9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:11.837979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:11.838665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:11.838945 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:11.839221 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:11.839988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:11.840299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:11.841700 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:11.855566 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 310/617] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:11.861397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:11.990005 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f76a29-a4e4-4ece-92c7-987d7e417357 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:12.031960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e790e97-25b5-458e-bdc1-4b4961d3a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:12.032771 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e790e97-25b5-458e-bdc1-4b4961d3a911 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.033051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e790e97-25b5-458e-bdc1-4b4961d3a911 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.033329 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e790e97-25b5-458e-bdc1-4b4961d3a911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.040671 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e790e97-25b5-458e-bdc1-4b4961d3a911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:12.042133 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e790e97-25b5-458e-bdc1-4b4961d3a911 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-3e790e97-25b5-458e-bdc1-4b4961d3a911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:12.058117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:12.060377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:12.063282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 308/618] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:12.071785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:12.113888 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b291e-4261-447b-817a-2fbb480cd4ba None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.114190 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b291e-4261-447b-817a-2fbb480cd4ba None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.114350 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b291e-4261-447b-817a-2fbb480cd4ba None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.115968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 309/619] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:12.123039 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d859c-27be-4538-a252-53a4e5827cc0 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.123039 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d859c-27be-4538-a252-53a4e5827cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.123039 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d859c-27be-4538-a252-53a4e5827cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.138827 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-cc2d859c-27be-4538-a252-53a4e5827cc0 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:12.140713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-cc2d859c-27be-4538-a252-53a4e5827cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:12.174918 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf55a4-990c-4873-9bf7-627d8cb3831f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:12.210420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:12.211090 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.211427 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.211807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.215785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:12.215785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:12.215785 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:12.231881 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 311/620] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:12.234141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:12.291377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 310/621] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:03:12.328571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d859c-27be-4538-a252-53a4e5827cc0 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:12.335623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be54f-f026-4eae-a9b3-401c9c7a34e0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:12.374743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580fb1e-7864-4126-939f-70be37631952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:12.375615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580fb1e-7864-4126-939f-70be37631952 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.375979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580fb1e-7864-4126-939f-70be37631952 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.376259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580fb1e-7864-4126-939f-70be37631952 None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/56dd93adf7bc4781b6af5b40e4bc6c6b/roles/24a80586c13847a5b38391521300ce84` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.393861 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580fb1e-7864-4126-939f-70be37631952 None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=56dd93adf7bc4781b6af5b40e4bc6c6b, role_id=24a80586c13847a5b38391521300ce84)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:12.395714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580fb1e-7864-4126-939f-70be37631952 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:12.410827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 312/622] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:12 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/56dd93adf7bc4781b6af5b40e4bc6c6b/roles/24a80586c13847a5b38391521300ce84 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:03:12.531262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d859c-27be-4538-a252-53a4e5827cc0 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:12.590625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4334d-aa78-49df-b8d1-3d2e2751ef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:12.591830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4334d-aa78-49df-b8d1-3d2e2751ef26 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.592330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4334d-aa78-49df-b8d1-3d2e2751ef26 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.592830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4334d-aa78-49df-b8d1-3d2e2751ef26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.612838 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4334d-aa78-49df-b8d1-3d2e2751ef26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-27a4334d-aa78-49df-b8d1-3d2e2751ef26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:12.621205 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:12.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:12.623083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:12.626803 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 311/623] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:12.632213 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580fb1e-7864-4126-939f-70be37631952 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:12.745812 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad1b5-6de2-4d11-b629-6ef04c7d6f49 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.746566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad1b5-6de2-4d11-b629-6ef04c7d6f49 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.747052 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad1b5-6de2-4d11-b629-6ef04c7d6f49 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.750771 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580fb1e-7864-4126-939f-70be37631952 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:12.751452 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 312/624] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:12.758621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570ac17-d685-40e3-ad15-dd73f217e796 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.759268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570ac17-d685-40e3-ad15-dd73f217e796 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.759752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570ac17-d685-40e3-ad15-dd73f217e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.777923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-0570ac17-d685-40e3-ad15-dd73f217e796 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:12.779501 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-0570ac17-d685-40e3-ad15-dd73f217e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:12.793202 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:12.793877 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.794162 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.794441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:12.795352 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:12.795663 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:12.798462 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:12.813159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 313/625] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:12.824144 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:12.922287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 313/626] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:03:12.936012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57780732-7237-4cf3-9b13-bb8cb2bd2030 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:12.963376 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570ac17-d685-40e3-ad15-dd73f217e796 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:12.978913 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70061e64-384d-4fa3-9cad-952ced853454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:12.980108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061e64-384d-4fa3-9cad-952ced853454 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:12.980567 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061e64-384d-4fa3-9cad-952ced853454 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:12.981206 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70061e64-384d-4fa3-9cad-952ced853454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.002632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061e64-384d-4fa3-9cad-952ced853454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.004939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70061e64-384d-4fa3-9cad-952ced853454 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-70061e64-384d-4fa3-9cad-952ced853454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:13.026563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:13.027725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:13.028804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:13.028804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:13.028804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:13.028804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:13.031238 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 314/627] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:13.032674 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80cbbc-585c-4e16-9441-0c598ed003fc None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.033108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80cbbc-585c-4e16-9441-0c598ed003fc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.033550 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80cbbc-585c-4e16-9441-0c598ed003fc None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.035280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 315/628] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:13.040269 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80cbbc-585c-4e16-9441-0c598ed003fc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.083704 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570ac17-d685-40e3-ad15-dd73f217e796 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.118747 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124eb4b-14be-4a53-a466-8f5dd235f322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.119645 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124eb4b-14be-4a53-a466-8f5dd235f322 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.120017 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124eb4b-14be-4a53-a466-8f5dd235f322 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.120579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124eb4b-14be-4a53-a466-8f5dd235f322 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.131255 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124eb4b-14be-4a53-a466-8f5dd235f322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a124eb4b-14be-4a53-a466-8f5dd235f322 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:13.139155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:13.141428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:13.142603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:13.143299 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 314/629] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:13.144181 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410003b-d7b7-45ef-a1f8-9bd4feff1b7d None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.144352 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410003b-d7b7-45ef-a1f8-9bd4feff1b7d None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.144683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410003b-d7b7-45ef-a1f8-9bd4feff1b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.152638 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80cbbc-585c-4e16-9441-0c598ed003fc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.162666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-5410003b-d7b7-45ef-a1f8-9bd4feff1b7d None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:13.163877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-5410003b-d7b7-45ef-a1f8-9bd4feff1b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:13.189303 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.190314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.190827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.191323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.192299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:13.192811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.194390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.208738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 316/630] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:13.209985 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.239796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 315/631] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:13.239796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410003b-d7b7-45ef-a1f8-9bd4feff1b7d None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.334924 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f207f4-3128-48f5-9d50-c5f5e2df9f10 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.336711 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410003b-d7b7-45ef-a1f8-9bd4feff1b7d None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.370453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.371438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.371608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.372051 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.372475 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.372739 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.373051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.373417 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.373939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:13.375094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.376647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.382167 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.383784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.386055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 317/632] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:13.387117 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:13.399839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:13.401072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:03:13.402060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:13.402619 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 316/633] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:13.403451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.497916 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc88b6-ba73-48bc-b44b-c3246b8215f6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.509153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dc829-7d48-4614-ac81-a35981cf7f92 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.534970 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64061c-6ee7-4a70-9f3c-e4b05caf0a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.536144 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64061c-6ee7-4a70-9f3c-e4b05caf0a5f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.536635 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64061c-6ee7-4a70-9f3c-e4b05caf0a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.537151 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64061c-6ee7-4a70-9f3c-e4b05caf0a5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.544330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.545168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.545452 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.545734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.550402 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64061c-6ee7-4a70-9f3c-e4b05caf0a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:13.556833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.558272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5b64061c-6ee7-4a70-9f3c-e4b05caf0a5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:13.559080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:13.560136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:13.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:13.568626 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 318/634] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:13.569744 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64061c-6ee7-4a70-9f3c-e4b05caf0a5f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:13.576960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:13.578972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:13.579900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:13.579900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:13.579900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:13.579900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:13.579900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 317/635] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:13.580200 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.674865 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64061c-6ee7-4a70-9f3c-e4b05caf0a5f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.679974 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dacf8-2b36-4d7f-9fa6-11bf0fae494d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.708696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba4bc4-45b9-49a3-983c-0cb973cebe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.709353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba4bc4-45b9-49a3-983c-0cb973cebe93 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.709634 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba4bc4-45b9-49a3-983c-0cb973cebe93 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.709908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba4bc4-45b9-49a3-983c-0cb973cebe93 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.710734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba4bc4-45b9-49a3-983c-0cb973cebe93 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:13.711044 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba4bc4-45b9-49a3-983c-0cb973cebe93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.712504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba4bc4-45b9-49a3-983c-0cb973cebe93 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.714615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.715503 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.715632 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.715845 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.716590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:13.716900 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.718309 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.726187 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 318/636] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:13.726983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.738451 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 319/637] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:13.738451 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9a85d-c66f-403a-8e40-aa88db13a240 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.738451 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9a85d-c66f-403a-8e40-aa88db13a240 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.738451 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9a85d-c66f-403a-8e40-aa88db13a240 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.738865 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 320/638] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:13.739926 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9a85d-c66f-403a-8e40-aa88db13a240 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.837738 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f471ec5-b28d-4875-bf48-c3f426f8385e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.838983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9a85d-c66f-403a-8e40-aa88db13a240 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:13.872691 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa829-6c49-4e86-a96f-8b621f470ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.872916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:13.873585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.873866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.874818 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.875217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa829-6c49-4e86-a96f-8b621f470ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.875686 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa829-6c49-4e86-a96f-8b621f470ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.875814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:13.876113 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.876476 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa829-6c49-4e86-a96f-8b621f470ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.877478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.887405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfa829-6c49-4e86-a96f-8b621f470ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:13.888834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfa829-6c49-4e86-a96f-8b621f470ff0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:13.893856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 319/639] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:13.893856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-cacfa829-6c49-4e86-a96f-8b621f470ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:13.911270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:13.912315 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:13.913224 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:13.913224 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:13.913224 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:13.913224 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:13.913224 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 321/640] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:13.913986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1529-23cf-4733-951a-d3e2fab4b73e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:13.914154 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1529-23cf-4733-951a-d3e2fab4b73e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:13.914447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1529-23cf-4733-951a-d3e2fab4b73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:13.932022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e49e1529-23cf-4733-951a-d3e2fab4b73e None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:13.933271 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e49e1529-23cf-4733-951a-d3e2fab4b73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:13.997775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318293f8-6e34-4cc4-8692-07365e780ee8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.007978 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 322/641] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:14.007978 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e1529-23cf-4733-951a-d3e2fab4b73e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.047206 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08ac37-bb5e-443d-8410-07f4fe8a5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.047897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08ac37-bb5e-443d-8410-07f4fe8a5ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.048186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08ac37-bb5e-443d-8410-07f4fe8a5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.048464 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08ac37-bb5e-443d-8410-07f4fe8a5ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.102920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e1529-23cf-4733-951a-d3e2fab4b73e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.118230 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08ac37-bb5e-443d-8410-07f4fe8a5ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.119686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08ac37-bb5e-443d-8410-07f4fe8a5ef7 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.137293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.138374 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.138854 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.139323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.148925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.151204 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:14.170028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:14.171713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:14.172893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 323/642] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:14.173495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.223693 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 320/643] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:14.224998 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08ac37-bb5e-443d-8410-07f4fe8a5ef7 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.277807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f58ca6-359a-4a43-ba62-7ef5205d4bfa None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.311452 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.312151 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.312439 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.312713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.313431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:14.313740 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.315100 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.326030 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 324/644] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:14.327384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.337862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08ac37-bb5e-443d-8410-07f4fe8a5ef7 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.371859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12d5a9-fa51-4cdb-ac0a-70954ba3c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.372596 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12d5a9-fa51-4cdb-ac0a-70954ba3c441 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.372876 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12d5a9-fa51-4cdb-ac0a-70954ba3c441 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.373155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12d5a9-fa51-4cdb-ac0a-70954ba3c441 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.383274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12d5a9-fa51-4cdb-ac0a-70954ba3c441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-ef12d5a9-fa51-4cdb-ac0a-70954ba3c441 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:14.391032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:14.392221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:14.393382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 321/645] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:14.394130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12d5a9-fa51-4cdb-ac0a-70954ba3c441 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.427798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a664e-125b-473f-857d-ab3d6c205939 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.460568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.461247 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.461530 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.461792 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.462618 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:14.462926 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.464384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.487187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 325/646] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:14.487187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.500272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12d5a9-fa51-4cdb-ac0a-70954ba3c441 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.534085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.535177 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.535455 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.535723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.546773 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.548253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:14.565722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:14.566657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:14.567571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:14.567571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:14.567571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:14.567571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:14.567571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 322/647] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:14.567892 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.592385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162263f6-aeca-4ef3-b0e4-73e914514318 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.626836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.627718 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.628023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.628292 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.637155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.638598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:14.653012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:14.654000 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:14.654992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 326/648] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:14.655640 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.672326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37590747-8dec-46f9-bf0b-a11028cf0929 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.707022 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.707859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.708144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.708437 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.709166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:14.709472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.710825 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.723360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 323/649] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:14.723360 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.754289 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b54774-32ee-4e26-b049-0137598fc76e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.789797 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163878f1-3d7c-4ae6-8138-3b102536e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.790444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163878f1-3d7c-4ae6-8138-3b102536e782 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.790734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163878f1-3d7c-4ae6-8138-3b102536e782 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163878f1-3d7c-4ae6-8138-3b102536e782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.824098 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246f9a3-4be5-4cb8-b919-1b03a7720ebd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:14.856568 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:14.857018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163878f1-3d7c-4ae6-8138-3b102536e782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.857455 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:14.857534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:14.857753 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:14.859108 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:14.859222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163878f1-3d7c-4ae6-8138-3b102536e782 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.859559 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:14.860945 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:14.872943 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 324/650] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:14.878982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.966532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 327/651] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:14.967368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163878f1-3d7c-4ae6-8138-3b102536e782 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:14.977271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e380-8f4d-43a9-ab39-c4cc0b83dceb None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.009204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.009859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.010136 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.010404 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.011221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:15.011524 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.012965 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.032545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 325/652] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:15.033843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.060989 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163878f1-3d7c-4ae6-8138-3b102536e782 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.094773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97d2ed-56ee-4d89-9755-1cf8c03eb4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.095548 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97d2ed-56ee-4d89-9755-1cf8c03eb4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.095864 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97d2ed-56ee-4d89-9755-1cf8c03eb4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.096146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97d2ed-56ee-4d89-9755-1cf8c03eb4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.105707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97d2ed-56ee-4d89-9755-1cf8c03eb4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.107155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97d2ed-56ee-4d89-9755-1cf8c03eb4f2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5f97d2ed-56ee-4d89-9755-1cf8c03eb4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:15.124665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:15.125655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:15.126547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:15.126547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:15.126547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:15.126547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:15.126547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 328/653] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:15.127029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9631a1-6981-4fca-b499-85bf41f19041 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.127306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9631a1-6981-4fca-b499-85bf41f19041 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.127580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9631a1-6981-4fca-b499-85bf41f19041 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.128843 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 329/654] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:15.129579 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9631a1-6981-4fca-b499-85bf41f19041 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.135213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37760eb0-0a24-4a1a-b2d6-f2dcfcf375ef None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.167839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.168619 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.168895 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.169163 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.175643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.177087 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:15.192141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:15.193149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 326/655] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:15.194068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.226465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9631a1-6981-4fca-b499-85bf41f19041 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.259398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.260227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.260492 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.260762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.270566 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.272035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:15.288973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:15.289987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:15.290898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:15.290898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:15.290898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:15.290898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:15.290898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 330/656] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:15.291428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.315978 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacdcde-a009-410d-82ab-93779313c471 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.348634 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48df3b6-2d0a-4fce-ad0f-d9d0033c3765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.349282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df3b6-2d0a-4fce-ad0f-d9d0033c3765 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.349572 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df3b6-2d0a-4fce-ad0f-d9d0033c3765 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.349848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df3b6-2d0a-4fce-ad0f-d9d0033c3765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.386207 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d81ee-f9d4-4c40-a4eb-78903c7e0ee9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.413743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48df3b6-2d0a-4fce-ad0f-d9d0033c3765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.415187 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48df3b6-2d0a-4fce-ad0f-d9d0033c3765 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.417810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb7a9a-0025-412a-b9b9-bc7a0bd8b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.418465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7a9a-0025-412a-b9b9-bc7a0bd8b9ec None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.418754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7a9a-0025-412a-b9b9-bc7a0bd8b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.419033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb7a9a-0025-412a-b9b9-bc7a0bd8b9ec None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.419744 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb7a9a-0025-412a-b9b9-bc7a0bd8b9ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:15.420086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb7a9a-0025-412a-b9b9-bc7a0bd8b9ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.422023 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb7a9a-0025-412a-b9b9-bc7a0bd8b9ec None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.432869 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 331/657] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:15.434077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631628-5a5d-409f-b3cc-67bdf13249ca None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.434367 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631628-5a5d-409f-b3cc-67bdf13249ca None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.434643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77631628-5a5d-409f-b3cc-67bdf13249ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.451002 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-77631628-5a5d-409f-b3cc-67bdf13249ca None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:15.452274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-77631628-5a5d-409f-b3cc-67bdf13249ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:15.510374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 327/658] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:15.515455 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48df3b6-2d0a-4fce-ad0f-d9d0033c3765 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.515967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 332/659] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:15.516812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631628-5a5d-409f-b3cc-67bdf13249ca None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.607411 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48df3b6-2d0a-4fce-ad0f-d9d0033c3765 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.614459 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77631628-5a5d-409f-b3cc-67bdf13249ca None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.640250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.640863 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.641143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.641417 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.642190 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:15.642496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.643938 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.646927 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.647578 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.647891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.648170 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.648883 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:15.649192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.650553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.654873 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 328/660] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:15.656507 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.662586 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 333/661] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:15.663350 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.750762 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3047e-12a9-4a4c-8330-bca0ad66e0fc None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.756834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0b59a-abe3-4ccc-83ec-08c35220119d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.782820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.783613 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.783928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.784206 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.788368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.789150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.789431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.789703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.792062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.793510 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.800047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.801470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:15.807480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:15.808573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 329/662] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:15.809529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:15.818826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:15.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:15.821102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:15.821102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:15.821102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:15.821102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:15.821102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 334/663] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:15.821102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.909310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba95d79-e8f6-4afd-ac79-f6fd2098aeae None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.914923 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88365c8f-2414-41fb-b72f-b470a616ec2f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:15.941111 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab3128-2384-45cb-85fc-99ad0b5ee51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.941897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab3128-2384-45cb-85fc-99ad0b5ee51e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.942182 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab3128-2384-45cb-85fc-99ad0b5ee51e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.942458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab3128-2384-45cb-85fc-99ad0b5ee51e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.946896 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:15.947536 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:15.947851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:15.948130 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:15.948952 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=22338defb3ca46c28a1ad7b526ab48ac) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:15.949258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:15.950678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:15.953026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab3128-2384-45cb-85fc-99ad0b5ee51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:15.957474 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 335/664] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/role_assignments?user.id=22338defb3ca46c28a1ad7b526ab48ac&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:15.958252 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-4bab3128-2384-45cb-85fc-99ad0b5ee51e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:15.960805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:15.961713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:15.962579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 330/665] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:15.963288 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab3128-2384-45cb-85fc-99ad0b5ee51e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.064920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf377ff-03cf-4104-b521-7a118b5b78f5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.075014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab3128-2384-45cb-85fc-99ad0b5ee51e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.100179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.101176 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.101845 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.102127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.110129 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.111649 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.112626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.113307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.113583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.113851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.114691 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:16.114996 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.116465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:16.127156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:16.128230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:16.129140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:16.129140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:16.129140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:16.129140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:16.129140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:16.129140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:16.129140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:16.129140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:16.133288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 336/666] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:16.134083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.141336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 331/667] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:03:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:16.141336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.235679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59800ec9-54e4-427c-bc9a-5a7688a298b0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.245851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86497-c81c-466b-923a-8a043aba93a6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.269282 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.270132 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.270247 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.270479 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.271197 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:16.271575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.272910 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.283135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.283828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.284113 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.284386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.285137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:16.289581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.289707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 337/668] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:16.289707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.289895 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.298056 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 332/669] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:16.302568 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.388503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95f962-6149-45f7-9ce4-d32624bdc2aa None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.401160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31f91-056b-4029-9add-26b9e74bdf62 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.423401 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.424211 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.424559 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.424907 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.425755 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:16.426131 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.427615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.434333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16557-31c1-4fbf-ab97-86636991f6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.435064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16557-31c1-4fbf-ab97-86636991f6ad None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.435419 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16557-31c1-4fbf-ab97-86636991f6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.435789 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a16557-31c1-4fbf-ab97-86636991f6ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.445021 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 338/670] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:16.445021 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.504459 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a16557-31c1-4fbf-ab97-86636991f6ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.505832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a16557-31c1-4fbf-ab97-86636991f6ad None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.545421 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9b39b-d8cb-45b5-a3ba-f6bd2333be64 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.577520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.578546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.579165 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.579165 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.585544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.586956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:16.601258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:16.602368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:16.603482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:16.603482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:16.603482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:16.603482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:16.603482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:16.603482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:16.603482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:16.603482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:16.610207 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 333/671] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:16.610207 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16557-31c1-4fbf-ab97-86636991f6ad None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.610767 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 339/672] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:16.612305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.705681 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a16557-31c1-4fbf-ab97-86636991f6ad None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.714124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc9472-431f-424c-a822-a3a6b05ae850 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.738378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.739167 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.739442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.739717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.747022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.747921 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.748033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.748252 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.749759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=05cd4cbad8ee4541b53068f7a4916db4) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:16.750046 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.750349 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.751445 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.751848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.768247 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 340/673] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/role_assignments?user.id=05cd4cbad8ee4541b53068f7a4916db4&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:16.768247 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:16.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:16.770326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:16.771216 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:16.771216 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:16.771216 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:16.771216 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:16.775633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 334/674] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:16.776677 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.888951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9c700-8ce0-4a03-98b0-0a8110dbcc77 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.901806 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711a6fb-f58c-4087-9fba-9a32f6737503 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:16.929335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.930006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.930289 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.930566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.931361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:16.931674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.933142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.938820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:16.939618 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:16.939941 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:16.940275 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:16.946514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 335/675] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:16.947463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:16.957503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:16.959160 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:16.981300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:16.982255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:16.983168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:16.983168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:16.983168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:16.983168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:16.987739 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 341/676] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:16.988642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.066926 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934358f-6bf6-4eaa-afd7-d62d394321a3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.104957 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08cec-def9-4c8d-a0e2-ddeb22c286f4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.110730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.111410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.111695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.112073 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.112840 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:17.113151 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.114638 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.127793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 336/677] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:17.128642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.140517 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.141180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.141456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.141737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.142567 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=4b31cba57e024daf84c6359b7e6a81cc) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:17.142881 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.144338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.150656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 342/678] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:16 2022] GET /identity/v3/role_assignments?user.id=4b31cba57e024daf84c6359b7e6a81cc&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:17.151470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.237554 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1092b02-eb30-4303-abe3-d041549a69da None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.261128 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cd87-c440-4ed6-8996-d8d6bec27054 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.288591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.289287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.289564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.289843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.290578 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:17.290888 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.292309 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.298423 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.299217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.299498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.299788 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.307912 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.309378 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.310527 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 337/679] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:17.317625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:17.329461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:17.331715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:17.334054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 343/680] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:17.340953 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.473175 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2242-bed5-4b75-8b18-39c683a02725 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.510118 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.511087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.511567 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.512050 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.512376 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3ef20-f779-4819-bfc8-eca359027320 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.513256 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:17.513739 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.515462 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.536094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 344/681] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:03:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:17.541635 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.564773 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.566815 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.567866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.568153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.577387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.579281 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:17.597813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:17.598790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:17.599687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 338/682] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:17.604923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.659960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baca92f-dfa9-4503-a0c6-27507fb1f753 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.708399 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6d486-b023-46fd-8cdd-4e9efe1c8c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.709050 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6d486-b023-46fd-8cdd-4e9efe1c8c1c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.709331 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6d486-b023-46fd-8cdd-4e9efe1c8c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.709602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6d486-b023-46fd-8cdd-4e9efe1c8c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.725288 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536dd9-267e-4acd-8d5c-a3fec75199e8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.771984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.773051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.773476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.774151 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.775109 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:17.775561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.777626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.794107 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 339/683] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:17.795544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6d486-b023-46fd-8cdd-4e9efe1c8c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.798359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6d486-b023-46fd-8cdd-4e9efe1c8c1c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.800233 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.917108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 345/684] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:17.923346 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6d486-b023-46fd-8cdd-4e9efe1c8c1c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:17.932992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de063c-3dee-4698-82e4-2b3018954094 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:17.966798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:17.968448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:17.968927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:17.969395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:17.970469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=2243986a25be4ad0866b80d488ab5d7f) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:17.971002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:17.972669 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:17.979452 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 340/685] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:17 2022] GET /identity/v3/role_assignments?user.id=2243986a25be4ad0866b80d488ab5d7f&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:18.027219 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6d486-b023-46fd-8cdd-4e9efe1c8c1c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:18.064624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:18.065441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:18.065724 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:18.065999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:18.077914 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:18.079429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:18.099284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:18.100265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:18.101155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:18.101155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:18.101155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:18.101155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:18.101155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 346/686] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:18.106502 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:18.241762 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c445a8-3744-4cc2-abaf-ba4d7cd31a68 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:18.280051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46e505-ee32-484c-9e1d-09717dfc8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:18.281064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e505-ee32-484c-9e1d-09717dfc8445 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:18.281064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e505-ee32-484c-9e1d-09717dfc8445 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:18.281256 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46e505-ee32-484c-9e1d-09717dfc8445 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:18.281937 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e505-ee32-484c-9e1d-09717dfc8445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:18.282241 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e505-ee32-484c-9e1d-09717dfc8445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:18.283617 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46e505-ee32-484c-9e1d-09717dfc8445 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:18.297533 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 341/687] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:18.302640 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:18.418761 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95580c-e58d-40f8-bea5-3eb0c4cb1bb8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:18.455986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:18.456795 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:18.457076 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:18.457350 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:18.458374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbf95-48eb-4b34-97f0-b85bb6d2e01f None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:18.458665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbf95-48eb-4b34-97f0-b85bb6d2e01f None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:18.458946 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bbf95-48eb-4b34-97f0-b85bb6d2e01f None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:18.460555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 342/688] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:18.464592 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:18.465906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:18.466699 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92540e-4627-4b4c-b9f0-6d2c0f7725e1 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:18.466988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92540e-4627-4b4c-b9f0-6d2c0f7725e1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:18.467260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92540e-4627-4b4c-b9f0-6d2c0f7725e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:18.480058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:18.480969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:18.481879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 347/689] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:18.488170 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:18.490500 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-9b92540e-4627-4b4c-b9f0-6d2c0f7725e1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:18.491694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-9b92540e-4627-4b4c-b9f0-6d2c0f7725e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:18.589454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 343/690] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:18.612503 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92540e-4627-4b4c-b9f0-6d2c0f7725e1 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:18.614323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6489494-341a-42d2-b912-b41cc029a93d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:18.651637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:18.652714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:18.653940 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:18.654391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:18.655942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:18.656548 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:18.658191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:18.674440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 348/691] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:18.679654 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:18.756829 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92540e-4627-4b4c-b9f0-6d2c0f7725e1 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:18.821895 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:18.822711 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:18.822990 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:18.823264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:18.823950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:18.825312 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:18.847330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:18.848585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:18.849454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 344/692] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:03:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:18.854289 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:18.872597 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c734fc-2c79-4b09-aec9-44481482ae53 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:18.934448 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:18.935109 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:18.935388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:18.935660 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:18.943483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=56dd93adf7bc4781b6af5b40e4bc6c6b) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:18.943483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:18.943483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:18.959150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 349/693] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:18 2022] GET /identity/v3/role_assignments?user.id=56dd93adf7bc4781b6af5b40e4bc6c6b&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:19.008617 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f12a6-eb41-4d9b-885e-7d42ca4d1cee None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:19.046023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66c847-7a9c-415b-a27f-7664332f9af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:19.046693 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66c847-7a9c-415b-a27f-7664332f9af9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:19.046982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66c847-7a9c-415b-a27f-7664332f9af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:19.047257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66c847-7a9c-415b-a27f-7664332f9af9 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:19.048057 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66c847-7a9c-415b-a27f-7664332f9af9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:19.048364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66c847-7a9c-415b-a27f-7664332f9af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:19.049798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66c847-7a9c-415b-a27f-7664332f9af9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:19.055181 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 345/694] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:03:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:19.060916 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:19.168036 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e6bb0-5ade-4a39-a562-2119c7e29691 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:19.204650 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f33ad-7eef-4663-a7ff-4ebccfd09b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:19.205420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f33ad-7eef-4663-a7ff-4ebccfd09b7f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:19.205768 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f33ad-7eef-4663-a7ff-4ebccfd09b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:19.206047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f33ad-7eef-4663-a7ff-4ebccfd09b7f None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:19.206753 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f33ad-7eef-4663-a7ff-4ebccfd09b7f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:19.207057 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f33ad-7eef-4663-a7ff-4ebccfd09b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:19.208443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f33ad-7eef-4663-a7ff-4ebccfd09b7f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:19.214771 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 350/695] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:03:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:19.579797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268163c-8b9d-4886-8d26-1ff6edf8ecc5 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:19.580202 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268163c-8b9d-4886-8d26-1ff6edf8ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:19.580429 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268163c-8b9d-4886-8d26-1ff6edf8ecc5 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:19.581933 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 346/696] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:19.587601 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865408d-3723-443d-aede-cf4c3fc2ffda None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:19.588260 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865408d-3723-443d-aede-cf4c3fc2ffda None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:19.588750 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865408d-3723-443d-aede-cf4c3fc2ffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:19.609496 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e865408d-3723-443d-aede-cf4c3fc2ffda None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:19.611185 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e865408d-3723-443d-aede-cf4c3fc2ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:19.684732 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 351/697] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:19.711997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268163c-8b9d-4886-8d26-1ff6edf8ecc5 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:19.832159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268163c-8b9d-4886-8d26-1ff6edf8ecc5 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:19.874931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:19.875879 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:19.876186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:19.876469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:19.891980 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:19.893428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:19.914072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:19.915037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:19.915993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:19.915993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:19.915993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:19.915993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:19.917703 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 347/698] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:19.923348 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865408d-3723-443d-aede-cf4c3fc2ffda None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:20.068312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865408d-3723-443d-aede-cf4c3fc2ffda None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:20.132572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bafa81-14f3-4cf1-ab56-5885e52faf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:20.133605 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bafa81-14f3-4cf1-ab56-5885e52faf64 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:20.134093 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bafa81-14f3-4cf1-ab56-5885e52faf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:20.134589 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bafa81-14f3-4cf1-ab56-5885e52faf64 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:20.135513 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bafa81-14f3-4cf1-ab56-5885e52faf64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:20.136068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bafa81-14f3-4cf1-ab56-5885e52faf64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:20.137643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bafa81-14f3-4cf1-ab56-5885e52faf64 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:20.150660 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 352/699] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:20.156974 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:20.253340 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593cd3-c51d-4bd6-8a4a-94859ce0d64e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:20.254009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593cd3-c51d-4bd6-8a4a-94859ce0d64e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:20.254391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593cd3-c51d-4bd6-8a4a-94859ce0d64e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:20.256175 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 353/700] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:20.262398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c605-0385-494f-b429-2bf34da3c338 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:20.262777 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c605-0385-494f-b429-2bf34da3c338 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:20.263128 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c605-0385-494f-b429-2bf34da3c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:20.281127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0630c605-0385-494f-b429-2bf34da3c338 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:20.282615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0630c605-0385-494f-b429-2bf34da3c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:20.326810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8fd7c-69aa-4c15-8589-48e5864e1052 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:20.385733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea9a4-6513-4ff2-b563-ebd09c9546ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:20.386816 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea9a4-6513-4ff2-b563-ebd09c9546ed None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:20.387271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea9a4-6513-4ff2-b563-ebd09c9546ed None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:20.387712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea9a4-6513-4ff2-b563-ebd09c9546ed None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:20.388595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea9a4-6513-4ff2-b563-ebd09c9546ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:20.390935 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea9a4-6513-4ff2-b563-ebd09c9546ed None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:20.410053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 354/701] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:03:20.424342 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 348/702] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:03:20 2022] POST /identity/v3/users => generated 254 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:20.442879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c605-0385-494f-b429-2bf34da3c338 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:20.565876 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c605-0385-494f-b429-2bf34da3c338 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:20.609946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6e884-2fb3-4ff4-908f-5d353c884a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:20.610757 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e884-2fb3-4ff4-908f-5d353c884a11 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:20.611103 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e884-2fb3-4ff4-908f-5d353c884a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:20.611383 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e884-2fb3-4ff4-908f-5d353c884a11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:20.622191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e884-2fb3-4ff4-908f-5d353c884a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0db6e884-2fb3-4ff4-908f-5d353c884a11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:20.632441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:20.633465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:20.634760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 355/703] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:20.640710 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea9a4-6513-4ff2-b563-ebd09c9546ed None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:20.756478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea9a4-6513-4ff2-b563-ebd09c9546ed None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:20.799825 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:20.800511 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:20.800792 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:20.801068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:20.801824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:20.802128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:20.803492 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:20.813572 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 349/704] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:20.821256 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6e884-2fb3-4ff4-908f-5d353c884a11 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:20.927198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6e884-2fb3-4ff4-908f-5d353c884a11 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:20.962911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:20.964128 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:20.964614 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:20.965094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:20.977310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:20.979054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:21.000431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:21.001400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:21.002328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:21.002328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:21.002328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:21.002328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:21.006863 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 356/705] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:21.010627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:21.125357 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3139939-6a10-44b9-a59e-a4ea5e80e6df None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:21.168805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b5beb-1061-4786-b6d7-d924b43bdafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:21.169471 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5beb-1061-4786-b6d7-d924b43bdafe None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:21.169751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5beb-1061-4786-b6d7-d924b43bdafe None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:21.170025 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5beb-1061-4786-b6d7-d924b43bdafe None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:21.171475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5beb-1061-4786-b6d7-d924b43bdafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:21.172246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5beb-1061-4786-b6d7-d924b43bdafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:21.173620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5beb-1061-4786-b6d7-d924b43bdafe None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:21.190570 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 350/706] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:21.196177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:21.296809 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc346f-ac28-48d0-a02a-39ac73b86c98 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:21.297169 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc346f-ac28-48d0-a02a-39ac73b86c98 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:21.297437 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc346f-ac28-48d0-a02a-39ac73b86c98 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:21.299155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 351/707] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:21.305092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedccd-2999-44bf-84ef-10e85ead02b1 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:21.305092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedccd-2999-44bf-84ef-10e85ead02b1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:21.305092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedccd-2999-44bf-84ef-10e85ead02b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:21.324560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-a0fedccd-2999-44bf-84ef-10e85ead02b1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:21.325877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-a0fedccd-2999-44bf-84ef-10e85ead02b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:21.361967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48420ff-353f-488a-bf59-33858c58bac9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:21.401420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 352/708] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:21.415550 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:21.416544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:21.416823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:21.417094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:21.425524 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:21.427020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:21.441898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:21.442870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:21.443846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:21.444382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fedccd-2999-44bf-84ef-10e85ead02b1 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:21.455801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 357/709] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:03:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:21.461344 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:21.584075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb4c94-49d3-49c3-b5bb-6a773ddd489f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:21.624067 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:21.624877 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:21.625157 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:21.625430 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:21.626264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:21.626576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:21.628040 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:21.647951 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 358/710] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:03:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:21.653979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:21.688328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fedccd-2999-44bf-84ef-10e85ead02b1 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:21.724117 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:21.724882 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:21.725157 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:21.725426 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] PATH_INFO: `/v3/services/network` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:21.726082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:21.727531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:21.740824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:21.741889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:21.743145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 353/711] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:21 2022] GET /identity/v3/services/network => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:21.748491 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:21.867439 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c94d3-6e0d-42f0-b8bc-25cf134f5c6e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:21.883834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f80ae5-442a-4266-8689-b6607b72b0ee None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:21.918446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:21.919111 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:21.919390 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:21.919700 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:21.920450 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] RBAC: Adding query filter params (name=network) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:21.921365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:21.922795 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:21.927568 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 354/712] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:21.932828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:21.957812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760d3ca-9edd-46bf-8615-2ed413483268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:21.958477 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760d3ca-9edd-46bf-8615-2ed413483268 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:21.958761 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760d3ca-9edd-46bf-8615-2ed413483268 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:21.959040 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760d3ca-9edd-46bf-8615-2ed413483268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.041617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760d3ca-9edd-46bf-8615-2ed413483268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:22.042984 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760d3ca-9edd-46bf-8615-2ed413483268 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:22.059255 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07dd05-eb7a-44c6-bbd1-52bb1dd75621 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:22.109296 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add44136-8d5b-49ea-ba00-bf846d1e10bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:22.109982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add44136-8d5b-49ea-ba00-bf846d1e10bf None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.110260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add44136-8d5b-49ea-ba00-bf846d1e10bf None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.110534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add44136-8d5b-49ea-ba00-bf846d1e10bf None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.111250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add44136-8d5b-49ea-ba00-bf846d1e10bf None admin] RBAC: Adding query filter params (type=network) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:22.111552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add44136-8d5b-49ea-ba00-bf846d1e10bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:22.113044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add44136-8d5b-49ea-ba00-bf846d1e10bf None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:22.124820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 355/713] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:22.126497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df010930-5898-45a2-ba3a-364cbf941161 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.126783 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df010930-5898-45a2-ba3a-364cbf941161 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.127056 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df010930-5898-45a2-ba3a-364cbf941161 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.128759 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 356/714] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:22.143091 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe14f-3a01-4ee9-8ed8-f793c0af47fb None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.143397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe14f-3a01-4ee9-8ed8-f793c0af47fb None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.143644 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe14f-3a01-4ee9-8ed8-f793c0af47fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.148295 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 359/715] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:22.155795 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760d3ca-9edd-46bf-8615-2ed413483268 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:22.189078 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-b1bbe14f-3a01-4ee9-8ed8-f793c0af47fb None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:22.191454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-b1bbe14f-3a01-4ee9-8ed8-f793c0af47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:22.299349 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 357/716] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:22.301225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414fe3-8683-49f0-8eb9-de754920179a None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.301721 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414fe3-8683-49f0-8eb9-de754920179a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.302198 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414fe3-8683-49f0-8eb9-de754920179a None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.303941 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 358/717] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:22.308911 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2cdb-a735-4d0d-94d3-ddcf68c15245 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.309438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2cdb-a735-4d0d-94d3-ddcf68c15245 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.309918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2cdb-a735-4d0d-94d3-ddcf68c15245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.332353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760d3ca-9edd-46bf-8615-2ed413483268 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:22.333733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-60ef2cdb-a735-4d0d-94d3-ddcf68c15245 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:22.336308 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-60ef2cdb-a735-4d0d-94d3-ddcf68c15245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:22.370526 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:22.372105 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.373953 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.374241 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.388256 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:22.389809 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:22.408944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:22.409911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:22.410812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:22.410812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:22.410812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:22.410812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:22.410812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 360/718] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:22.411391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:22.439449 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 359/719] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:03:22.440804 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2cdb-a735-4d0d-94d3-ddcf68c15245 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:22.541757 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd250d02-947c-47bb-97da-0c39db115548 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:22.559498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2cdb-a735-4d0d-94d3-ddcf68c15245 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:22.583357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b6b89-69f9-469f-a2f1-abc71e0e431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:22.584055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b6b89-69f9-469f-a2f1-abc71e0e431a None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.584336 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b6b89-69f9-469f-a2f1-abc71e0e431a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.584611 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b6b89-69f9-469f-a2f1-abc71e0e431a None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.585753 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b6b89-69f9-469f-a2f1-abc71e0e431a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:22.587434 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b6b89-69f9-469f-a2f1-abc71e0e431a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:22.601596 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:22.602323 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.602672 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.603012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.603930 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:22.604248 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:22.605927 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:22.607411 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 361/720] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:03:22 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:22.609318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b6b89-69f9-469f-a2f1-abc71e0e431a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:22.619236 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 360/721] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:22.637580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:22.779136 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059c8e9-c769-4a46-96a0-8b11f438ac1f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:22.826272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:22.828132 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.828418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.829044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.839800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:22.841854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:22.860662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:22.862755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:22.864982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 361/722] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:22.879081 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:22.884468 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b6b89-69f9-469f-a2f1-abc71e0e431a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:22.929814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3df5-e23b-4446-9fcc-2c6f90e4d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:22.930987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3df5-e23b-4446-9fcc-2c6f90e4d929 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:22.931266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3df5-e23b-4446-9fcc-2c6f90e4d929 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:22.931542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc3df5-e23b-4446-9fcc-2c6f90e4d929 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:22.950748 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc3df5-e23b-4446-9fcc-2c6f90e4d929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0dbc3df5-e23b-4446-9fcc-2c6f90e4d929 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:22.959979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:22.962120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:22.964246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 362/723] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:22.971800 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3df5-e23b-4446-9fcc-2c6f90e4d929 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:23.006878 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8be60-3c05-4a44-9b44-48e63547b0a5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:23.049178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:23.049851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:23.050133 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:23.050406 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:23.051200 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:23.051511 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:23.053708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:23.070131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 362/724] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:23.080789 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:23.091890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc3df5-e23b-4446-9fcc-2c6f90e4d929 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:23.180497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:23.181550 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:23.182027 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:23.182491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:23.183436 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:23.183979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:23.185582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:23.188133 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595b0b-096d-4945-87ab-b5d3ff0434e1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:23.195348 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 363/725] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:23.211133 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:23.237440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:23.238105 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:23.238441 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:23.238722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:23.239565 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=4b31cba57e024daf84c6359b7e6a81cc) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:23.239945 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:23.241682 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:23.248856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 363/726] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:23 2022] GET /identity/v3/role_assignments?user.id=4b31cba57e024daf84c6359b7e6a81cc&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=67227061f74f48f293a12155e904b5fc => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:23.345188 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5691c-8dc3-4e4d-b9ab-050d0c9e1d3b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:23.394680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077f67c-c9c4-4e4e-aaa1-b0aa37def65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:23.395979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f67c-c9c4-4e4e-aaa1-b0aa37def65f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:23.396572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f67c-c9c4-4e4e-aaa1-b0aa37def65f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:23.397068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f67c-c9c4-4e4e-aaa1-b0aa37def65f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:23.414020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077f67c-c9c4-4e4e-aaa1-b0aa37def65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:23.416937 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077f67c-c9c4-4e4e-aaa1-b0aa37def65f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0077f67c-c9c4-4e4e-aaa1-b0aa37def65f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:23.437610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:23.438612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:23.439501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:23.439501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:23.439501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:23.439501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:23.441849 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 364/727] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:23.447398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:23.600501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916abc2-530a-4440-9192-df27611af921 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:23.600853 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916abc2-530a-4440-9192-df27611af921 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:23.601025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916abc2-530a-4440-9192-df27611af921 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:23.602346 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 365/728] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:03:23.611104 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284cf8-41be-4ce3-b22d-05ec118dfb98 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:23.611381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284cf8-41be-4ce3-b22d-05ec118dfb98 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:23.611657 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40284cf8-41be-4ce3-b22d-05ec118dfb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:23.618158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce139e-0c92-45a6-998e-ae6edc347bcd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:23.643970 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-40284cf8-41be-4ce3-b22d-05ec118dfb98 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:23.645165 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-40284cf8-41be-4ce3-b22d-05ec118dfb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:23.659902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:23.660580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:23.660864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:23.661138 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:23.661867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:23.662183 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:23.663568 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:23.687251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 364/729] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:23.696755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:23.758443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 366/730] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:03:23.802427 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40284cf8-41be-4ce3-b22d-05ec118dfb98 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:23.851793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9966a-3763-4992-b900-a727988c5c2b None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:23.896521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:23.897685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:23.898164 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:23.898650 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:23.913787 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:23.916153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:23.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:23.946793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:23.947758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:23.955567 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 365/731] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:23.961719 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:23.979880 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40284cf8-41be-4ce3-b22d-05ec118dfb98 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:24.022478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cef29-1a2e-4a1b-9882-5b3620b75f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:24.023277 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cef29-1a2e-4a1b-9882-5b3620b75f40 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.023556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cef29-1a2e-4a1b-9882-5b3620b75f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.026778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cef29-1a2e-4a1b-9882-5b3620b75f40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.052611 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cef29-1a2e-4a1b-9882-5b3620b75f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d12cef29-1a2e-4a1b-9882-5b3620b75f40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:24.062065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:24.063020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:24.063873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:24.079906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 367/732] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:24.080254 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cef29-1a2e-4a1b-9882-5b3620b75f40 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:24.163775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc73d7-a3c5-426b-a091-781715f3b2ef None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:24.229942 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:24.230643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.230923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.231197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.232099 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:24.232414 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:24.234473 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:24.255118 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cef29-1a2e-4a1b-9882-5b3620b75f40 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:24.269639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 366/733] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:03:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:24.274792 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:24.302704 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:24.303425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.303707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.305174 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.305931 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:24.306235 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:24.308202 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:24.324052 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 368/734] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:24.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:24.476843 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2cf4b-2b03-41c3-9f4a-5684737e22c9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:24.497777 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c914b4-f2ae-455a-b77e-0999a97c8215 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:24.527013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d024cf2-5540-4f8b-8b3b-198299ff505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:24.529127 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024cf2-5540-4f8b-8b3b-198299ff505d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.529421 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024cf2-5540-4f8b-8b3b-198299ff505d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.529702 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d024cf2-5540-4f8b-8b3b-198299ff505d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.570087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:24.570938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.571214 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.571530 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.590586 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:24.592106 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:24.617675 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d024cf2-5540-4f8b-8b3b-198299ff505d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:24.619121 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d024cf2-5540-4f8b-8b3b-198299ff505d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:24.627463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:24.628372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:24.629258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:24.629258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:24.629258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:24.629258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:24.631432 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 369/735] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:24.640919 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:24.721796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 367/736] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:03:24.731873 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d024cf2-5540-4f8b-8b3b-198299ff505d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:24.863791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45bce6-7b46-494c-8fac-0cb344b5c531 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:24.863993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d024cf2-5540-4f8b-8b3b-198299ff505d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:24.909366 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f86f-e933-44fc-91ad-15e3c763932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:24.912059 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f86f-e933-44fc-91ad-15e3c763932d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.912937 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f86f-e933-44fc-91ad-15e3c763932d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.913284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f86f-e933-44fc-91ad-15e3c763932d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.936878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a69d0d-a054-483f-ad7d-ea6dac91c371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:24.937778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69d0d-a054-483f-ad7d-ea6dac91c371 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.940673 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69d0d-a054-483f-ad7d-ea6dac91c371 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.940673 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a69d0d-a054-483f-ad7d-ea6dac91c371 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.940844 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f86f-e933-44fc-91ad-15e3c763932d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:24.940940 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a69d0d-a054-483f-ad7d-ea6dac91c371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:24.940940 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a69d0d-a054-483f-ad7d-ea6dac91c371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:24.941070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f86f-e933-44fc-91ad-15e3c763932d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:24.941139 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a69d0d-a054-483f-ad7d-ea6dac91c371 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:24.954870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 370/737] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:24.956313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3ad2f-751d-42ad-ad65-5e46cd9f37ec None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.956596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3ad2f-751d-42ad-ad65-5e46cd9f37ec None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.956868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3ad2f-751d-42ad-ad65-5e46cd9f37ec None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.958280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 371/738] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:24.960308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3ad2f-751d-42ad-ad65-5e46cd9f37ec None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-e495f86f-e933-44fc-91ad-15e3c763932d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:24.966916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:24.967931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:24.968834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:24.968834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:24.968834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:24.968834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:24.971525 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 368/739] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:24.973428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83cee-b1eb-4bf3-9ef2-ad0df7f111e5 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:24.974226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83cee-b1eb-4bf3-9ef2-ad0df7f111e5 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:24.974719 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece83cee-b1eb-4bf3-9ef2-ad0df7f111e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:24.995906 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-ece83cee-b1eb-4bf3-9ef2-ad0df7f111e5 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:24.997715 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-ece83cee-b1eb-4bf3-9ef2-ad0df7f111e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:25.100728 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 369/740] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:03:25.102271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece83cee-b1eb-4bf3-9ef2-ad0df7f111e5 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:25.172343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3ad2f-751d-42ad-ad65-5e46cd9f37ec None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:25.223082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece83cee-b1eb-4bf3-9ef2-ad0df7f111e5 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:25.240358 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:25.241185 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.241464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.241736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.250712 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:25.252174 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:25.272475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:25.273698 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.274176 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.274640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.275627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:25.276179 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:25.277760 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:25.290404 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 370/741] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:25.291506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:25.294062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:25.295031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:25.296624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:25.303680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 372/742] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:03:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:25.304600 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:25.408080 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872cd3c-47c1-4467-96cf-10984f3d2504 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:25.459644 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2d89c-2e3a-4bb8-8fc3-feef8a4fb78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:25.460358 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2d89c-2e3a-4bb8-8fc3-feef8a4fb78e None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.460636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2d89c-2e3a-4bb8-8fc3-feef8a4fb78e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.460907 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2d89c-2e3a-4bb8-8fc3-feef8a4fb78e None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.461631 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2d89c-2e3a-4bb8-8fc3-feef8a4fb78e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:25.462993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2d89c-2e3a-4bb8-8fc3-feef8a4fb78e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:25.479795 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 371/743] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:03:25 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:25.480623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2d89c-2e3a-4bb8-8fc3-feef8a4fb78e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:25.496481 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89179d4-4555-4262-9c37-063e77e4e8e5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:25.566221 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b18ff-abcd-411f-8419-fc72c580db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:25.567126 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b18ff-abcd-411f-8419-fc72c580db08 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.567958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b18ff-abcd-411f-8419-fc72c580db08 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.568281 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b18ff-abcd-411f-8419-fc72c580db08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.582751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b18ff-abcd-411f-8419-fc72c580db08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:25.585134 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b18ff-abcd-411f-8419-fc72c580db08 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:25.602421 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2d89c-2e3a-4bb8-8fc3-feef8a4fb78e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-766b18ff-abcd-411f-8419-fc72c580db08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:25.606397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:25.607413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:25.609570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:25.609570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:25.609570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:25.609570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:25.609570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:25.609570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:25.609570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:25.609570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:25.613288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 373/744] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:25.615620 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5cce-3910-47c2-b19a-4968e3b91145 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.616193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5cce-3910-47c2-b19a-4968e3b91145 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.616834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5cce-3910-47c2-b19a-4968e3b91145 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.619502 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 374/745] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:25.620802 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5cce-3910-47c2-b19a-4968e3b91145 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:25.640410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386f013-5e56-47e0-b766-bccb651c2f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:25.641097 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f013-5e56-47e0-b766-bccb651c2f40 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.641374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f013-5e56-47e0-b766-bccb651c2f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.641649 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386f013-5e56-47e0-b766-bccb651c2f40 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.642504 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386f013-5e56-47e0-b766-bccb651c2f40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:25.642816 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386f013-5e56-47e0-b766-bccb651c2f40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:25.644422 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386f013-5e56-47e0-b766-bccb651c2f40 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:25.670790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 372/746] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:03:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:25.672448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c152b2-90a7-4fad-bce5-788a09937136 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.672749 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c152b2-90a7-4fad-bce5-788a09937136 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.673032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c152b2-90a7-4fad-bce5-788a09937136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.692132 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-74c152b2-90a7-4fad-bce5-788a09937136 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:25.693612 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-74c152b2-90a7-4fad-bce5-788a09937136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:25.761147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5cce-3910-47c2-b19a-4968e3b91145 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:25.770763 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 373/747] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:25.771871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c152b2-90a7-4fad-bce5-788a09937136 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:25.803085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:25.803939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.804349 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.804463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.805674 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:25.806288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:25.807784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:25.824391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 375/748] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:25.825339 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:25.880520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c152b2-90a7-4fad-bce5-788a09937136 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:25.919673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa201fc3-4317-4df1-97c0-10679a201d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:25.920923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201fc3-4317-4df1-97c0-10679a201d37 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.921637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201fc3-4317-4df1-97c0-10679a201d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.921637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201fc3-4317-4df1-97c0-10679a201d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.943610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97b12-f543-4b13-8b72-483d3c62ac9d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:25.985679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:25.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:25.987873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:25.988633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:25.989204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa201fc3-4317-4df1-97c0-10679a201d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:25.989678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:25.990650 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa201fc3-4317-4df1-97c0-10679a201d37 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:25.991401 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:26.010372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:26.011398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:26.012306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:26.018219 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 376/749] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:03:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:26.019088 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.088478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 374/750] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:03:26.090012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6889da-a75e-4adb-816c-7a0569723ed4 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.090454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6889da-a75e-4adb-816c-7a0569723ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.090733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6889da-a75e-4adb-816c-7a0569723ed4 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.095963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 375/751] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:26.095963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6889da-a75e-4adb-816c-7a0569723ed4 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.136301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fb668-2d61-4f7a-8afc-f2fb1ebf3a73 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.168426 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.169126 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.169403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.169673 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.171338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=56dd93adf7bc4781b6af5b40e4bc6c6b) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:26.171671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:26.173117 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.178295 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 377/752] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/role_assignments?user.id=56dd93adf7bc4781b6af5b40e4bc6c6b&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=67227061f74f48f293a12155e904b5fc => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:26.179061 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.213814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6889da-a75e-4adb-816c-7a0569723ed4 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.262699 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dc0a8-7034-41b0-908a-a0cce24d3828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.264949 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dc0a8-7034-41b0-908a-a0cce24d3828 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.265709 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dc0a8-7034-41b0-908a-a0cce24d3828 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.266140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dc0a8-7034-41b0-908a-a0cce24d3828 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.267030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dc0a8-7034-41b0-908a-a0cce24d3828 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:26.267645 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dc0a8-7034-41b0-908a-a0cce24d3828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:26.270006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2dc0a8-7034-41b0-908a-a0cce24d3828 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.276846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 376/753] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:26.278665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0649-6f1a-4d79-9279-6337b6b687a2 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.279107 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0649-6f1a-4d79-9279-6337b6b687a2 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.280480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0649-6f1a-4d79-9279-6337b6b687a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.289495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089f209-757a-4fe9-972c-0e0b0f070f1c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.303645 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-98fe0649-6f1a-4d79-9279-6337b6b687a2 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:26.306042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-98fe0649-6f1a-4d79-9279-6337b6b687a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:26.325738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.327664 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.328100 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.328553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.345759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:26.348035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:26.371804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:26.372963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:26.374105 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:26.374105 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:26.374105 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:26.374105 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:26.376530 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 378/754] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:26.377561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.393931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 377/755] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:26.400065 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe0649-6f1a-4d79-9279-6337b6b687a2 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.515632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea19e8b-42a6-4a8e-aedf-ad1a226a5133 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.526394 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe0649-6f1a-4d79-9279-6337b6b687a2 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.556738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.558206 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.558705 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.559411 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.560456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:26.560963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:26.564003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.567414 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.568359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.568743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.569120 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.570064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:26.570407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:26.570660 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 379/756] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:26.571962 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.572078 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.587851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 378/757] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:26.588929 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.691075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d68449-f507-4e52-a140-9d5b3b3a19cd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.712844 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658206-9b6f-43f5-abec-6fd964ed3525 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.726561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb696-a102-45b8-bbc1-2bc4ac764bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.727582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb696-a102-45b8-bbc1-2bc4ac764bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.728058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb696-a102-45b8-bbc1-2bc4ac764bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.728516 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb696-a102-45b8-bbc1-2bc4ac764bf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.740035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bb696-a102-45b8-bbc1-2bc4ac764bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:26.747847 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f37bb696-a102-45b8-bbc1-2bc4ac764bf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:26.748669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:26.749779 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:26.750820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:26.751662 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.752058 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.752426 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.753391 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] RBAC: Adding query filter params (interface=public, service_id=e45080e817e84dcbbef15ee826e85597, region_id=RegionOne) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:26.758054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:26.758054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.758571 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 380/758] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:26.759584 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb696-a102-45b8-bbc1-2bc4ac764bf5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.763682 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 379/759] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/endpoints?service_id=e45080e817e84dcbbef15ee826e85597&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:26.765444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.863175 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb696-a102-45b8-bbc1-2bc4ac764bf5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.888911 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae093f-cd4e-4cc1-8032-5be076fa5b31 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:26.899384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.900501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.901008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.901490 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.909747 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:26.911402 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.923931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:26.924684 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:26.925027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:26.925365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:26.926170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:26.926585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:26.928025 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:26.928515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:26.929389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:26.930300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:26.930300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:26.930300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:26.930300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:26.930300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:26.930300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:26.930300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:26.930300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:26.933006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 381/760] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:26.933971 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:26.946579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 380/761] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:26.946579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:27.042217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33271da8-7682-4504-9779-5ea697804fe0 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:27.042683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90335-20bc-41b8-8f55-2b56c00def41 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:27.081306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:27.081715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420c512-3cf2-4f3f-a896-537776df1797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:27.082194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.082571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.083262 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420c512-3cf2-4f3f-a896-537776df1797 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.083783 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420c512-3cf2-4f3f-a896-537776df1797 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.084263 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420c512-3cf2-4f3f-a896-537776df1797 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.085222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420c512-3cf2-4f3f-a896-537776df1797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:27.085770 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.086584 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:27.086894 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:27.088356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:27.089789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420c512-3cf2-4f3f-a896-537776df1797 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:27.095860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 382/762] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:27.096906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420c512-3cf2-4f3f-a896-537776df1797 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:27.106692 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 381/763] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:27.107917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:27.208713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420c512-3cf2-4f3f-a896-537776df1797 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:27.266369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:27.267180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.267458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.267727 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.289267 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:27.290760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:27.323041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53191f6-0cb4-4276-b220-9b01f4f40e74 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:27.323860 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:27.324742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:27.325639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:27.325639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:27.325639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:27.325639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:27.325639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 383/764] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:27.332442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:27.375155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:27.376319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.376611 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.377146 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.377990 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=aa3419c2ac434daabea2cccd301002c7) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:27.378454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:27.380530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:27.394172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 382/765] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:27 2022] GET /identity/v3/role_assignments?user.id=aa3419c2ac434daabea2cccd301002c7&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:27.461620 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69079c-0840-4bf6-9f3e-51dd15504fc6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:27.501563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:27.502300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.502588 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.502862 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.503602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:27.503938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:27.505373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:27.519068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 384/766] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:27.524779 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:27.691002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de553f-7e71-49a0-8945-f88b6262cf9d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:27.729021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd7ba1-27e0-49db-9779-d8b21d2db240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:27.729741 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd7ba1-27e0-49db-9779-d8b21d2db240 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.730018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd7ba1-27e0-49db-9779-d8b21d2db240 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.730289 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd7ba1-27e0-49db-9779-d8b21d2db240 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.739337 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd7ba1-27e0-49db-9779-d8b21d2db240 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:27.740811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd7ba1-27e0-49db-9779-d8b21d2db240 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-dddd7ba1-27e0-49db-9779-d8b21d2db240 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:27.755737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:27.757733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:27.758925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 383/767] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:03:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:27.766211 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:27.908245 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b3692-c7ce-4a3f-bfc4-7165eb1864c0 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.908589 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b3692-c7ce-4a3f-bfc4-7165eb1864c0 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.908796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b3692-c7ce-4a3f-bfc4-7165eb1864c0 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.910374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 384/768] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:03:27.915304 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa8cfc-7700-4c4e-bd81-c8472feadf00 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.915580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa8cfc-7700-4c4e-bd81-c8472feadf00 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.915892 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa8cfc-7700-4c4e-bd81-c8472feadf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.919010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a8661-d2bc-4338-a264-c1422a3bfe55 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:27.934030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-adfa8cfc-7700-4c4e-bd81-c8472feadf00 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:27.935536 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-adfa8cfc-7700-4c4e-bd81-c8472feadf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:27.981423 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:27.982149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:27.982486 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:27.983354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:27.984928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:27.985240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:27.986664 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:28.008852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 385/769] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:03:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:28.018905 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.033197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 385/770] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:28.067877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa8cfc-7700-4c4e-bd81-c8472feadf00 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.189506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa655-a96c-49d5-955a-ad50703e8667 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:28.246749 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:28.247468 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.247744 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.248037 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.261835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:28.263292 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:28.266947 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa8cfc-7700-4c4e-bd81-c8472feadf00 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:28.286942 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:28.287968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:28.288892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:28.288892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:28.288892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:28.288892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:28.288892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 386/771] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:28.295403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.327653 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:28.329774 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.330054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.330329 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] PATH_INFO: `/v3/services/network` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.332596 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:28.333971 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:28.359620 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:28.362116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:28.364336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 386/772] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/services/network => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:28.371802 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.478584 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0153f6-ffaf-4db7-b44c-9cbbe5cb7ed4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:28.509352 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381727c-4c66-4114-86ae-ba110d110679 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:28.549856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:28.550829 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.551246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.551648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.552772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] RBAC: Adding query filter params (name=network) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:28.553229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:28.555375 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:28.560055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:28.561557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.561973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.562373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.563476 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:28.563962 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:28.566521 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:28.571262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 387/773] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:28.588652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.591809 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 387/774] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:28.597835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.696023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cc70c-4dd8-4be2-80bc-35e01938c01e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:28.703272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ad02d-eefc-4840-8d22-e8fe46caf963 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:28.732053 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c938a6-e32e-44ce-9710-e01278de0d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:28.733518 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c938a6-e32e-44ce-9710-e01278de0d30 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.734023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c938a6-e32e-44ce-9710-e01278de0d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.734483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c938a6-e32e-44ce-9710-e01278de0d30 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.735371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c938a6-e32e-44ce-9710-e01278de0d30 None admin] RBAC: Adding query filter params (type=network) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:28.735616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c938a6-e32e-44ce-9710-e01278de0d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:28.736653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24eb14-e4c1-4c7e-8133-c67a41cb70c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:28.737142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c938a6-e32e-44ce-9710-e01278de0d30 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:28.737572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24eb14-e4c1-4c7e-8133-c67a41cb70c5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.737914 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24eb14-e4c1-4c7e-8133-c67a41cb70c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.738253 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24eb14-e4c1-4c7e-8133-c67a41cb70c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.743323 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 388/775] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:28.744648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afec71-e086-419b-8714-b39ab7bced1d None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.744937 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afec71-e086-419b-8714-b39ab7bced1d None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.745214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afec71-e086-419b-8714-b39ab7bced1d None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.751614 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 389/776] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:28.752602 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afec71-e086-419b-8714-b39ab7bced1d None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.752832 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24eb14-e4c1-4c7e-8133-c67a41cb70c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:28.754460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24eb14-e4c1-4c7e-8133-c67a41cb70c5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9c24eb14-e4c1-4c7e-8133-c67a41cb70c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:28.770084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:28.772541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 388/777] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153d86-7cd5-407b-ae5d-ee0743473c10 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.774764 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153d86-7cd5-407b-ae5d-ee0743473c10 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.775891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb153d86-7cd5-407b-ae5d-ee0743473c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.790577 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-cb153d86-7cd5-407b-ae5d-ee0743473c10 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:28.791885 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cb153d86-7cd5-407b-ae5d-ee0743473c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:28.865389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 389/778] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:28.866370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb153d86-7cd5-407b-ae5d-ee0743473c10 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.892688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afec71-e086-419b-8714-b39ab7bced1d None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:28.936475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:28.937508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:28.938359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:28.938359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:28.939870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] RBAC: Adding query filter params (interface=public, service_id=1840fcfe71904e21a189dfbe91523ae3, region_id=RegionOne) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:28.939870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:28.941581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:28.947092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 390/779] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/endpoints?service_id=1840fcfe71904e21a189dfbe91523ae3&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:28.952055 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:28.984321 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb153d86-7cd5-407b-ae5d-ee0743473c10 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:29.028190 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:29.029155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.029444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.029863 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.030725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:29.031038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:29.032798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:29.053687 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 390/780] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:29.053687 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:29.073278 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92855e-ac3b-413c-af53-a1050d52bf5d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:29.126137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367821c-1f47-4bff-b21d-d0976268d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:29.127397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367821c-1f47-4bff-b21d-d0976268d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.127852 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367821c-1f47-4bff-b21d-d0976268d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.128254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367821c-1f47-4bff-b21d-d0976268d7e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.142043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367821c-1f47-4bff-b21d-d0976268d7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-6367821c-1f47-4bff-b21d-d0976268d7e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:29.152314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:29.153282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:29.154150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 391/781] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:29.156013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367821c-1f47-4bff-b21d-d0976268d7e9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:29.165033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77017ad-1db2-45f2-99f2-33066a29bc71 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:29.209601 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad43ecc-908e-4196-8d6f-e8df5eb97076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:29.210282 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad43ecc-908e-4196-8d6f-e8df5eb97076 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.210566 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad43ecc-908e-4196-8d6f-e8df5eb97076 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.210843 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad43ecc-908e-4196-8d6f-e8df5eb97076 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.211539 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad43ecc-908e-4196-8d6f-e8df5eb97076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:29.212977 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad43ecc-908e-4196-8d6f-e8df5eb97076 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:29.220201 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 391/782] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:03:29 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:29.221089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad43ecc-908e-4196-8d6f-e8df5eb97076 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:29.334513 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad43ecc-908e-4196-8d6f-e8df5eb97076 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:29.377313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:29.377994 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.378276 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.378550 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.379306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:29.379615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:29.381273 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:29.398646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 392/783] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:29.400241 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:29.516078 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde6d16-9c11-4f5d-b3d0-09ec9f1be4b4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:29.534307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367821c-1f47-4bff-b21d-d0976268d7e9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:29.551317 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:29.552172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.552449 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.552718 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.565446 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:29.566896 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:29.571709 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81d11f-2304-4147-abbf-80a0c568efd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:29.572640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d11f-2304-4147-abbf-80a0c568efd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.572918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d11f-2304-4147-abbf-80a0c568efd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.573192 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d11f-2304-4147-abbf-80a0c568efd8 None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/4b31cba57e024daf84c6359b7e6a81cc/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.575149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81d11f-2304-4147-abbf-80a0c568efd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=4b31cba57e024daf84c6359b7e6a81cc, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:29.576628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81d11f-2304-4147-abbf-80a0c568efd8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:29.585347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:29.586312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:29.587701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:29.587701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:29.587701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:29.587701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:29.591120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 393/784] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:29.593113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:29.596496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 392/785] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:29 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/4b31cba57e024daf84c6359b7e6a81cc/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:03:29.714439 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af9a74-3c0e-4e97-8be8-10677a9d0b62 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:29.752226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d9253-6296-403c-b22c-421c37c347a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:29.752903 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9253-6296-403c-b22c-421c37c347a4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.753185 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9253-6296-403c-b22c-421c37c347a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.753459 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d9253-6296-403c-b22c-421c37c347a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.754190 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d9253-6296-403c-b22c-421c37c347a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:29.754494 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d9253-6296-403c-b22c-421c37c347a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:29.755936 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d9253-6296-403c-b22c-421c37c347a4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:29.775165 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 394/786] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:29.777356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81d11f-2304-4147-abbf-80a0c568efd8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:29.860265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ba51-d329-415b-922d-c5492aa88da0 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.860562 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ba51-d329-415b-922d-c5492aa88da0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.860729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442ba51-d329-415b-922d-c5492aa88da0 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.862075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 395/787] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:29.867429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2eb1e-5aed-4525-bf05-22ed04dde51e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.867716 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2eb1e-5aed-4525-bf05-22ed04dde51e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.868028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2eb1e-5aed-4525-bf05-22ed04dde51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.891425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4ce2eb1e-5aed-4525-bf05-22ed04dde51e None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:29.892669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4ce2eb1e-5aed-4525-bf05-22ed04dde51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:29.931153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81d11f-2304-4147-abbf-80a0c568efd8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:29.962679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 396/788] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:29.972479 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:29.973524 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:29.973948 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:29.974361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:29.985789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2eb1e-5aed-4525-bf05-22ed04dde51e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:29.988016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:29.989641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:30.005521 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:30.006727 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:30.008015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:30.015118 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 393/789] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:30.016553 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.090567 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2eb1e-5aed-4525-bf05-22ed04dde51e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.127301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.128101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.128382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.128655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.129306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:30.130659 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:30.143547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:30.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:30.145457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 397/790] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:03:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:30.150854 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.174027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda476-e05b-4506-b133-b60b67051678 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.230981 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.232044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.232536 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.233562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.234611 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:30.235154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:30.236821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.255418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 394/791] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:30.259884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13eb5a-e089-4074-b23d-2dcecdc3a632 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.261362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.291624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.292332 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.292609 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.292879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.293776 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:30.293902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:30.295832 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.301260 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 398/792] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:30.306769 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.367666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1903214-2b76-4cf0-aff2-62d554d54af9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.402837 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa96e18-3360-4112-b0f0-d569770c741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.403950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96e18-3360-4112-b0f0-d569770c741d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.404417 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96e18-3360-4112-b0f0-d569770c741d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.405475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96e18-3360-4112-b0f0-d569770c741d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.408474 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d50911-0257-4213-a72b-d134baaabd03 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.416300 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa96e18-3360-4112-b0f0-d569770c741d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:30.418070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa96e18-3360-4112-b0f0-d569770c741d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-baa96e18-3360-4112-b0f0-d569770c741d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:30.438062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:30.439034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:30.439988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:30.439988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:30.439988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:30.439988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:30.442201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 395/793] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:30.448187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0555ed-2ba9-4e45-ba40-ac9a753401cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.448187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0555ed-2ba9-4e45-ba40-ac9a753401cd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.448187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0555ed-2ba9-4e45-ba40-ac9a753401cd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.448187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0555ed-2ba9-4e45-ba40-ac9a753401cd None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.448603 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0555ed-2ba9-4e45-ba40-ac9a753401cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:30.448603 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0555ed-2ba9-4e45-ba40-ac9a753401cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:30.448603 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0555ed-2ba9-4e45-ba40-ac9a753401cd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.449207 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb10d05-e921-4c2f-b071-357af6cdf783 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.449663 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb10d05-e921-4c2f-b071-357af6cdf783 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.450091 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb10d05-e921-4c2f-b071-357af6cdf783 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.452173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 396/794] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:30.453387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb10d05-e921-4c2f-b071-357af6cdf783 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.454613 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 399/795] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:30.460398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae6a4-1281-455c-9329-1775e90bac5e None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.460781 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae6a4-1281-455c-9329-1775e90bac5e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.461173 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae6a4-1281-455c-9329-1775e90bac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.479261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-de3ae6a4-1281-455c-9329-1775e90bac5e None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:30.480769 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-de3ae6a4-1281-455c-9329-1775e90bac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:30.549573 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 400/796] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:30.550638 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ae6a4-1281-455c-9329-1775e90bac5e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.561558 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb10d05-e921-4c2f-b071-357af6cdf783 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.596489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.597387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.597817 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.598257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.599162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:30.599648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:30.601243 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.613680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 397/797] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:30.619213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.654214 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ae6a4-1281-455c-9329-1775e90bac5e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.687845 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63197a51-606d-4168-bdac-350ad4255e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.688569 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63197a51-606d-4168-bdac-350ad4255e1b None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.688844 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63197a51-606d-4168-bdac-350ad4255e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.689110 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63197a51-606d-4168-bdac-350ad4255e1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.690148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63197a51-606d-4168-bdac-350ad4255e1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:30.691390 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63197a51-606d-4168-bdac-350ad4255e1b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.717936 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 401/798] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:03:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:30.719078 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63197a51-606d-4168-bdac-350ad4255e1b None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.750905 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1967d-ad12-49c0-8b05-32879c2ca066 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.830003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4f29-965f-4fa6-ad84-6db6b42e4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.831271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4f29-965f-4fa6-ad84-6db6b42e4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.832564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4f29-965f-4fa6-ad84-6db6b42e4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.833351 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4f29-965f-4fa6-ad84-6db6b42e4cf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.853119 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4f29-965f-4fa6-ad84-6db6b42e4cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-35ee4f29-965f-4fa6-ad84-6db6b42e4cf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:30.867805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:30.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:30.869743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:30.874057 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 398/799] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:30.875745 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4f29-965f-4fa6-ad84-6db6b42e4cf2 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:30.899471 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63197a51-606d-4168-bdac-350ad4255e1b None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:30.939295 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:30.941776 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:30.942964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:30.943478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:30.958318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:30.963449 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:30.988414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:30.989385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:30.990298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:30.990298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:30.990298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:30.990298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:30.990298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:30.990298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:30.990298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:30.990298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:30.992804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 402/800] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:30.999157 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:31.050683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4f29-965f-4fa6-ad84-6db6b42e4cf2 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:31.101551 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:31.102225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:31.102857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:31.102857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:31.103493 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:31.103819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:31.105355 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:31.114484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 399/801] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:31.116617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb5ed-99af-43ef-a37d-d5824391a4a1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:31.120953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:31.155924 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:31.156897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:31.157381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:31.157836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:31.158873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:31.159396 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:31.161063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:31.173415 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 403/802] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:31.179465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:31.244642 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff06ad-87b2-4023-9a6e-5486137d79da None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:31.288154 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fa34c-0d6b-4e03-ba78-903e9c78aae6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:31.304713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:31.306111 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:31.307983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:31.309214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:31.328879 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:31.331284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:31.349636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee04bd-c808-45be-a10a-82a94de82256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:31.350916 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee04bd-c808-45be-a10a-82a94de82256 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:31.351402 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee04bd-c808-45be-a10a-82a94de82256 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:31.351915 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee04bd-c808-45be-a10a-82a94de82256 None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/56dd93adf7bc4781b6af5b40e4bc6c6b/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:31.355038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee04bd-c808-45be-a10a-82a94de82256 None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=56dd93adf7bc4781b6af5b40e4bc6c6b, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:31.359029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee04bd-c808-45be-a10a-82a94de82256 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:31.365072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:31.365958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:31.366879 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:31.366879 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:31.366879 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:31.366879 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:31.372626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 400/803] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:31.380964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:31.387876 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 404/804] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:31 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/56dd93adf7bc4781b6af5b40e4bc6c6b/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:03:31.533286 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15724260-9365-4c02-9775-fce1c61d07dc None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:31.574956 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:31.575609 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:31.575922 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:31.576195 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:31.577873 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:31.578210 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:31.579687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:31.599883 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 401/805] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:31.605071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee04bd-c808-45be-a10a-82a94de82256 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:31.712197 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee04bd-c808-45be-a10a-82a94de82256 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:31.750707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:31.751943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:31.752567 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:31.753071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:31.768318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:31.770083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:31.789074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:31.790082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:31.791038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:31.793712 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 405/806] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:03:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:31.799721 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:31.954815 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907bac7-87fc-4d54-82cc-cfb0114d84c5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:32.022526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e852f78-d5ee-412c-9ac3-652c74d0d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:32.023211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e852f78-d5ee-412c-9ac3-652c74d0d84a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.023489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e852f78-d5ee-412c-9ac3-652c74d0d84a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.023774 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e852f78-d5ee-412c-9ac3-652c74d0d84a None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.024638 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e852f78-d5ee-412c-9ac3-652c74d0d84a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:32.024945 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e852f78-d5ee-412c-9ac3-652c74d0d84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:32.026441 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e852f78-d5ee-412c-9ac3-652c74d0d84a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:32.055800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 402/807] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:03:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:32.061412 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:32.169254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150512e7-a2cc-4fa3-bcaa-c397d864e8e3 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.169695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150512e7-a2cc-4fa3-bcaa-c397d864e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.169865 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150512e7-a2cc-4fa3-bcaa-c397d864e8e3 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.175064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 403/808] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:32.180881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c1207-8da6-4109-af62-3d4648588918 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.181166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c1207-8da6-4109-af62-3d4648588918 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.181442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c1207-8da6-4109-af62-3d4648588918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.216791 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-237c1207-8da6-4109-af62-3d4648588918 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:32.219212 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-237c1207-8da6-4109-af62-3d4648588918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:32.232035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a50ec-89d8-44b8-bfbf-d34e964f616f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:32.292976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:32.294573 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.294573 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.294573 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.323057 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:32.324496 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:32.360943 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:32.362003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:32.362909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:32.362909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:32.362909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:32.362909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:32.362909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 406/809] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:32.370492 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:32.378691 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 404/810] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:32.412506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c1207-8da6-4109-af62-3d4648588918 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:32.610602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16790d8-cacf-4d8f-8f9c-b17c385bbc75 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:32.614387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c1207-8da6-4109-af62-3d4648588918 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:32.659438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37bf08-7113-4326-9e07-c90bbdb81873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:32.660280 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bf08-7113-4326-9e07-c90bbdb81873 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.660714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bf08-7113-4326-9e07-c90bbdb81873 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.660994 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bf08-7113-4326-9e07-c90bbdb81873 None admin] PATH_INFO: `/v3/services/network` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.662037 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37bf08-7113-4326-9e07-c90bbdb81873 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:32.664338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37bf08-7113-4326-9e07-c90bbdb81873 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:32.672088 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bff7a1-034e-4cd0-bd40-b7b24f09aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:32.672826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff7a1-034e-4cd0-bd40-b7b24f09aeaa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.673196 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff7a1-034e-4cd0-bd40-b7b24f09aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.673543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff7a1-034e-4cd0-bd40-b7b24f09aeaa None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.674339 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bff7a1-034e-4cd0-bd40-b7b24f09aeaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:32.674717 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bff7a1-034e-4cd0-bd40-b7b24f09aeaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:32.676187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bff7a1-034e-4cd0-bd40-b7b24f09aeaa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-5a37bf08-7113-4326-9e07-c90bbdb81873 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:32.682853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:32.684231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:03:32.685077 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:32.688302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 405/811] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:32 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:32.690640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcc150-2ce8-4904-a2fd-d772c795f8ed None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.690640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcc150-2ce8-4904-a2fd-d772c795f8ed None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.690640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcc150-2ce8-4904-a2fd-d772c795f8ed None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.692370 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 406/812] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:32.693190 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcc150-2ce8-4904-a2fd-d772c795f8ed None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:32.701876 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 407/813] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:32.704129 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe3f8-2e39-41b0-a510-d629f3d9c1c8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.704418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe3f8-2e39-41b0-a510-d629f3d9c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.704699 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbe3f8-2e39-41b0-a510-d629f3d9c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.722624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-59fbe3f8-2e39-41b0-a510-d629f3d9c1c8 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:32.723878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-59fbe3f8-2e39-41b0-a510-d629f3d9c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:32.799147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 408/814] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:32.804380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbe3f8-2e39-41b0-a510-d629f3d9c1c8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:32.825703 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcc150-2ce8-4904-a2fd-d772c795f8ed None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:32.870236 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:32.870766 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.871045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.871321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:32.872189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] RBAC: Adding query filter params (name=network) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:32.872866 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:32.875545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:32.886116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 407/815] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:32.887070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:32.961244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbe3f8-2e39-41b0-a510-d629f3d9c1c8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:32.997289 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:32.998085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:32.998450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:32.998728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.001021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1a79b-7753-45c0-86cb-6ab6e163766f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.005891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.007299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:33.022466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:33.024751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 409/816] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:33.026330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.039583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9b514-26f5-4375-877a-4d9ff77e9352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.040557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b514-26f5-4375-877a-4d9ff77e9352 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.040940 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b514-26f5-4375-877a-4d9ff77e9352 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.041319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9b514-26f5-4375-877a-4d9ff77e9352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.052804 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9b514-26f5-4375-877a-4d9ff77e9352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-b5f9b514-26f5-4375-877a-4d9ff77e9352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:33.061526 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:33.063218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:33.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 408/817] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:33.071800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9b514-26f5-4375-877a-4d9ff77e9352 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.149621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618bafb-9e73-4dde-8148-41904c6de2e8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.189593 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.190261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.190539 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.190812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.191517 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] RBAC: Adding query filter params (type=network) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:33.191844 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.194017 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.205945 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 410/818] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:33.205945 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.210530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9b514-26f5-4375-877a-4d9ff77e9352 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.244429 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.245456 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.245939 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.246414 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.247492 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:33.248065 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.250666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.263972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 409/819] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:33.265038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.331963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dee76b-8090-4dbf-8d8d-c0768b825f7a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.375254 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.375979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.376257 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.376531 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.377080 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6efea-f928-4a02-b6e4-ec752c4bc368 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.377308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:33.377567 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.378928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.389780 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 411/820] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:33.390954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.415617 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f074401-500f-452c-a0e8-786ab2a334ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.417082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f074401-500f-452c-a0e8-786ab2a334ff None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.417567 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f074401-500f-452c-a0e8-786ab2a334ff None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.418305 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f074401-500f-452c-a0e8-786ab2a334ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.419421 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f074401-500f-452c-a0e8-786ab2a334ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.422148 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f074401-500f-452c-a0e8-786ab2a334ff None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.456455 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 410/821] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:03:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:33.458408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f074401-500f-452c-a0e8-786ab2a334ff None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.525348 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c675-623a-4682-bcf3-01098b0cbe6c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.588069 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b371c63-4741-4410-98a2-dd7cb9aa8708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.588963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371c63-4741-4410-98a2-dd7cb9aa8708 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.589237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371c63-4741-4410-98a2-dd7cb9aa8708 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.589506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371c63-4741-4410-98a2-dd7cb9aa8708 None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/aa3419c2ac434daabea2cccd301002c7/roles/24a80586c13847a5b38391521300ce84` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.602142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f074401-500f-452c-a0e8-786ab2a334ff None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.606148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371c63-4741-4410-98a2-dd7cb9aa8708 None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=aa3419c2ac434daabea2cccd301002c7, role_id=24a80586c13847a5b38391521300ce84)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.608450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371c63-4741-4410-98a2-dd7cb9aa8708 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.626563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 412/822] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:33 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/aa3419c2ac434daabea2cccd301002c7/roles/24a80586c13847a5b38391521300ce84 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:03:33.628100 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448aaaa-5ebc-4d02-aa5c-092331e98d64 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.628391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448aaaa-5ebc-4d02-aa5c-092331e98d64 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.628666 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448aaaa-5ebc-4d02-aa5c-092331e98d64 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.630440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 413/823] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:33.645186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f947-c299-4a9c-95ea-7562ba2a5e04 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.645539 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f947-c299-4a9c-95ea-7562ba2a5e04 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.645732 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41f947-c299-4a9c-95ea-7562ba2a5e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.666939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1d41f947-c299-4a9c-95ea-7562ba2a5e04 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:33.669867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.670410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1d41f947-c299-4a9c-95ea-7562ba2a5e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:33.670494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.670494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.670494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.684814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.687389 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:33.708788 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:33.709772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:33.710665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:33.710665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:33.710665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:33.710665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:33.714361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 411/824] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:33.720848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.756008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 414/825] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:33.787026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41f947-c299-4a9c-95ea-7562ba2a5e04 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.863375 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d91274-8530-4a45-91d7-dd286230eda3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.899266 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.899963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.900246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.900523 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.901252 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:33.901555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.902916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.907880 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41f947-c299-4a9c-95ea-7562ba2a5e04 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:33.915821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 412/826] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:33.921413 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:33.943462 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:33.944652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:33.945142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:33.945620 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:33.946515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:33.948103 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:33.960743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:33.961790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:33.962637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:33.965461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 415/827] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:33.971920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.033564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0092-469c-4930-8c25-031d2638f5ec None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.072669 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.073361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.073648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.073919 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.086893 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:34.088720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:34.106480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:34.108043 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:03:34.109035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:34.109572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185667f-9d14-447e-9d0e-ab87fa347157 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.116041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 413/828] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:03:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:34.117554 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.149030 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.149696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.150230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.150230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.151257 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:34.151572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:34.153277 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:34.159801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 416/829] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:34.166966 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.236657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3e8f9-245e-4bac-a795-5af583014a98 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.272272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25f375-bbc0-40a6-a94a-3e38d30c47d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.273089 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f375-bbc0-40a6-a94a-3e38d30c47d3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.273377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f375-bbc0-40a6-a94a-3e38d30c47d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.273950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25f375-bbc0-40a6-a94a-3e38d30c47d3 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.275064 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25f375-bbc0-40a6-a94a-3e38d30c47d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:34.275371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25f375-bbc0-40a6-a94a-3e38d30c47d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:34.277539 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25f375-bbc0-40a6-a94a-3e38d30c47d3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:34.279117 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a83fc-ecf0-4db4-87d5-a1e4084c89fb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.296480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 414/830] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:03:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:34.297887 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed762a6-28f3-49a0-908a-0e98843269a6 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.298177 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed762a6-28f3-49a0-908a-0e98843269a6 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.298450 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed762a6-28f3-49a0-908a-0e98843269a6 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.299856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 415/831] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:34.304705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed762a6-28f3-49a0-908a-0e98843269a6 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.319279 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229b4fb-4eaf-499e-9105-72317e6fff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.319971 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229b4fb-4eaf-499e-9105-72317e6fff8d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.320259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229b4fb-4eaf-499e-9105-72317e6fff8d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.320517 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229b4fb-4eaf-499e-9105-72317e6fff8d None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.321214 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229b4fb-4eaf-499e-9105-72317e6fff8d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:34.321518 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229b4fb-4eaf-499e-9105-72317e6fff8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:34.322862 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229b4fb-4eaf-499e-9105-72317e6fff8d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:34.336060 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 417/832] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:34.336060 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aa9ed-5c05-4742-88e6-9b86cd69c3d1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.336060 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aa9ed-5c05-4742-88e6-9b86cd69c3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.336060 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aa9ed-5c05-4742-88e6-9b86cd69c3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.348536 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-a23aa9ed-5c05-4742-88e6-9b86cd69c3d1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:34.351181 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-a23aa9ed-5c05-4742-88e6-9b86cd69c3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:34.436428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 418/833] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:34.445483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed762a6-28f3-49a0-908a-0e98843269a6 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.459838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aa9ed-5c05-4742-88e6-9b86cd69c3d1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.497087 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb4de6-7325-45b3-9660-19fd813beb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.498908 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4de6-7325-45b3-9660-19fd813beb8a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.499840 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4de6-7325-45b3-9660-19fd813beb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.500520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb4de6-7325-45b3-9660-19fd813beb8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.574889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aa9ed-5c05-4742-88e6-9b86cd69c3d1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.600914 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb4de6-7325-45b3-9660-19fd813beb8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:34.603310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb4de6-7325-45b3-9660-19fd813beb8a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:34.610305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49f0ad-733b-4cb6-a714-c65aef6840fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.611192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f0ad-733b-4cb6-a714-c65aef6840fe None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.611546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f0ad-733b-4cb6-a714-c65aef6840fe None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.611917 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49f0ad-733b-4cb6-a714-c65aef6840fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.622179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49f0ad-733b-4cb6-a714-c65aef6840fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-7d49f0ad-733b-4cb6-a714-c65aef6840fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:34.630632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:34.631813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:03:34.632889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:34.638802 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 419/834] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:34.640451 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49f0ad-733b-4cb6-a714-c65aef6840fe None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.734084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 416/835] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:03:34.735265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb4de6-7325-45b3-9660-19fd813beb8a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.757571 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49f0ad-733b-4cb6-a714-c65aef6840fe None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.793145 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.794158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.794656 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.795697 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.796786 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:34.797324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:34.798887 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:34.812108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 420/836] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:34.814528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.834528 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb4de6-7325-45b3-9660-19fd813beb8a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.870426 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.871348 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.871635 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.871989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.883136 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:34.884721 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:34.905724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:34.906678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:34.907588 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:34.907588 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:34.907588 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:34.907588 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:34.911691 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 417/837] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:34.912741 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:34.929146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87decf-f8d7-416f-b3d9-60d3990c6551 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:34.976718 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:34.978106 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:34.978392 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:34.978667 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:34.992886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:34.994958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.014712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0842ef-5005-439a-8e70-164f86c9fc80 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:35.016902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:35.017789 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:35.018714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:35.018714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:35.018714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:35.018714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:35.018714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 421/838] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:35.024662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:35.050532 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:35.051200 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:35.051482 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:35.051755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:35.052504 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:35.052810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:35.054275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.066779 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 418/839] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:35.075795 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:35.137686 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b0bc-bfd3-49d9-8810-f5ae499288eb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:35.172391 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:35.173159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:35.173339 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:35.175784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:35.175784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:35.175784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:35.176259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.181588 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925d8de-ba08-4e33-a379-5c37e71df447 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:35.188031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 422/840] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:35.197697 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:35.224075 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:35.225725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:35.226191 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:35.226771 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:35.237149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:35.238828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:35.257725 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:35.258864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:35.260101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:35.260101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:35.260101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:35.260101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:35.260101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:35.260101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:35.260101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:35.260101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:35.263008 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 419/841] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:35.270733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:35.308172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c111615-cd5f-4418-81a6-14c8bf2e2943 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:35.344735 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:35.345748 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:35.346126 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:35.346502 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:35.354071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:35.355632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.367706 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112a273-0ccc-43a0-a28a-ab001e2c1a7c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:35.372068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:35.373054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:03:35.374033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:35.378859 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 423/842] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:03:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:35.379798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:35.402108 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:35.402771 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:35.403051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:35.403326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:35.404143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:35.404972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:35.406567 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.423850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 420/843] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:35.425634 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:35.492114 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c78341-2b27-4f27-9ac7-9b1d088905f4 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:35.526712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a070d8-5c80-44b3-bce5-49da7e5de966 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:35.529067 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:35.530440 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:35.530729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:35.531008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:35.531876 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:35.532191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:35.533619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.557489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 424/844] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:03:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:35.558556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:35.562545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:35.563228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:35.563514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:35.563816 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:35.564686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=4b31cba57e024daf84c6359b7e6a81cc) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:35.565000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:35.566492 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.579948 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 421/845] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:35 2022] GET /identity/v3/role_assignments?user.id=4b31cba57e024daf84c6359b7e6a81cc&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=67227061f74f48f293a12155e904b5fc => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:35.674623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a5a94-5c20-447e-9670-1b727ffa8610 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:35.719449 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85593624-e12f-423d-98d8-88e0e0b382fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:35.720165 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593624-e12f-423d-98d8-88e0e0b382fb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:35.720449 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593624-e12f-423d-98d8-88e0e0b382fb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:35.720727 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593624-e12f-423d-98d8-88e0e0b382fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:35.791793 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593624-e12f-423d-98d8-88e0e0b382fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:35.793167 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85593624-e12f-423d-98d8-88e0e0b382fb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:35.897703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 425/846] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:03:35.902982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.004767 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf9f65-cc90-4e88-a57b-35d96c571e52 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.039511 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b2ce-ce51-4a97-a455-c5bc7cb25b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.040336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b2ce-ce51-4a97-a455-c5bc7cb25b25 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.040617 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b2ce-ce51-4a97-a455-c5bc7cb25b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.040890 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b2ce-ce51-4a97-a455-c5bc7cb25b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.052844 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b2ce-ce51-4a97-a455-c5bc7cb25b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:36.054226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b2ce-ce51-4a97-a455-c5bc7cb25b25 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:36.071266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090f14-569c-4d2c-bdee-7c4df601cd11 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.071266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090f14-569c-4d2c-bdee-7c4df601cd11 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.071266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090f14-569c-4d2c-bdee-7c4df601cd11 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-e600b2ce-ce51-4a97-a455-c5bc7cb25b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:36.071859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:36.074984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:36.077913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:36.077913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:36.077913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:36.077913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:36.077913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 422/847] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:36.078272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 426/848] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:03:36.086093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d34e2-d4db-42f4-b941-c7456e2bae55 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.086093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d34e2-d4db-42f4-b941-c7456e2bae55 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.086093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d34e2-d4db-42f4-b941-c7456e2bae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.089113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090f14-569c-4d2c-bdee-7c4df601cd11 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.103456 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-085d34e2-d4db-42f4-b941-c7456e2bae55 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:36.104888 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-085d34e2-d4db-42f4-b941-c7456e2bae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:36.183867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 423/849] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:36.204020 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d34e2-d4db-42f4-b941-c7456e2bae55 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.210642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090f14-569c-4d2c-bdee-7c4df601cd11 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.247420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.249038 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.249555 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.250032 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.250963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:36.251472 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:36.253066 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:36.265378 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 427/850] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:36.270308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.309032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d34e2-d4db-42f4-b941-c7456e2bae55 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.356515 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f6257-dd4f-4a11-b1d2-39ef130ab405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.358421 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6257-dd4f-4a11-b1d2-39ef130ab405 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.358720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6257-dd4f-4a11-b1d2-39ef130ab405 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.358995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6257-dd4f-4a11-b1d2-39ef130ab405 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.371996 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f6257-dd4f-4a11-b1d2-39ef130ab405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-be3f6257-dd4f-4a11-b1d2-39ef130ab405 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:36.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:36.383430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:36.384307 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 424/851] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:36.385660 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa413190-437f-4fe3-a902-ba3bf7edcaa3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.392755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f6257-dd4f-4a11-b1d2-39ef130ab405 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.425543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753337-f036-4983-b64f-525dcd097742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.426719 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753337-f036-4983-b64f-525dcd097742 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.427219 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753337-f036-4983-b64f-525dcd097742 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.427687 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753337-f036-4983-b64f-525dcd097742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.435054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49753337-f036-4983-b64f-525dcd097742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:36.437646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49753337-f036-4983-b64f-525dcd097742 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-49753337-f036-4983-b64f-525dcd097742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:36.453015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:36.453983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:36.454873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:36.454873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:36.454873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:36.454873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:36.454873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:36.454873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:36.454873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:36.454873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:36.461810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 428/852] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:36.462947 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753337-f036-4983-b64f-525dcd097742 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.495019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f6257-dd4f-4a11-b1d2-39ef130ab405 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.531847 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.532602 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.532875 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.533111 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.533844 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:36.534214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:36.535676 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:36.550709 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 425/853] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:36.552269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.590343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753337-f036-4983-b64f-525dcd097742 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.626015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.626969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.627423 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.627922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.628877 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:36.629374 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:36.630959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:36.648593 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 429/854] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:36.649815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.661032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750a82a-a1ab-45c1-b620-5a9fe2c0b5ab None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.696718 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.697646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.697980 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.698325 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.710646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:36.712180 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:36.730651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:36.731603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:36.733277 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:36.733277 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:36.733277 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:36.733277 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:36.737444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 426/855] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:36.738692 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.758175 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542641cf-2b97-44a5-a1cd-af756d406db2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.790979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39388dc3-5da1-4251-9e60-7b3e3e886ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.791623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388dc3-5da1-4251-9e60-7b3e3e886ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.791927 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388dc3-5da1-4251-9e60-7b3e3e886ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.792209 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388dc3-5da1-4251-9e60-7b3e3e886ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.793180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388dc3-5da1-4251-9e60-7b3e3e886ef2 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=56dd93adf7bc4781b6af5b40e4bc6c6b) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:36.793486 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388dc3-5da1-4251-9e60-7b3e3e886ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:36.795518 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388dc3-5da1-4251-9e60-7b3e3e886ef2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:36.806379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 430/856] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/role_assignments?user.id=56dd93adf7bc4781b6af5b40e4bc6c6b&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=67227061f74f48f293a12155e904b5fc => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:36.806379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ebd6-bddb-4438-9f33-d72275f89cd3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.806379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ebd6-bddb-4438-9f33-d72275f89cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.806379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ebd6-bddb-4438-9f33-d72275f89cd3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.806379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 431/857] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:36.810896 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ba7a-f99f-4051-ac9a-afc58e6f66c4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.811177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ba7a-f99f-4051-ac9a-afc58e6f66c4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.811454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ba7a-f99f-4051-ac9a-afc58e6f66c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.829743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-daa9ba7a-f99f-4051-ac9a-afc58e6f66c4 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:36.830955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-daa9ba7a-f99f-4051-ac9a-afc58e6f66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:36.879143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4196f46-f9b7-4869-aa61-a9b9f92483e8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:36.915852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 432/858] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:36.931004 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:36.931834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:36.935830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:36.935830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:36.935830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:36.935830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:36.935830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:36.939397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ba7a-f99f-4051-ac9a-afc58e6f66c4 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:36.955545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 427/859] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:36.961131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:37.059406 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ba7a-f99f-4051-ac9a-afc58e6f66c4 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:37.095511 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470116fa-ea8c-427f-b723-fbfdfbd12e00 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:37.113756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e550-4ae6-42a1-84c1-32b916b9acdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:37.114694 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e550-4ae6-42a1-84c1-32b916b9acdb None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:37.114972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e550-4ae6-42a1-84c1-32b916b9acdb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:37.115243 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e550-4ae6-42a1-84c1-32b916b9acdb None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:37.116014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e550-4ae6-42a1-84c1-32b916b9acdb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:37.117827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e550-4ae6-42a1-84c1-32b916b9acdb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:37.134268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:37.135157 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:37.135640 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 433/860] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:03:36 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:37.135800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:37.136128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:37.148026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:37.149567 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:37.167027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:37.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:37.169032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 428/861] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:03:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:37.176194 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e550-4ae6-42a1-84c1-32b916b9acdb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:37.291742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e550-4ae6-42a1-84c1-32b916b9acdb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:37.333806 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:37.334480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:37.334754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:37.335024 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:37.335905 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:37.336210 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:37.337837 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:37.359621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 434/862] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:03:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:37.366525 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:37.477520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e2ec7-433a-4af4-8974-de67818e1773 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:37.512895 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f3072-f54b-40c8-8516-fc9daef23943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:37.514186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3072-f54b-40c8-8516-fc9daef23943 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:37.514728 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3072-f54b-40c8-8516-fc9daef23943 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:37.515200 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f3072-f54b-40c8-8516-fc9daef23943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:37.584143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f3072-f54b-40c8-8516-fc9daef23943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:37.585968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f3072-f54b-40c8-8516-fc9daef23943 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:37.688724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 429/863] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:37 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:03:37.694617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:37.809424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1973f31-bcf5-45ad-ae14-2977afb427aa None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:37.852157 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7cf52-083f-417a-a844-73746678e9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:37.852958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cf52-083f-417a-a844-73746678e9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:37.853240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cf52-083f-417a-a844-73746678e9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:37.853514 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7cf52-083f-417a-a844-73746678e9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:37.864583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7cf52-083f-417a-a844-73746678e9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:37.866032 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7cf52-083f-417a-a844-73746678e9e0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-20f7cf52-083f-417a-a844-73746678e9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:37.883803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:37.884822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:37.885827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:37.885827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:37.885827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:37.885827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:37.885827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 435/864] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:37.893287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f3072-f54b-40c8-8516-fc9daef23943 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:37.997019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f3072-f54b-40c8-8516-fc9daef23943 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:38.007627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161a8a3-81f7-4f09-b90a-9864c709d740 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.007627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161a8a3-81f7-4f09-b90a-9864c709d740 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.007938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161a8a3-81f7-4f09-b90a-9864c709d740 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.009536 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 436/865] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:38.015651 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84866-fefa-45e3-8770-1ab1cc406667 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.015976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84866-fefa-45e3-8770-1ab1cc406667 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.016259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c84866-fefa-45e3-8770-1ab1cc406667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.033891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-67c84866-fefa-45e3-8770-1ab1cc406667 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:38.035071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-67c84866-fefa-45e3-8770-1ab1cc406667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:38.039848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:38.040777 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.041274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.041757 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.042694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:38.043010 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:38.044411 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:38.057095 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 430/866] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:38.063281 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:38.115805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 437/867] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:38.141661 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c84866-fefa-45e3-8770-1ab1cc406667 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:38.194421 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959da4a-faab-4687-a016-f3eeec574c6f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:38.229033 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:38.229849 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.230127 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.230398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.237226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:38.238654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:38.253315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:38.254274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:38.255194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:38.255194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:38.255194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:38.255194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:38.255194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:38.255194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:38.255194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:38.255194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:38.259377 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 431/868] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:38.260295 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:38.262934 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c84866-fefa-45e3-8770-1ab1cc406667 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:38.297878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:38.299481 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.300007 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.300498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.301374 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:38.302950 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:38.315811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:38.316835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:38.317706 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:38.325201 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 438/869] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:03:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:38.327164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:38.362808 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af6927-827b-422e-8a1b-d31feb031f48 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:38.411114 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:38.411879 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.412182 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.412486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.413259 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:38.413569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:38.414983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:38.428857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 432/870] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:38.432997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37a67d-bd08-4a07-ba09-ca17aa19fb91 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:38.434502 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:38.468511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:38.469551 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.470060 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.470543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.471438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:38.471980 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:38.473570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:38.483655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 439/871] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:38.484827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:38.536370 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eecef-ca47-410c-b5ef-8b17851155ef None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:38.571056 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b7095-07b5-48d5-83a5-4e4ab9eba2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:38.571634 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b7095-07b5-48d5-83a5-4e4ab9eba2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.571944 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b7095-07b5-48d5-83a5-4e4ab9eba2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.572217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b7095-07b5-48d5-83a5-4e4ab9eba2b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.573034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b7095-07b5-48d5-83a5-4e4ab9eba2b2 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=aa3419c2ac434daabea2cccd301002c7) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:38.573332 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b7095-07b5-48d5-83a5-4e4ab9eba2b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:38.574740 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b7095-07b5-48d5-83a5-4e4ab9eba2b2 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:38.581332 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 433/872] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:38 2022] GET /identity/v3/role_assignments?user.id=aa3419c2ac434daabea2cccd301002c7&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:38.588720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223196cd-1e82-43ae-b175-41ec9c4a0fa8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:38.634192 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14609a-15d3-4541-b956-530a5f078e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:38.634874 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14609a-15d3-4541-b956-530a5f078e00 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:38.635190 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14609a-15d3-4541-b956-530a5f078e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:38.635473 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14609a-15d3-4541-b956-530a5f078e00 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:38.636212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14609a-15d3-4541-b956-530a5f078e00 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:38.636515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14609a-15d3-4541-b956-530a5f078e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:38.637892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14609a-15d3-4541-b956-530a5f078e00 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:38.644075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 440/873] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:39.240229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfeef7-2c89-4cf7-9abb-0b795fbc9abd None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:39.240750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfeef7-2c89-4cf7-9abb-0b795fbc9abd None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:39.240750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfeef7-2c89-4cf7-9abb-0b795fbc9abd None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:39.242356 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 434/874] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:39.248553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3abc-0869-4f2a-b982-4ea909207d9a None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:39.249446 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3abc-0869-4f2a-b982-4ea909207d9a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:39.249737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3abc-0869-4f2a-b982-4ea909207d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:39.267001 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-911a3abc-0869-4f2a-b982-4ea909207d9a None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:39.268212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-911a3abc-0869-4f2a-b982-4ea909207d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:39.336367 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 441/875] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:39.363609 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfeef7-2c89-4cf7-9abb-0b795fbc9abd None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:39.471663 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfeef7-2c89-4cf7-9abb-0b795fbc9abd None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:39.505527 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b4aed-86cf-473b-80b4-42c290204d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:39.508076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4aed-86cf-473b-80b4-42c290204d9b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:39.508076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4aed-86cf-473b-80b4-42c290204d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:39.508076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4aed-86cf-473b-80b4-42c290204d9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:39.508076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b4aed-86cf-473b-80b4-42c290204d9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:39.508853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b4aed-86cf-473b-80b4-42c290204d9b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-ae3b4aed-86cf-473b-80b4-42c290204d9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:39.521898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:39.522968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:39.523848 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 435/876] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:39.529971 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3abc-0869-4f2a-b982-4ea909207d9a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:39.533423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503627-b798-4d7a-bc9f-ca205274e4d7 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:39.533708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503627-b798-4d7a-bc9f-ca205274e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:39.533982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503627-b798-4d7a-bc9f-ca205274e4d7 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:39.535562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 436/877] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:03:39.540667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293c93-41c1-4477-a897-982e5d156ae9 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:39.540957 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293c93-41c1-4477-a897-982e5d156ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:39.541240 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96293c93-41c1-4477-a897-982e5d156ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:39.562819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-96293c93-41c1-4477-a897-982e5d156ae9 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:39.564047 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-96293c93-41c1-4477-a897-982e5d156ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:39.640229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 437/878] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:39.653441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3abc-0869-4f2a-b982-4ea909207d9a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:39.656254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96293c93-41c1-4477-a897-982e5d156ae9 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:39.698803 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:39.700301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:39.700748 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:39.701757 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:39.703384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:39.703885 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:39.705990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:39.711937 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 442/879] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:39.719004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:39.762393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96293c93-41c1-4477-a897-982e5d156ae9 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:39.806538 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:39.807638 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:39.808118 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:39.808545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:39.809353 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:39.812045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:39.824552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:39.825870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:39.828860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:39.832158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 438/880] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:39.838864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:39.847144 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538687ed-7fcd-4a9e-9227-8dca05a54459 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:39.890318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:39.895636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:39.895636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:39.895636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:39.895636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:39.895636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:39.895636 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:39.899960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 443/881] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:39 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:39.965694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabbf24-edf8-4c73-a3ae-cbdefbc7c617 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:40.004386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:40.005477 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:40.005980 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:40.006456 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:40.007371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:40.007920 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:40.009535 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:40.016166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 439/882] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:40.027814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:40.128465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0dbcc-4172-46d5-ae22-ba0ce8f5ed9e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:40.162628 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:40.163647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:40.164169 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:40.164642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:40.165535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:40.166056 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:40.167703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:40.173483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 444/883] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:40.179410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:40.278473 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80491dda-4c1c-45e1-89e3-f574ff601dd6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:40.313332 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2f1dc-8a6f-464a-9e99-03f323bb13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:40.314266 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f1dc-8a6f-464a-9e99-03f323bb13e3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:40.314697 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f1dc-8a6f-464a-9e99-03f323bb13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:40.315131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f1dc-8a6f-464a-9e99-03f323bb13e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:40.316213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2f1dc-8a6f-464a-9e99-03f323bb13e3 None admin] RBAC: Adding query filter params (interface=public, service_id=486687724e7441d99f896b46114b3dc3, region_id=RegionOne) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:40.316694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2f1dc-8a6f-464a-9e99-03f323bb13e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:40.318207 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2f1dc-8a6f-464a-9e99-03f323bb13e3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:40.328626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 440/884] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:03:40 2022] GET /identity/v3/endpoints?service_id=486687724e7441d99f896b46114b3dc3&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:40.334111 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:40.437908 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6751060-b7c9-457e-a54b-958e93e0167f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:40.475219 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6941d0e-67bc-4742-b571-e7dc5f290956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:40.475921 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941d0e-67bc-4742-b571-e7dc5f290956 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:40.476199 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941d0e-67bc-4742-b571-e7dc5f290956 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:40.476467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6941d0e-67bc-4742-b571-e7dc5f290956 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:40.477142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6941d0e-67bc-4742-b571-e7dc5f290956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:40.478497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6941d0e-67bc-4742-b571-e7dc5f290956 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:40.485040 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 445/885] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:03:40 2022] GET /identity/v3/services => generated 1011 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:03:40.974824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43cb5-2331-4fa9-b421-98fe73fba847 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:40.975218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43cb5-2331-4fa9-b421-98fe73fba847 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:40.975395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f43cb5-2331-4fa9-b421-98fe73fba847 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:40.977557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 441/886] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:40.982734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298aad2-5d62-4d4c-b252-72a50b4c31c4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:40.983025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298aad2-5d62-4d4c-b252-72a50b4c31c4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:40.983482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298aad2-5d62-4d4c-b252-72a50b4c31c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:41.001284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-f298aad2-5d62-4d4c-b252-72a50b4c31c4 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:41.002466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-f298aad2-5d62-4d4c-b252-72a50b4c31c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:41.039461 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eb718-cf11-43e3-afe6-35e59ddcbe10 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:41.039828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eb718-cf11-43e3-afe6-35e59ddcbe10 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:41.040047 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eb718-cf11-43e3-afe6-35e59ddcbe10 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:41.041639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 442/887] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:41.047597 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516fd1-e3d0-4eb6-96c0-93a89abeebc1 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:41.047905 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516fd1-e3d0-4eb6-96c0-93a89abeebc1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:41.048185 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516fd1-e3d0-4eb6-96c0-93a89abeebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:41.065859 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-10516fd1-e3d0-4eb6-96c0-93a89abeebc1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:41.067053 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-10516fd1-e3d0-4eb6-96c0-93a89abeebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:41.080782 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 446/888] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:40 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:41.102425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298aad2-5d62-4d4c-b252-72a50b4c31c4 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:41.150263 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 443/889] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:41.174609 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10516fd1-e3d0-4eb6-96c0-93a89abeebc1 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:41.231544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298aad2-5d62-4d4c-b252-72a50b4c31c4 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:41.269726 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d441-0568-4267-96de-5bae5bf83df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:41.270398 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d441-0568-4267-96de-5bae5bf83df6 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:41.270683 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d441-0568-4267-96de-5bae5bf83df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:41.270957 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d441-0568-4267-96de-5bae5bf83df6 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:41.271677 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d441-0568-4267-96de-5bae5bf83df6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:41.273070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d441-0568-4267-96de-5bae5bf83df6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:41.280851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10516fd1-e3d0-4eb6-96c0-93a89abeebc1 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:41.289613 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 447/890] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:03:41 2022] POST /identity/v3/services => generated 269 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:03:41.328581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c9f4d-cfcf-4857-b312-f4cb5160ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:41.329782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c9f4d-cfcf-4857-b312-f4cb5160ea57 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:41.330300 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c9f4d-cfcf-4857-b312-f4cb5160ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:41.330888 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c9f4d-cfcf-4857-b312-f4cb5160ea57 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:41.344654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c9f4d-cfcf-4857-b312-f4cb5160ea57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-c06c9f4d-cfcf-4857-b312-f4cb5160ea57 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:41.353931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:41.355002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:03:41.355902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:41.363861 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 444/891] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:03:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:41.366394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d441-0568-4267-96de-5bae5bf83df6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:41.482665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d441-0568-4267-96de-5bae5bf83df6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:41.519589 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:41.520288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:41.520568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:41.520842 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:41.521586 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:41.521891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:41.523252 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:41.532684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 448/892] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:03:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:41.538156 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c9f4d-cfcf-4857-b312-f4cb5160ea57 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:41.640912 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c9f4d-cfcf-4857-b312-f4cb5160ea57 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:41.678860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:41.679664 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:41.679983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:41.680263 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:41.691234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:41.692707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:41.711000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:41.711988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:41.712918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:41.712918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:41.712918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:41.712918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:41.712918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 445/893] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:41.718302 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:41.821794 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b4f96-91cb-4ced-8cef-1632f0784165 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:41.856019 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:41.856684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:41.856962 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:41.857819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:41.858547 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:41.858831 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:41.860222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:41.872851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 449/894] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:41.878330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:41.980481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d94c1-c641-48ee-9f65-a5c2e50ce2eb None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:42.014819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373e7d5-4b5c-41f6-baa4-17cbc447ca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:42.015704 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e7d5-4b5c-41f6-baa4-17cbc447ca56 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.016021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e7d5-4b5c-41f6-baa4-17cbc447ca56 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.016296 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e7d5-4b5c-41f6-baa4-17cbc447ca56 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.025321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373e7d5-4b5c-41f6-baa4-17cbc447ca56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:42.026820 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373e7d5-4b5c-41f6-baa4-17cbc447ca56 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-2373e7d5-4b5c-41f6-baa4-17cbc447ca56 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:42.043713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:42.046630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:42.048928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 446/895] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:03:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:42.053412 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:42.154503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee027aa-1b3e-4335-9c8e-890f6b32fd37 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:42.188827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbe815-4d32-47c0-a9fa-7273db4a48a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:42.189501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbe815-4d32-47c0-a9fa-7273db4a48a0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.189778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbe815-4d32-47c0-a9fa-7273db4a48a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.190054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbe815-4d32-47c0-a9fa-7273db4a48a0 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.190884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbe815-4d32-47c0-a9fa-7273db4a48a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:42.191191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbe815-4d32-47c0-a9fa-7273db4a48a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:42.192642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbe815-4d32-47c0-a9fa-7273db4a48a0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:42.212022 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed233-8177-433c-9cb8-073bb9687817 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.212329 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed233-8177-433c-9cb8-073bb9687817 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.212562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed233-8177-433c-9cb8-073bb9687817 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.212739 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 450/896] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:03:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:42.213889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 447/897] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:42.219904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ed233-8177-433c-9cb8-073bb9687817 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:42.220570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6e5a-8351-48f2-81b7-ba60fad432b7 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.220858 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6e5a-8351-48f2-81b7-ba60fad432b7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.221135 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6e5a-8351-48f2-81b7-ba60fad432b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.238552 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7a3e6e5a-8351-48f2-81b7-ba60fad432b7 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:42.239623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7a3e6e5a-8351-48f2-81b7-ba60fad432b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:42.312054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 451/898] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:42.329909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e6e5a-8351-48f2-81b7-ba60fad432b7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:42.341596 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ed233-8177-433c-9cb8-073bb9687817 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:42.384989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcce7c-1a27-4c44-a887-7a1b40c19daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:42.386053 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcce7c-1a27-4c44-a887-7a1b40c19daa None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.386337 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcce7c-1a27-4c44-a887-7a1b40c19daa None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.386884 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcce7c-1a27-4c44-a887-7a1b40c19daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.432182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e6e5a-8351-48f2-81b7-ba60fad432b7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:42.472298 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcce7c-1a27-4c44-a887-7a1b40c19daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:42.474050 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcce7c-1a27-4c44-a887-7a1b40c19daa None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:42.474232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce17d-a02a-442c-aced-de40ad3cdf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:42.474891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce17d-a02a-442c-aced-de40ad3cdf1c None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.475215 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce17d-a02a-442c-aced-de40ad3cdf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.475601 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce17d-a02a-442c-aced-de40ad3cdf1c None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.477346 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ce17d-a02a-442c-aced-de40ad3cdf1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:42.478717 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ce17d-a02a-442c-aced-de40ad3cdf1c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:42.495729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 452/899] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:03:42 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:42.605420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 448/900] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:42 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:03:42.612453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce17d-a02a-442c-aced-de40ad3cdf1c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:42.734985 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce17d-a02a-442c-aced-de40ad3cdf1c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:42.769540 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc79d7-e3e7-497e-a76f-f76ef14f5f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:42.770357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc79d7-e3e7-497e-a76f-f76ef14f5f96 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.770634 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc79d7-e3e7-497e-a76f-f76ef14f5f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.770905 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc79d7-e3e7-497e-a76f-f76ef14f5f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.781992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc79d7-e3e7-497e-a76f-f76ef14f5f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:42.783428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc79d7-e3e7-497e-a76f-f76ef14f5f96 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-adfc79d7-e3e7-497e-a76f-f76ef14f5f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:42.800671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:42.802729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:42.804812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:42.804812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:42.804812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:42.804812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:42.804812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 453/901] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:42.807814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcce7c-1a27-4c44-a887-7a1b40c19daa None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:42.827542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80279-e505-46cb-8e13-56a6b63c7a9a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.827868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80279-e505-46cb-8e13-56a6b63c7a9a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.828115 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80279-e505-46cb-8e13-56a6b63c7a9a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.829734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 454/902] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:42.836757 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578435-52d1-4189-8d76-dab56a04cb82 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.837188 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578435-52d1-4189-8d76-dab56a04cb82 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.837621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f578435-52d1-4189-8d76-dab56a04cb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0f578435-52d1-4189-8d76-dab56a04cb82 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:42.864101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0f578435-52d1-4189-8d76-dab56a04cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:42.923730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcce7c-1a27-4c44-a887-7a1b40c19daa None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:42.935989 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 455/903] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:42.958290 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f578435-52d1-4189-8d76-dab56a04cb82 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:42.962174 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:42.962847 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:42.963127 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:42.963403 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:42.964169 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:42.964476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:42.965837 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:42.982827 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 449/904] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:42.988036 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:43.065466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f578435-52d1-4189-8d76-dab56a04cb82 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:43.091829 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75819d3d-d483-4c95-944a-52cecf6f3e68 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:43.099822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:43.100628 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.100900 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.101167 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.101810 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:43.103153 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:43.115964 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:43.117101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:43.118752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 456/905] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:43.123925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:43.135098 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:43.136229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.136716 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.137232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.145228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:43.146916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:43.162720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:43.163724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:43.164673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:43.164673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:43.164673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:43.164673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:43.164673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:43.164673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:43.164673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:43.164673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:43.167228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 450/906] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:43.173547 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:43.228958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc89d5-aa94-469c-bdfe-17901f3be4a3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:43.262811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:43.264279 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.264560 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.264830 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.265530 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:43.265833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:43.267200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:43.276868 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 457/907] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:43.277751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:43.308170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aca28-74d6-4795-bacd-4b4c7ace1772 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:43.352535 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:43.354386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.354856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.355310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.356663 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:43.357647 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:43.359744 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:43.381070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 451/908] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:43.382698 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:43.384929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6af1b-7d4b-4631-8016-cc8e5342a137 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:43.419212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:43.419989 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.420274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.420739 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.421823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:43.421936 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:43.423361 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:43.433301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 458/909] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:03:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:43.434194 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:43.514844 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46f878-45c8-4092-9f25-b1d5f06aa83d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:43.542333 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa79c-ef7e-4769-bad3-0d19dbc14c24 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:43.564041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ead84-714c-489b-9170-a7bca4b69ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:43.565555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ead84-714c-489b-9170-a7bca4b69ccc None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.566325 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ead84-714c-489b-9170-a7bca4b69ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.566872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ead84-714c-489b-9170-a7bca4b69ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.568405 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ead84-714c-489b-9170-a7bca4b69ccc None admin] RBAC: Adding query filter params (role.id=cd99d12153d2430aabc119f3f7f80c4f, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=aa3419c2ac434daabea2cccd301002c7) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:43.569174 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ead84-714c-489b-9170-a7bca4b69ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:43.571562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ead84-714c-489b-9170-a7bca4b69ccc None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:43.579126 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373f5d4-dcbc-443c-afa9-32be422073b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:43.584127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f5d4-dcbc-443c-afa9-32be422073b7 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.584127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f5d4-dcbc-443c-afa9-32be422073b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.584127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f5d4-dcbc-443c-afa9-32be422073b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.584127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373f5d4-dcbc-443c-afa9-32be422073b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:43.584127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373f5d4-dcbc-443c-afa9-32be422073b7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:43.584539 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 452/910] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:43 2022] GET /identity/v3/role_assignments?user.id=aa3419c2ac434daabea2cccd301002c7&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=cd99d12153d2430aabc119f3f7f80c4f => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:43.611298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 459/911] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:03:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:03:43.728409 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee00399-a46a-473e-8761-ee0e534a1e6e None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.728777 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee00399-a46a-473e-8761-ee0e534a1e6e None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.728982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee00399-a46a-473e-8761-ee0e534a1e6e None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.730665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 453/912] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:43.738466 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4634f-ec1a-4ec7-8cb2-9ec79b95b5c6 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:43.738786 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4634f-ec1a-4ec7-8cb2-9ec79b95b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:43.739029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4634f-ec1a-4ec7-8cb2-9ec79b95b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:43.758986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-06b4634f-ec1a-4ec7-8cb2-9ec79b95b5c6 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:43.760311 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-06b4634f-ec1a-4ec7-8cb2-9ec79b95b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:43.843994 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 460/913] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:43.866153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee00399-a46a-473e-8761-ee0e534a1e6e None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:43.974092 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee00399-a46a-473e-8761-ee0e534a1e6e None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:44.010260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:44.011432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:44.011935 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:44.012390 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:44.013364 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:44.014970 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:44.027915 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:44.029012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:44.029898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:44.035896 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 454/914] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:03:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:44.038745 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4634f-ec1a-4ec7-8cb2-9ec79b95b5c6 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:44.149117 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4634f-ec1a-4ec7-8cb2-9ec79b95b5c6 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:44.186215 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:44.186894 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:44.187179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:44.187455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:44.188182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:44.188490 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:44.189859 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:44.194826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 461/915] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:44.200564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:44.305964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f199848-c167-4567-9e26-25d750963bc8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:44.340649 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:44.342264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:44.342769 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:44.343248 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:44.344193 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:44.344733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:44.346297 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:44.355861 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 455/916] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:44.359416 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:44.461535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b3c5-b729-4d0e-837c-6a03aa3a09b5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:44.497075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cc272-6af5-4e2e-a5fa-453d336c453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:44.498842 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cc272-6af5-4e2e-a5fa-453d336c453c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:44.499495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cc272-6af5-4e2e-a5fa-453d336c453c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:44.500010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cc272-6af5-4e2e-a5fa-453d336c453c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:44.501028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cc272-6af5-4e2e-a5fa-453d336c453c None admin] RBAC: Adding query filter params (interface=public, service_id=cc60c6aac6cf4b77ac551fe290968eac, region_id=RegionOne) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:44.501548 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cc272-6af5-4e2e-a5fa-453d336c453c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:44.503109 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cc272-6af5-4e2e-a5fa-453d336c453c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:44.515865 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 462/917] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:03:44 2022] GET /identity/v3/endpoints?service_id=cc60c6aac6cf4b77ac551fe290968eac&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:44.517679 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:44.620414 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22abf5-aa4f-4273-9075-cc886bcc6713 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:44.654644 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d167e7-6e5d-4c55-a62a-383b678df78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:44.655590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d167e7-6e5d-4c55-a62a-383b678df78b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:44.656149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d167e7-6e5d-4c55-a62a-383b678df78b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:44.656628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d167e7-6e5d-4c55-a62a-383b678df78b None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:44.657506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d167e7-6e5d-4c55-a62a-383b678df78b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:44.659085 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d167e7-6e5d-4c55-a62a-383b678df78b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:44.671909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 456/918] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:03:44 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:03:44.892448 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d056b5-ca8d-4977-9cdd-e207426c5603 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:44.892940 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d056b5-ca8d-4977-9cdd-e207426c5603 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:44.892940 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d056b5-ca8d-4977-9cdd-e207426c5603 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:44.894501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 463/919] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:44.900132 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f576c-4964-4aba-8906-1dc3ce8cec38 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:44.900417 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f576c-4964-4aba-8906-1dc3ce8cec38 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:44.900814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f576c-4964-4aba-8906-1dc3ce8cec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:44.920824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-d24f576c-4964-4aba-8906-1dc3ce8cec38 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:44.922013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-d24f576c-4964-4aba-8906-1dc3ce8cec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:44.988722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 457/920] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:45.013115 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d056b5-ca8d-4977-9cdd-e207426c5603 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:45.122306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d056b5-ca8d-4977-9cdd-e207426c5603 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:45.156369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:45.157436 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:45.157891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:45.158313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:45.159103 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:45.160714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:45.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:45.173976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:45.175035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:45.177450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 464/921] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:45.183571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f576c-4964-4aba-8906-1dc3ce8cec38 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:45.285846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f576c-4964-4aba-8906-1dc3ce8cec38 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:45.319908 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:45.320585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:45.320867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:45.321142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:45.321932 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:45.322238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:45.323600 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:45.329088 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 458/922] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:45.334551 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:45.435059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d80e-9893-4dc3-b8c5-e8692197cd23 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:45.473630 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:45.474301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:45.474583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:45.474858 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:45.475566 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:45.475902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:45.477269 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:45.483520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 465/923] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:45.489275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:45.596259 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b652c32-43b6-4028-9b30-9f502c0791d1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:45.632348 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5a182-22fa-46e5-a37d-de88d21e21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:45.633392 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a182-22fa-46e5-a37d-de88d21e21c4 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:45.633876 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a182-22fa-46e5-a37d-de88d21e21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:45.634346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5a182-22fa-46e5-a37d-de88d21e21c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:45.635345 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5a182-22fa-46e5-a37d-de88d21e21c4 None admin] RBAC: Adding query filter params (interface=public, service_id=7758f583683c477fba7eb483de4ee074, region_id=RegionOne) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:45.635896 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5a182-22fa-46e5-a37d-de88d21e21c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:45.637506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5a182-22fa-46e5-a37d-de88d21e21c4 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:45.643960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 459/924] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:03:45 2022] GET /identity/v3/endpoints?service_id=7758f583683c477fba7eb483de4ee074&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:45.649760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:45.750968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae02305-1188-4263-ae4d-673ad328963d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:45.787861 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e206f-5e4d-49bc-a77a-292d0da9fde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:45.788956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e206f-5e4d-49bc-a77a-292d0da9fde7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:45.789448 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e206f-5e4d-49bc-a77a-292d0da9fde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:45.789928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e206f-5e4d-49bc-a77a-292d0da9fde7 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:45.790968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e206f-5e4d-49bc-a77a-292d0da9fde7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:45.792722 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e206f-5e4d-49bc-a77a-292d0da9fde7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:45.805216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 466/925] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:03:45 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:03:45.964576 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa294b2-f683-4fca-91d0-521d69385153 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:45.964908 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa294b2-f683-4fca-91d0-521d69385153 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:45.965148 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa294b2-f683-4fca-91d0-521d69385153 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:45.967074 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 460/926] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:45.973052 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62990e6-263e-4d1a-a072-88ccc646219f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:45.973577 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62990e6-263e-4d1a-a072-88ccc646219f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:45.973577 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62990e6-263e-4d1a-a072-88ccc646219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:45.992376 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-c62990e6-263e-4d1a-a072-88ccc646219f None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:45.993582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-c62990e6-263e-4d1a-a072-88ccc646219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:45.999509 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54898b-4603-4965-aa21-a2041392274b None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.000555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54898b-4603-4965-aa21-a2041392274b None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.000555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54898b-4603-4965-aa21-a2041392274b None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.001688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 461/927] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:46.006921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be359-8dd7-4fe4-b2e5-cdcc131d5768 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.007213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be359-8dd7-4fe4-b2e5-cdcc131d5768 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.007494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59be359-8dd7-4fe4-b2e5-cdcc131d5768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.024799 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-b59be359-8dd7-4fe4-b2e5-cdcc131d5768 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:46.025974 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-b59be359-8dd7-4fe4-b2e5-cdcc131d5768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:46.073790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 467/928] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:46.096616 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62990e6-263e-4d1a-a072-88ccc646219f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:46.117392 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 462/929] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:46.141147 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59be359-8dd7-4fe4-b2e5-cdcc131d5768 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:46.204404 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62990e6-263e-4d1a-a072-88ccc646219f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:46.239851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d0786-e0f0-4d5e-b6fa-70788afcf3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:46.240688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59be359-8dd7-4fe4-b2e5-cdcc131d5768 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:46.241264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0786-e0f0-4d5e-b6fa-70788afcf3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.241759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0786-e0f0-4d5e-b6fa-70788afcf3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.242277 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0786-e0f0-4d5e-b6fa-70788afcf3d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.253938 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d0786-e0f0-4d5e-b6fa-70788afcf3d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-6d9d0786-e0f0-4d5e-b6fa-70788afcf3d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:46.262478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:46.264198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:03:46.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:46.272422 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 468/930] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:03:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:46.273583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d0786-e0f0-4d5e-b6fa-70788afcf3d7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:46.275074 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:46.275736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.276032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.276306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.276998 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:46.279679 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:46.280658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: WARNING keystone.server.flask.common [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:03:46.298936 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.sql.core [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:03:46.298936 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:03:46.298936 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [parameters: {'id': '8d3c029feae94dc38edc2f821b871afe', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:03:46.298936 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d3c029feae94dc38edc2f821b871afe.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d3c029feae94dc38edc2f821b871afe. May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application conn.query(q) May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:03:46.308869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result.read() May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 15:03:46.309723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application next(self.gen) May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application yield resource May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application next(self.gen) May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise self.value May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application session.commit() May 09 15:03:46.311658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.session.flush() May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application compat.raise_( May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:03:46.313083 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:03:46.315232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application conn.query(q) May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result.read() May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:03:46.317476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [parameters: {'id': '8d3c029feae94dc38edc2f821b871afe', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:46.319630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:46.321639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d3c029feae94dc38edc2f821b871afe. May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 463/931] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 9 15:03:46 2022] POST /identity/v3/projects => generated 262 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:46.324917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:46.401100 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d0786-e0f0-4d5e-b6fa-70788afcf3d7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:46.439111 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:46.440164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.440692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.441173 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.442162 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:46.442702 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:46.444324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:46.451913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00760f6-e5a5-478a-82d7-dace674f2048 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:46.458529 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 469/932] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:03:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:46.459628 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:46.488862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:46.489990 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.490905 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.491407 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.499347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:46.501472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:46.518674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:46.519605 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:46.520886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:46.520886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:46.520886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:46.520886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:46.520886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:46.520886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:46.520886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:46.520886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:46.523191 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 464/933] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:46.528657 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:46.585153 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef150d-dcfa-49ee-8ec5-d722fa72f6a1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:46.631157 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:46.632472 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.632760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.633072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.644147 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d677f-2a13-4b43-acae-c21e3f43bb41 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:46.648227 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:46.649669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:46.671018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:46.672031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:46.672946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:46.672946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:46.672946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:46.672946 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:46.675832 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 470/934] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:46.677848 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:46.687629 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:46.688338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.688616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.688886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.690151 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:46.690457 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:46.692257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:46.715724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 465/935] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:46.793598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a59a-a989-4b00-90aa-b6d3ef99db04 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:46.832630 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:46.833708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:46.834197 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:46.834675 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:46.835613 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:46.836190 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:46.837879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:46.852610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 471/936] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:46.863811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:46.977144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a0142-d231-44e1-97a4-c55f8afeedd5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.015071 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4966f15-a8f8-4eea-95c7-c2d0719fbbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.015978 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966f15-a8f8-4eea-95c7-c2d0719fbbcd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.016272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966f15-a8f8-4eea-95c7-c2d0719fbbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.016529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966f15-a8f8-4eea-95c7-c2d0719fbbcd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.025773 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4966f15-a8f8-4eea-95c7-c2d0719fbbcd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.027215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4966f15-a8f8-4eea-95c7-c2d0719fbbcd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-b4966f15-a8f8-4eea-95c7-c2d0719fbbcd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:47.042891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:47.043963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:47.045811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 466/937] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:03:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:47.050632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.154731 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dbf74-1cf5-4061-aed8-21a18973fbca None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.156940 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d2366-bbbe-4ac5-99db-3842c61dd9b2 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.157438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d2366-bbbe-4ac5-99db-3842c61dd9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.157928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d2366-bbbe-4ac5-99db-3842c61dd9b2 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.159781 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 467/938] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:03:47.168728 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558720e3-df57-48ba-b09f-2d10b5c301a1 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.169017 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558720e3-df57-48ba-b09f-2d10b5c301a1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.169297 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558720e3-df57-48ba-b09f-2d10b5c301a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.186756 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-558720e3-df57-48ba-b09f-2d10b5c301a1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:47.188297 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-558720e3-df57-48ba-b09f-2d10b5c301a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:47.192002 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.192920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.193404 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.193876 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.194923 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:47.195434 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.197083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.215669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 472/939] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:03:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:47.221513 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.303800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 468/940] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:47.321496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558720e3-df57-48ba-b09f-2d10b5c301a1 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.344313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de374c-a37c-43af-b62e-908e786a8f52 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.380478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.381565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.382087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.382506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.393357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.394983 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:47.413158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:47.414308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:47.415443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:47.415443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:47.415443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:47.415443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:47.421806 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 473/941] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:47.423287 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.436747 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558720e3-df57-48ba-b09f-2d10b5c301a1 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.474342 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.475440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.475895 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.476340 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.477140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.478719 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:47.491833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:47.493460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:03:47.494549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:47.502421 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 469/942] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:03:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:47.504145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.543813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56598faa-a5c1-4369-9406-5e2fe83c9069 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.591178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.592118 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.592448 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.592878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.593883 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:47.594594 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.596170 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.610962 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddfb7b-6fe3-4f0c-95b7-ae0418cd0237 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.615932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 474/943] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:47.616947 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.647648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.648579 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.649035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.649477 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.650330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:47.650800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.652340 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.662237 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 470/944] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:47.663981 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.724637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c94b4f-78db-46b8-b2d5-d46add39d395 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.758951 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.759662 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.760090 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.760495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.768342 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.769571 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f0eba-1aa9-4a41-a712-5c207b408422 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.770055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:47.785493 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:47.786633 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:47.787790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:47.787790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:47.787790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:47.787790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:47.787790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:47.787790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:47.787790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:47.787790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:47.794167 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 475/945] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:47.795748 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.808934 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.809868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.810853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.811274 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.812154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:47.812624 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.814207 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.823880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 471/946] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:47.826105 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.900055 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95db81-212c-49e0-8b0f-b29397bb45ef None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f86cd-dc8d-4c25-8309-31eda5ea63a4 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:47.934262 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.935423 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.935836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.936352 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.937710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:47.938028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.939467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:47.956815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 476/947] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:47.957783 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:47.967372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c863e65-2e9f-4688-9245-e3a3a62e5ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:47.968552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c863e65-2e9f-4688-9245-e3a3a62e5ffb None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:47.969093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c863e65-2e9f-4688-9245-e3a3a62e5ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:47.969597 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c863e65-2e9f-4688-9245-e3a3a62e5ffb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:47.970625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c863e65-2e9f-4688-9245-e3a3a62e5ffb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:47.972419 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c863e65-2e9f-4688-9245-e3a3a62e5ffb None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:48.003992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 472/948] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:03:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:03:48.078716 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb6da4-28bd-4a30-b7f9-b3d82c4b600f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:48.120955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd60c-5622-445a-9641-2e4569ce4bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:48.121913 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd60c-5622-445a-9641-2e4569ce4bad None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:48.122200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd60c-5622-445a-9641-2e4569ce4bad None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:48.123024 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd60c-5622-445a-9641-2e4569ce4bad None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/aa3419c2ac434daabea2cccd301002c7/roles/cd99d12153d2430aabc119f3f7f80c4f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:48.125515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd60c-5622-445a-9641-2e4569ce4bad None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=aa3419c2ac434daabea2cccd301002c7, role_id=cd99d12153d2430aabc119f3f7f80c4f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:48.126978 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd60c-5622-445a-9641-2e4569ce4bad None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:48.144064 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 477/949] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:03:47 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/aa3419c2ac434daabea2cccd301002c7/roles/cd99d12153d2430aabc119f3f7f80c4f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:03:48.176052 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbdef-dc59-470a-aabb-c11c90034928 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:48.176374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbdef-dc59-470a-aabb-c11c90034928 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:48.176546 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbdef-dc59-470a-aabb-c11c90034928 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:48.178393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 473/950] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:48.184570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973168da-a7ad-46ef-a1c8-67b058800da2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:48.184892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973168da-a7ad-46ef-a1c8-67b058800da2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:48.185200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973168da-a7ad-46ef-a1c8-67b058800da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:48.204895 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-973168da-a7ad-46ef-a1c8-67b058800da2 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:48.206134 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-973168da-a7ad-46ef-a1c8-67b058800da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:48.284009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 478/951] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:48.306132 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbdef-dc59-470a-aabb-c11c90034928 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:48.413514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbdef-dc59-470a-aabb-c11c90034928 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:48.449378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:48.450444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:48.451096 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:48.451742 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:48.452841 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:48.454357 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:48.467158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:48.468438 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:48.469451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:48.471819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 474/952] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:48.480015 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973168da-a7ad-46ef-a1c8-67b058800da2 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:48.581732 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973168da-a7ad-46ef-a1c8-67b058800da2 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:48.616963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:48.617878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:48.618309 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:48.618730 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:48.619668 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:48.620147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:48.621659 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:48.627544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 479/953] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:48.632852 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:48.739950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdbf52-b1cc-4ea9-95b1-3a1e6b6262e7 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:48.774976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9acc87-3479-481d-bfd4-4ce7f0de4936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:48.775919 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9acc87-3479-481d-bfd4-4ce7f0de4936 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:48.776352 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9acc87-3479-481d-bfd4-4ce7f0de4936 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:48.776796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9acc87-3479-481d-bfd4-4ce7f0de4936 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:48.777678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9acc87-3479-481d-bfd4-4ce7f0de4936 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:48.778133 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9acc87-3479-481d-bfd4-4ce7f0de4936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:48.780223 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9acc87-3479-481d-bfd4-4ce7f0de4936 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:48.785770 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 475/954] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:48.792846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:48.893164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b147894-eaf3-47d5-9f35-97c29a2d8333 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:48.932889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9bd76-b3b2-44fd-b200-d4662ad29cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:48.933829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9bd76-b3b2-44fd-b200-d4662ad29cd9 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:48.934265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9bd76-b3b2-44fd-b200-d4662ad29cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:48.934715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9bd76-b3b2-44fd-b200-d4662ad29cd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:48.936255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9bd76-b3b2-44fd-b200-d4662ad29cd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:48.937875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9bd76-b3b2-44fd-b200-d4662ad29cd9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:48.958489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 480/955] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:03:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:49.104737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c406c6-d3de-462c-a6da-10d6025d7dd3 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:49.105578 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c406c6-d3de-462c-a6da-10d6025d7dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:49.106144 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c406c6-d3de-462c-a6da-10d6025d7dd3 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:49.109018 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 476/956] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:49.114384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e2e8-fcd0-4c72-8543-f889bf9dee20 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:49.114884 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e2e8-fcd0-4c72-8543-f889bf9dee20 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:49.114990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0e2e8-fcd0-4c72-8543-f889bf9dee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:49.133419 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-20a0e2e8-fcd0-4c72-8543-f889bf9dee20 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:49.134985 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-20a0e2e8-fcd0-4c72-8543-f889bf9dee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:49.209247 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 481/957] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:49.234068 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c406c6-d3de-462c-a6da-10d6025d7dd3 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:49.344750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c406c6-d3de-462c-a6da-10d6025d7dd3 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:49.380626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:49.381659 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:49.382151 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:49.382637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:49.383575 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:49.385256 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:49.400754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.sql.core [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:03:49.400754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:03:49.400754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [parameters: {'user_id': '97eb3d9151684787929a84eb336f9f68', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:03:49.400754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application conn.query(q) May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result.read() May 09 15:03:49.410228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:03:49.411217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application next(self.gen) May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application yield resource May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application next(self.gen) May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise self.value May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application session.commit() May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:03:49.412211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.session.flush() May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application compat.raise_( May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:03:49.413137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:03:49.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application conn.query(q) May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application result.read() May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:03:49.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [parameters: {'user_id': '97eb3d9151684787929a84eb336f9f68', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:49.419090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 15:03:49.420687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 15:03:49.421616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 15:03:49.421616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 15:03:49.421616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:03:49.421616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:03:49.421616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:03:49.421616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:49.425162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 477/958] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:03:49 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:49.431872 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e2e8-fcd0-4c72-8543-f889bf9dee20 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:49.534028 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0e2e8-fcd0-4c72-8543-f889bf9dee20 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:49.571096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bde44d-8947-4b97-9a15-8ac4562456ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:49.572369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde44d-8947-4b97-9a15-8ac4562456ac None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:49.572882 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde44d-8947-4b97-9a15-8ac4562456ac None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:49.573406 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bde44d-8947-4b97-9a15-8ac4562456ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:49.582319 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bde44d-8947-4b97-9a15-8ac4562456ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:49.584123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bde44d-8947-4b97-9a15-8ac4562456ac None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-87bde44d-8947-4b97-9a15-8ac4562456ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:49.599598 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:49.600576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:03:49.601528 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:49.605285 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 482/959] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:03:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:49.612558 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:49.709544 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e629a05-30e5-4a96-b525-8f8dcd96e4f8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:49.748215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2e48b-5bfa-47bf-bcd8-f2c31a16ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:49.753714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e48b-5bfa-47bf-bcd8-f2c31a16ab48 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:49.753714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e48b-5bfa-47bf-bcd8-f2c31a16ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:49.753714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e48b-5bfa-47bf-bcd8-f2c31a16ab48 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:49.753714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2e48b-5bfa-47bf-bcd8-f2c31a16ab48 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:49.753714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2e48b-5bfa-47bf-bcd8-f2c31a16ab48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:49.753714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2e48b-5bfa-47bf-bcd8-f2c31a16ab48 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:49.791408 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 478/960] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:03:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:50.367273 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205c7a-cb9f-47d4-b67c-c9d6f85f26eb None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:50.367798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205c7a-cb9f-47d4-b67c-c9d6f85f26eb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:50.367798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205c7a-cb9f-47d4-b67c-c9d6f85f26eb None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:50.369167 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 483/961] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:50.375140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529e92-757b-4668-be1c-248c7f752c22 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:50.375431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529e92-757b-4668-be1c-248c7f752c22 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:50.375710 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25529e92-757b-4668-be1c-248c7f752c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:50.393386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-25529e92-757b-4668-be1c-248c7f752c22 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:50.394986 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-25529e92-757b-4668-be1c-248c7f752c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:50.464566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 479/962] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:50.486619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e205c7a-cb9f-47d4-b67c-c9d6f85f26eb None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:50.585127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e205c7a-cb9f-47d4-b67c-c9d6f85f26eb None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:50.594965 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cd127-15b0-4094-b3d2-3a54143114cc None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:50.595252 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cd127-15b0-4094-b3d2-3a54143114cc None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:50.595529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cd127-15b0-4094-b3d2-3a54143114cc None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:50.599824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 480/963] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:50.602427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eba7d-9470-4574-95b6-ed3decd13d10 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:50.602542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eba7d-9470-4574-95b6-ed3decd13d10 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:50.602776 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140eba7d-9470-4574-95b6-ed3decd13d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:50.619014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:50.619721 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:50.619871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-140eba7d-9470-4574-95b6-ed3decd13d10 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:50.620100 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:50.620309 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:50.620929 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-140eba7d-9470-4574-95b6-ed3decd13d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:50.621033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:50.622424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:50.634711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:50.635743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:50.636696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 484/964] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:50.642014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:50.697422 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 481/965] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:50.721164 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eba7d-9470-4574-95b6-ed3decd13d10 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:50.750385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3eaed-c8dc-4deb-92ca-b0466d695d3d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:50.784417 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:50.785068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:50.785354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:50.785616 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:50.786318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:50.786622 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:50.787998 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:50.792793 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 485/966] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:50.798732 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:50.820523 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140eba7d-9470-4574-95b6-ed3decd13d10 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:50.855209 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f1926-8465-411e-a24c-611f1ee55978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:50.856097 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f1926-8465-411e-a24c-611f1ee55978 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:50.856415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f1926-8465-411e-a24c-611f1ee55978 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:50.856745 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f1926-8465-411e-a24c-611f1ee55978 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:50.867172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f1926-8465-411e-a24c-611f1ee55978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-f21f1926-8465-411e-a24c-611f1ee55978 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:03:50.875976 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:50.876950 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:03:50.877839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:50.880072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 482/967] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:03:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:50.882853 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f1926-8465-411e-a24c-611f1ee55978 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:50.903674 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ab91-aeef-4ee4-906f-8bbe9276ce7e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:50.945455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:50.946120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:50.946393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:50.946664 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:50.947356 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:50.947691 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:50.949035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:50.964042 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 486/968] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:50.994500 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f1926-8465-411e-a24c-611f1ee55978 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.032191 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.032871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.033153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.033430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.034190 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:51.034499 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.035913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.045032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 483/969] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:03:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:51.050893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.175068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54876ad-56d7-4b58-a19a-9b2d05cf884f None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.208609 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5b37b-c376-4bbc-aa3e-05f2eb2cf183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.209401 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5b37b-c376-4bbc-aa3e-05f2eb2cf183 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.209678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5b37b-c376-4bbc-aa3e-05f2eb2cf183 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.209949 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5b37b-c376-4bbc-aa3e-05f2eb2cf183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.220572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5b37b-c376-4bbc-aa3e-05f2eb2cf183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.221998 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5b37b-c376-4bbc-aa3e-05f2eb2cf183 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-edb5b37b-c376-4bbc-aa3e-05f2eb2cf183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:51.238933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:51.239988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:51.240956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:51.240956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:51.240956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:51.240956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:51.240956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 487/970] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:51.246942 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.314589 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e36b-8df7-4bba-b60c-338e4f2db40d None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.314925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e36b-8df7-4bba-b60c-338e4f2db40d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.315197 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e36b-8df7-4bba-b60c-338e4f2db40d None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.319812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 488/971] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:03:51.322317 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df33756-c934-4d55-a3c8-4200e8c55d10 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.322815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df33756-c934-4d55-a3c8-4200e8c55d10 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.323295 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df33756-c934-4d55-a3c8-4200e8c55d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.340864 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2df33756-c934-4d55-a3c8-4200e8c55d10 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:51.342478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2df33756-c934-4d55-a3c8-4200e8c55d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:51.351931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fe2c2-2b0c-4c13-b5d4-bb4177c6274d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.386760 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.387419 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.387699 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.388036 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.389301 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:51.389609 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.390966 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.402530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 484/972] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:51.408323 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.409761 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 489/973] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:51.432805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df33756-c934-4d55-a3c8-4200e8c55d10 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.509167 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e3393-8a9d-4431-a0ae-8ed1a78c7249 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.535655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df33756-c934-4d55-a3c8-4200e8c55d10 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.543752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.545425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.545959 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.546280 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.553581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.555008 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.570180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:03:51.570467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:51.571415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:03:51.572898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:51.573460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.573460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.573460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.573652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 485/974] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:51.576429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.578161 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.579154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:51.590251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:51.592608 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:51.593489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 490/975] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:03:51.598026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.681713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd63bf9-9356-47e7-84c7-c62e64934811 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.705310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc5256-7ab0-46f1-b529-2a61d034f5b3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.717556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.718228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.718508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.718780 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.719616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:51.719963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.721389 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.738625 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.739280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.739556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.739851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.740546 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:51.740848 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.742184 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.743557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 486/976] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:51.744458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.751967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 491/977] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:51.752892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.849731 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9513ec-c9cd-497f-a498-3605dcabd5c3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.856368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4c0ac-4ba3-4fc5-ab20-006fbdb02b05 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:51.883236 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee327984-18f9-438a-a809-c6cacf8a8da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.883947 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee327984-18f9-438a-a809-c6cacf8a8da8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.884226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee327984-18f9-438a-a809-c6cacf8a8da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.884669 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee327984-18f9-438a-a809-c6cacf8a8da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.889692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:51.890349 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:51.890627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:51.890898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:51.891587 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:51.891920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.893276 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.898141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 492/978] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:51.903513 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:51.961932 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee327984-18f9-438a-a809-c6cacf8a8da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:51.963854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee327984-18f9-438a-a809-c6cacf8a8da8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:51.998525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8deac1-bedb-4681-9d48-c310929956e2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:52.030345 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:52.030992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:52.031270 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:52.031933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:52.032362 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] RBAC: Adding query filter params (interface=admin, service_id=7758f583683c477fba7eb483de4ee074, region_id=RegionOne) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:52.032671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:52.034013 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:52.039407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 493/979] 10.222.0.32 () {56 vars in 1249 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/endpoints?service_id=7758f583683c477fba7eb483de4ee074&interface=admin®ion_id=RegionOne => generated 193 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:52.045101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:52.070352 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 487/980] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:03:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:03:52.071460 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee327984-18f9-438a-a809-c6cacf8a8da8 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:52.148524 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90156e0e-d5d0-44f0-89b3-737cd671efc2 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:52.173770 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee327984-18f9-438a-a809-c6cacf8a8da8 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:52.181720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afbdb5-98e5-4ab7-89d3-1b9c4e1fc931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:52.182384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbdb5-98e5-4ab7-89d3-1b9c4e1fc931 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:52.182665 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbdb5-98e5-4ab7-89d3-1b9c4e1fc931 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:52.182939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbdb5-98e5-4ab7-89d3-1b9c4e1fc931 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:52.183615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afbdb5-98e5-4ab7-89d3-1b9c4e1fc931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:52.185048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afbdb5-98e5-4ab7-89d3-1b9c4e1fc931 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:52.203561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 494/981] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:03:52 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:03:52.208979 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:52.209798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:52.210076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:52.210340 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:52.222715 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:52.224139 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:03:52.243458 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:52.244484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:52.250958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:03:52.250958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:03:52.250958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:03:52.250958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:52.250958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 488/982] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:52.251515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afbdb5-98e5-4ab7-89d3-1b9c4e1fc931 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:52.360554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afbdb5-98e5-4ab7-89d3-1b9c4e1fc931 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:52.396784 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:52.397442 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:52.397723 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:52.397994 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:52.398893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:52.399281 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:52.400664 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:52.413826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 495/983] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:52.419214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:52.516689 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229ceb1-81e9-401a-8ebc-9ec5a5f33556 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:52.550398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:52.551192 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:52.551467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:52.551734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:52.558319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:52.560269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:03:52.573754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:52.574651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:52.576610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:03:52.576610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:03:52.576610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:03:52.576610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:03:52.576610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:03:52.576610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:03:52.576610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:03:52.576610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:52.577681 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 489/984] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:52.581850 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:52.680259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8e2d5-4c13-4da4-a827-dc4fe6798ee1 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:52.715333 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6c19d-140d-45e5-a6ad-aa140ccb5390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:52.716342 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c19d-140d-45e5-a6ad-aa140ccb5390 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:52.716628 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c19d-140d-45e5-a6ad-aa140ccb5390 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:52.716901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6c19d-140d-45e5-a6ad-aa140ccb5390 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:52.717687 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6c19d-140d-45e5-a6ad-aa140ccb5390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:52.717996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6c19d-140d-45e5-a6ad-aa140ccb5390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:52.719415 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6c19d-140d-45e5-a6ad-aa140ccb5390 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:52.736296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 496/985] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:52.737792 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:52.838652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b4ca8-e1db-4245-8aae-957ed62eb0ee None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:52.871448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2823125-97b4-4549-bcf5-3c5db08cd154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:52.872128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823125-97b4-4549-bcf5-3c5db08cd154 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:52.873022 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823125-97b4-4549-bcf5-3c5db08cd154 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:52.873805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823125-97b4-4549-bcf5-3c5db08cd154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:52.874637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2823125-97b4-4549-bcf5-3c5db08cd154 None admin] RBAC: Adding query filter params (role.id=cd99d12153d2430aabc119f3f7f80c4f, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=aa3419c2ac434daabea2cccd301002c7) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:52.874951 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2823125-97b4-4549-bcf5-3c5db08cd154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:52.876397 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2823125-97b4-4549-bcf5-3c5db08cd154 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:52.887809 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 490/986] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:03:52 2022] GET /identity/v3/role_assignments?user.id=aa3419c2ac434daabea2cccd301002c7&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=cd99d12153d2430aabc119f3f7f80c4f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:53.224919 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bc090-f4c0-40d7-8b45-df58abaf183e None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:53.225307 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bc090-f4c0-40d7-8b45-df58abaf183e None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:53.225486 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bc090-f4c0-40d7-8b45-df58abaf183e None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:53.226994 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 497/987] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:53.232860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d04f-59ec-48ef-8021-0e64cafd2fd5 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:53.233153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d04f-59ec-48ef-8021-0e64cafd2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:53.233429 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9d04f-59ec-48ef-8021-0e64cafd2fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:53.249834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-33c9d04f-59ec-48ef-8021-0e64cafd2fd5 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:53.251015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-33c9d04f-59ec-48ef-8021-0e64cafd2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:53.317016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 491/988] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:53.339170 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bc090-f4c0-40d7-8b45-df58abaf183e None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:53.440291 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bc090-f4c0-40d7-8b45-df58abaf183e None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:53.473858 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d9f50-d31b-49e1-91b0-cab3ff1a82f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:53.474519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9f50-d31b-49e1-91b0-cab3ff1a82f4 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:53.474798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9f50-d31b-49e1-91b0-cab3ff1a82f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:53.475123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d9f50-d31b-49e1-91b0-cab3ff1a82f4 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:53.475823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d9f50-d31b-49e1-91b0-cab3ff1a82f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:53.477178 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d9f50-d31b-49e1-91b0-cab3ff1a82f4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:53.493583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 498/989] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:03:53 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:54.502406 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151dcb-7de4-497f-bbf6-179ac35e6bed None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:54.502953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151dcb-7de4-497f-bbf6-179ac35e6bed None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:54.502953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151dcb-7de4-497f-bbf6-179ac35e6bed None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:54.504650 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 492/990] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:54.510222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636cdd-23cf-4785-a091-b3598f9a7685 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:54.510652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636cdd-23cf-4785-a091-b3598f9a7685 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:54.510828 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11636cdd-23cf-4785-a091-b3598f9a7685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:54.527308 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-11636cdd-23cf-4785-a091-b3598f9a7685 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:54.528545 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-11636cdd-23cf-4785-a091-b3598f9a7685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:54.605057 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 499/991] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:54.626876 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151dcb-7de4-497f-bbf6-179ac35e6bed None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:54.726009 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151dcb-7de4-497f-bbf6-179ac35e6bed None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:54.758766 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:54.759577 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:54.759926 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:54.760167 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:54.760804 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:54.762163 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:54.774168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:54.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:03:54.776306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 493/992] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:03:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:54.783999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636cdd-23cf-4785-a091-b3598f9a7685 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:54.875906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11636cdd-23cf-4785-a091-b3598f9a7685 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:54.908094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:54.908756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:54.909036 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:54.909306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:54.909999 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:54.910530 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:54.911659 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:54.916487 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 500/993] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:54.922217 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:55.020810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b029b9-b803-4d26-a32d-99372a5a512c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:55.056830 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd563b63-8e4f-44fd-afd9-f6b39e982eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:55.057495 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd563b63-8e4f-44fd-afd9-f6b39e982eed None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.057772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd563b63-8e4f-44fd-afd9-f6b39e982eed None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.058042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd563b63-8e4f-44fd-afd9-f6b39e982eed None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.058751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd563b63-8e4f-44fd-afd9-f6b39e982eed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:55.059052 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd563b63-8e4f-44fd-afd9-f6b39e982eed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:55.060706 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd563b63-8e4f-44fd-afd9-f6b39e982eed None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:55.065839 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 494/994] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:03:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:55.071246 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:55.181955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40b111-9a89-431e-b045-83c6cb0185f3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:55.212514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990bb-deaa-4872-aa89-526a380f8e57 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.212798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990bb-deaa-4872-aa89-526a380f8e57 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.213099 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990bb-deaa-4872-aa89-526a380f8e57 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.214588 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 495/995] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:03:55.215554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8962c-00f6-42ed-b38f-3634a911036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:55.216240 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8962c-00f6-42ed-b38f-3634a911036d None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.216515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8962c-00f6-42ed-b38f-3634a911036d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.216783 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8962c-00f6-42ed-b38f-3634a911036d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.217522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8962c-00f6-42ed-b38f-3634a911036d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:55.218864 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8962c-00f6-42ed-b38f-3634a911036d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:55.220012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f91a-940b-4230-a6d8-d25942c09fd9 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.220305 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f91a-940b-4230-a6d8-d25942c09fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.220586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f91a-940b-4230-a6d8-d25942c09fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.235299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 501/996] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:03:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:55.249489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-1169f91a-940b-4230-a6d8-d25942c09fd9 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:55.250904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-1169f91a-940b-4230-a6d8-d25942c09fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:55.331917 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 496/997] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:03:55.352564 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8962c-00f6-42ed-b38f-3634a911036d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:55.457602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8962c-00f6-42ed-b38f-3634a911036d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:55.491232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:55.492060 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.492343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.492621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] PATH_INFO: `/v3/services/image` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.493277 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:55.494641 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:55.506447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:55.507467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:55.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 502/998] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:03:55 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:55.516431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f91a-940b-4230-a6d8-d25942c09fd9 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:55.619930 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f91a-940b-4230-a6d8-d25942c09fd9 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:55.653610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fce75-4f01-412d-ad6d-24ff1103cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:55.654267 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fce75-4f01-412d-ad6d-24ff1103cc07 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.654542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fce75-4f01-412d-ad6d-24ff1103cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.654810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fce75-4f01-412d-ad6d-24ff1103cc07 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.655511 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fce75-4f01-412d-ad6d-24ff1103cc07 None admin] RBAC: Adding query filter params (name=image) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:55.655852 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fce75-4f01-412d-ad6d-24ff1103cc07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:55.657204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fce75-4f01-412d-ad6d-24ff1103cc07 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:55.666434 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 497/999] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:55.667715 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:55.766305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091ee1-c80d-48e0-94c2-ce92d1b36f00 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:55.772496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323a9a-d889-459c-a95c-3b1be4b7adbc None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.772782 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323a9a-d889-459c-a95c-3b1be4b7adbc None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.773057 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323a9a-d889-459c-a95c-3b1be4b7adbc None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.774553 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 498/1000] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:03:55.779689 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5eea3-c2cb-41b8-ad9f-dd4074fe3c50 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.780000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5eea3-c2cb-41b8-ad9f-dd4074fe3c50 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.780271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5eea3-c2cb-41b8-ad9f-dd4074fe3c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.796928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-92d5eea3-c2cb-41b8-ad9f-dd4074fe3c50 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:55.798122 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-92d5eea3-c2cb-41b8-ad9f-dd4074fe3c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:55.799607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:55.800300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:55.800578 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:55.800858 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:55.801560 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] RBAC: Adding query filter params (type=image) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:55.801864 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:55.803216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:55.807693 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 503/1001] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:55.873116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 499/1002] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:55.895585 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:55.999340 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c6b3-cf20-4ae8-82f2-c293a59485bd None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:56.032577 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:56.033371 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:56.033647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:56.033916 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:56.034559 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:56.035930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:56.048261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:56.049298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:56.055004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 504/1003] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:56.057270 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5eea3-c2cb-41b8-ad9f-dd4074fe3c50 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:56.155253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5eea3-c2cb-41b8-ad9f-dd4074fe3c50 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:56.187723 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:56.188418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:56.188701 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:56.188978 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:56.189684 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:56.189992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:56.191349 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:56.201162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 500/1004] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:56.202979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:56.297549 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d19cd-866d-4574-b786-92d0e039a4bf None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:56.331757 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:56.332444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:56.332728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:56.333003 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:56.333700 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] RBAC: Adding query filter params (type=compute) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:56.334004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:56.335367 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:56.345369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 505/1005] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:56.347015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:56.445562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaaed0f-27db-4046-90c9-40d1525f5d30 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:56.479691 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0298d-db61-4c9b-99ba-f695634fb71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:56.480387 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0298d-db61-4c9b-99ba-f695634fb71d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:56.480670 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0298d-db61-4c9b-99ba-f695634fb71d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:56.480945 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0298d-db61-4c9b-99ba-f695634fb71d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:56.482388 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0298d-db61-4c9b-99ba-f695634fb71d None admin] RBAC: Adding query filter params (interface=public, service_id=dadaa71647de4a95bb524b58adcae7eb, region_id=RegionOne) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:56.482705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0298d-db61-4c9b-99ba-f695634fb71d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:56.484090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0298d-db61-4c9b-99ba-f695634fb71d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:56.491790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 501/1006] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:03:56 2022] GET /identity/v3/endpoints?service_id=dadaa71647de4a95bb524b58adcae7eb&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:56.495172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:56.595376 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfca437-d50b-492c-8a61-fa6201c9f4be None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:56.628160 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91761dc1-42f1-492e-96ff-2ccd3194b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:56.628813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91761dc1-42f1-492e-96ff-2ccd3194b08c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:56.629088 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91761dc1-42f1-492e-96ff-2ccd3194b08c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:56.629359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91761dc1-42f1-492e-96ff-2ccd3194b08c None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:56.630025 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91761dc1-42f1-492e-96ff-2ccd3194b08c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:56.631370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91761dc1-42f1-492e-96ff-2ccd3194b08c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:56.637492 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 506/1007] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:03:56 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:03:57.526440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322ba6-6df5-4ad9-b645-fd6a43ee73e7 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:57.526963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322ba6-6df5-4ad9-b645-fd6a43ee73e7 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:57.527042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322ba6-6df5-4ad9-b645-fd6a43ee73e7 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:57.528560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 502/1008] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:57.533805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300b36-2dcd-4dc2-a7a2-7451018f783b None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:57.534106 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300b36-2dcd-4dc2-a7a2-7451018f783b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:57.534389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300b36-2dcd-4dc2-a7a2-7451018f783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:57.551289 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-36300b36-2dcd-4dc2-a7a2-7451018f783b None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:57.552504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-36300b36-2dcd-4dc2-a7a2-7451018f783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:57.619076 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 507/1009] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:57.643283 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322ba6-6df5-4ad9-b645-fd6a43ee73e7 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:57.740683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322ba6-6df5-4ad9-b645-fd6a43ee73e7 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:57.775939 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced22838-0afc-42c1-8422-d27958b47618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:57.776787 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22838-0afc-42c1-8422-d27958b47618 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:57.777019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22838-0afc-42c1-8422-d27958b47618 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:57.777293 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22838-0afc-42c1-8422-d27958b47618 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:57.778515 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced22838-0afc-42c1-8422-d27958b47618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:57.780395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced22838-0afc-42c1-8422-d27958b47618 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:57.782176 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 503/1010] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:03:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:57.787791 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300b36-2dcd-4dc2-a7a2-7451018f783b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:57.888838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300b36-2dcd-4dc2-a7a2-7451018f783b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:57.923487 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d1cf1-3219-4010-9bcc-eb11b427f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:57.924173 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d1cf1-3219-4010-9bcc-eb11b427f25a None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:57.924458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d1cf1-3219-4010-9bcc-eb11b427f25a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:57.924734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d1cf1-3219-4010-9bcc-eb11b427f25a None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:57.925447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d1cf1-3219-4010-9bcc-eb11b427f25a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:57.926875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d1cf1-3219-4010-9bcc-eb11b427f25a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:57.954980 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 508/1011] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:03:57 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:58.045710 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f60d-efb3-46dd-b048-74db90fd68c2 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:58.046045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f60d-efb3-46dd-b048-74db90fd68c2 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:58.046172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752f60d-efb3-46dd-b048-74db90fd68c2 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:58.047730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 504/1012] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:58.053369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8d0c9-3b60-4987-9607-d5de55eee4e0 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:58.053658 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8d0c9-3b60-4987-9607-d5de55eee4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:58.053935 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8d0c9-3b60-4987-9607-d5de55eee4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:58.071502 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-76c8d0c9-3b60-4987-9607-d5de55eee4e0 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:58.072736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-76c8d0c9-3b60-4987-9607-d5de55eee4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:58.144713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 509/1013] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:58 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:58.167262 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752f60d-efb3-46dd-b048-74db90fd68c2 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:58.268050 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752f60d-efb3-46dd-b048-74db90fd68c2 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:58.300758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf6cd-76b5-428d-8a1d-f711a0c5364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:58.301336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf6cd-76b5-428d-8a1d-f711a0c5364f None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:58.301611 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf6cd-76b5-428d-8a1d-f711a0c5364f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:58.301878 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf6cd-76b5-428d-8a1d-f711a0c5364f None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:58.302591 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bf6cd-76b5-428d-8a1d-f711a0c5364f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:58.303966 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bf6cd-76b5-428d-8a1d-f711a0c5364f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:58.319102 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 505/1014] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:03:58 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:03:58.900958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7490b4-8dc0-43bb-a13f-fd9b1092184c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:58.901480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7490b4-8dc0-43bb-a13f-fd9b1092184c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:58.901480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7490b4-8dc0-43bb-a13f-fd9b1092184c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:58.902974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 510/1015] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:03:58.908817 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe30edd-5e0c-4001-9a9f-2379f7ebf111 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:58.909228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe30edd-5e0c-4001-9a9f-2379f7ebf111 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:58.909396 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe30edd-5e0c-4001-9a9f-2379f7ebf111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:58.926011 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-8fe30edd-5e0c-4001-9a9f-2379f7ebf111 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:03:58.927160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-8fe30edd-5e0c-4001-9a9f-2379f7ebf111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:03:58.998305 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 506/1016] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:03:58 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:03:59.021182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7490b4-8dc0-43bb-a13f-fd9b1092184c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:59.123425 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7490b4-8dc0-43bb-a13f-fd9b1092184c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:59.158743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:59.159893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:59.160383 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:59.160862 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:59.161734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:59.163293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:03:59.175010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:03:59.176094 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:03:59.176944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:03:59.179842 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 511/1017] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:03:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:03:59.183058 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe30edd-5e0c-4001-9a9f-2379f7ebf111 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:59.280024 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe30edd-5e0c-4001-9a9f-2379f7ebf111 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:59.312831 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:59.313489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:59.313772 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:59.314046 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:59.314748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:59.315057 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:59.316441 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:59.321289 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 507/1018] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:03:59.326851 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:59.430583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da63fc-16e0-4f3f-a532-934000fa51c7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:59.464828 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42890056-4bf8-456b-a200-b857afb041c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:59.465495 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890056-4bf8-456b-a200-b857afb041c0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:59.466324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890056-4bf8-456b-a200-b857afb041c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:59.467169 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42890056-4bf8-456b-a200-b857afb041c0 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:59.467343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42890056-4bf8-456b-a200-b857afb041c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:03:59.467614 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42890056-4bf8-456b-a200-b857afb041c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:59.469035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42890056-4bf8-456b-a200-b857afb041c0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:59.478241 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 512/1019] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:03:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:03:59.479743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:03:59.579047 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e61976-b555-4a92-a81c-cfe166bc749d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:03:59.613111 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83da79-4717-4b74-ba64-f1ab2fc31faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:03:59.613773 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83da79-4717-4b74-ba64-f1ab2fc31faa None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:03:59.614057 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83da79-4717-4b74-ba64-f1ab2fc31faa None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:03:59.614335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83da79-4717-4b74-ba64-f1ab2fc31faa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:03:59.615084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83da79-4717-4b74-ba64-f1ab2fc31faa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:03:59.616498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83da79-4717-4b74-ba64-f1ab2fc31faa None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:03:59.647796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 508/1020] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:03:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:00.285771 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c195b-21c7-44f4-99ba-7ae00f499aab None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:00.286326 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c195b-21c7-44f4-99ba-7ae00f499aab None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:00.286326 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c195b-21c7-44f4-99ba-7ae00f499aab None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:00.287714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 513/1021] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:00.292911 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e62283-dcc7-40a6-83ce-9c18d590caa4 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:00.293304 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e62283-dcc7-40a6-83ce-9c18d590caa4 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:00.293465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e62283-dcc7-40a6-83ce-9c18d590caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:00.311160 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-84e62283-dcc7-40a6-83ce-9c18d590caa4 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:00.312370 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-84e62283-dcc7-40a6-83ce-9c18d590caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:00.383748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 509/1022] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:00.408575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c195b-21c7-44f4-99ba-7ae00f499aab None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:00.513368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c195b-21c7-44f4-99ba-7ae00f499aab None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:00.546319 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cacfd-d586-40ae-a78f-e65301446943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:00.547111 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cacfd-d586-40ae-a78f-e65301446943 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:00.547393 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cacfd-d586-40ae-a78f-e65301446943 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:00.547669 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cacfd-d586-40ae-a78f-e65301446943 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:00.548891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cacfd-d586-40ae-a78f-e65301446943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:00.550318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cacfd-d586-40ae-a78f-e65301446943 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:00.552100 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 514/1023] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:00.557561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e62283-dcc7-40a6-83ce-9c18d590caa4 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:00.602146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c30a8-8e50-463b-91df-80b0e107f5f3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:00.602468 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c30a8-8e50-463b-91df-80b0e107f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:00.602696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c30a8-8e50-463b-91df-80b0e107f5f3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:00.604866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 515/1024] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:00.609744 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2015b-f0b9-4ef0-be00-8f5429b235e8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:00.610029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2015b-f0b9-4ef0-be00-8f5429b235e8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:00.610304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2015b-f0b9-4ef0-be00-8f5429b235e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:00.626960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-10e2015b-f0b9-4ef0-be00-8f5429b235e8 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:00.628168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-10e2015b-f0b9-4ef0-be00-8f5429b235e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:00.656630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e62283-dcc7-40a6-83ce-9c18d590caa4 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:00.689537 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbc701-3e04-411d-854b-c6f8327d731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:00.690204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc701-3e04-411d-854b-c6f8327d731d None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:00.690483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc701-3e04-411d-854b-c6f8327d731d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:00.690754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc701-3e04-411d-854b-c6f8327d731d None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:00.691466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbc701-3e04-411d-854b-c6f8327d731d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:00.693210 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbc701-3e04-411d-854b-c6f8327d731d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:00.693982 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 516/1025] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:04:00.719803 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 510/1026] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:04:00 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:00.720027 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2015b-f0b9-4ef0-be00-8f5429b235e8 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:00.825171 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2015b-f0b9-4ef0-be00-8f5429b235e8 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:00.865895 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:00.866829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:00.867116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:00.867388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] PATH_INFO: `/v3/services/image` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:00.868085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:00.869615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:00.882084 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:00.883172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:04:00.884441 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:00.888186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 517/1027] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:04:00 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:00.889581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbc701-3e04-411d-854b-c6f8327d731d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:00.993143 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbc701-3e04-411d-854b-c6f8327d731d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:01.027414 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:01.028381 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:01.028845 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:01.029265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:01.030114 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:01.030563 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:01.032082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:01.037189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 511/1028] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:01.043013 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:01.142756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24f88-64e5-4894-9984-51d10151d5ca None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:01.175456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:01.176150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:01.176435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:01.176711 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:01.177412 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:01.177721 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:01.179076 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:01.183772 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 518/1029] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:01.190214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:01.286968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4ee82-6ec4-4b09-96fe-962ad61c3ee1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:01.320237 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4c839-6ccb-4b3e-8bcd-dbea4785259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:01.320975 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4c839-6ccb-4b3e-8bcd-dbea4785259c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:01.321244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4c839-6ccb-4b3e-8bcd-dbea4785259c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:01.321432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4c839-6ccb-4b3e-8bcd-dbea4785259c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:01.322214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4c839-6ccb-4b3e-8bcd-dbea4785259c None admin] RBAC: Adding query filter params (interface=public, service_id=e2edbd5ae7b7427b8905e04e83b087c7, region_id=RegionOne) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:01.322527 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4c839-6ccb-4b3e-8bcd-dbea4785259c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:01.323916 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4c839-6ccb-4b3e-8bcd-dbea4785259c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:01.334041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 512/1030] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:04:01 2022] GET /identity/v3/endpoints?service_id=e2edbd5ae7b7427b8905e04e83b087c7&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:01.334847 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:01.435083 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72969f5c-21a6-457f-9018-39c45b0225a9 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:01.468306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dae14d-ed54-41a8-ab35-f24ad779362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:01.468968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dae14d-ed54-41a8-ab35-f24ad779362b None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:01.469248 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dae14d-ed54-41a8-ab35-f24ad779362b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:01.469521 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dae14d-ed54-41a8-ab35-f24ad779362b None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:01.470191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dae14d-ed54-41a8-ab35-f24ad779362b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:01.471559 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dae14d-ed54-41a8-ab35-f24ad779362b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:01.484024 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 519/1031] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:04:01 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:04:01.996574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a5ac-6a7d-485f-a019-61e6f1ef3bdc None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:01.997055 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a5ac-6a7d-485f-a019-61e6f1ef3bdc None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:01.997263 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a5ac-6a7d-485f-a019-61e6f1ef3bdc None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:01.999113 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 513/1032] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:02.004637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6833-dd5f-4c20-906a-220d5bf69c76 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:02.004929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6833-dd5f-4c20-906a-220d5bf69c76 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:02.005222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6833-dd5f-4c20-906a-220d5bf69c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:02.022155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-dcfd6833-dd5f-4c20-906a-220d5bf69c76 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:02.023327 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-dcfd6833-dd5f-4c20-906a-220d5bf69c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:02.092753 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 520/1033] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:02.115625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1a5ac-6a7d-485f-a019-61e6f1ef3bdc None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:02.213336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1a5ac-6a7d-485f-a019-61e6f1ef3bdc None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:02.244942 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5d2d3-42d8-4329-bf0b-16fd5ba489b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:02.245750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d2d3-42d8-4329-bf0b-16fd5ba489b1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:02.246029 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d2d3-42d8-4329-bf0b-16fd5ba489b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:02.246300 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5d2d3-42d8-4329-bf0b-16fd5ba489b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:02.257288 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5d2d3-42d8-4329-bf0b-16fd5ba489b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-90d5d2d3-42d8-4329-bf0b-16fd5ba489b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:02.265204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:02.266170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:04:02.267045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:02.274454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 514/1034] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:04:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:02.274577 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6833-dd5f-4c20-906a-220d5bf69c76 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:02.369131 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6833-dd5f-4c20-906a-220d5bf69c76 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:02.401910 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:02.402883 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:02.403914 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:02.404373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:02.405426 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:02.405911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:02.407542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:02.416551 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 521/1035] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:04:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:02.422561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5d2d3-42d8-4329-bf0b-16fd5ba489b1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:02.519893 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5d2d3-42d8-4329-bf0b-16fd5ba489b1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:02.552948 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:02.553737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:02.554014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:02.554282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:02.564728 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:02.566166 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:02.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:02.584486 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:02.585401 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:02.585401 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:02.585401 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:02.585401 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:02.586235 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 515/1036] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:02.590348 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:02.688447 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afe9dc-1756-4dc6-8190-69023255c052 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:02.725486 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:02.726496 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:02.726984 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:02.727482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:02.728506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:02.729179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:02.730796 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:02.743169 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 522/1037] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:02.754799 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:02.856514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5eed-b38e-4e5d-8ae4-52a92871847e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:02.892220 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e8775-d54f-47b4-8e44-db1e069c6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:02.893006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e8775-d54f-47b4-8e44-db1e069c6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:02.893284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e8775-d54f-47b4-8e44-db1e069c6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:02.893553 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e8775-d54f-47b4-8e44-db1e069c6bc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:02.902012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e8775-d54f-47b4-8e44-db1e069c6bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:02.903474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e8775-d54f-47b4-8e44-db1e069c6bc1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-d68e8775-d54f-47b4-8e44-db1e069c6bc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:04:02.917427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:02.918423 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:02.924573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 516/1038] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:04:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:02.925204 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.019575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a29cf-4770-4343-a317-cb1a1a1031bb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.034314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968504-658a-4110-86cb-a37b59f457e8 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.034602 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968504-658a-4110-86cb-a37b59f457e8 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.034880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968504-658a-4110-86cb-a37b59f457e8 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.036280 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 517/1039] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:03.041176 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffb8c9-26e3-4077-b0a0-9415b482d00c None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.041462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffb8c9-26e3-4077-b0a0-9415b482d00c None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.041741 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffb8c9-26e3-4077-b0a0-9415b482d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.053611 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.054265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.054550 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.054827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.055652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:03.056113 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:03.057521 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:03.058690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-fcffb8c9-26e3-4077-b0a0-9415b482d00c None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:03.060418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-fcffb8c9-26e3-4077-b0a0-9415b482d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:03.082392 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 523/1040] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:04:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:03.084653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.132636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 518/1041] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:04:03.156334 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffb8c9-26e3-4077-b0a0-9415b482d00c None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.186123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840834e3-2e28-404c-a089-2101df30d5ec None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.220797 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18da51a-b7ea-411f-b4de-7391cddbadb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.221450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18da51a-b7ea-411f-b4de-7391cddbadb7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.221732 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18da51a-b7ea-411f-b4de-7391cddbadb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.222006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18da51a-b7ea-411f-b4de-7391cddbadb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.259947 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffb8c9-26e3-4077-b0a0-9415b482d00c None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.291313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18da51a-b7ea-411f-b4de-7391cddbadb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:03.292801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18da51a-b7ea-411f-b4de-7391cddbadb7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:03.296719 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c51d35-bae5-4c5a-b902-00f067f139ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.297510 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51d35-bae5-4c5a-b902-00f067f139ae None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.297786 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51d35-bae5-4c5a-b902-00f067f139ae None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.298056 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51d35-bae5-4c5a-b902-00f067f139ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.309986 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c51d35-bae5-4c5a-b902-00f067f139ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-c4c51d35-bae5-4c5a-b902-00f067f139ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:03.317598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:03.318625 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:03.319637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 519/1042] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:03.324698 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c51d35-bae5-4c5a-b902-00f067f139ae None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.399475 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 524/1043] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:04:03.405844 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18da51a-b7ea-411f-b4de-7391cddbadb7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.424688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c51d35-bae5-4c5a-b902-00f067f139ae None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.459010 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.459726 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.459980 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.460257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.461000 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:03.461306 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:03.462690 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:03.470760 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 520/1044] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:03.476417 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.506086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18da51a-b7ea-411f-b4de-7391cddbadb7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.539647 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.540754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.541225 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.541501 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.552157 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:03.553897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:03.571643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:03.572720 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:03.573922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:03.573922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:03.573922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:03.573922 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:03.574158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396df1a-a987-4a40-b3a0-e941e36e7baf None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.574235 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 525/1045] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:03.578537 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.614483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e697ed-1908-42f8-8d9f-d2eb085e38b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.615371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e697ed-1908-42f8-8d9f-d2eb085e38b5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.615658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e697ed-1908-42f8-8d9f-d2eb085e38b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.616058 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e697ed-1908-42f8-8d9f-d2eb085e38b5 None admin] PATH_INFO: `/v3/users/6967cdfacb744749ac271d03c295c280` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.633712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e697ed-1908-42f8-8d9f-d2eb085e38b5 None admin] RBAC: Authorizing `identity:get_user(user_id=6967cdfacb744749ac271d03c295c280)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:03.635167 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e697ed-1908-42f8-8d9f-d2eb085e38b5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:03.636993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 521/1046] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/users/6967cdfacb744749ac271d03c295c280 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:03.643161 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e697ed-1908-42f8-8d9f-d2eb085e38b5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.687108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc33eee-efc1-4619-bc42-022a30e80abf None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.721576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.722237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.722516 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.722794 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.723505 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:03.723834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:03.725198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:03.736078 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 526/1047] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:03.740033 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e697ed-1908-42f8-8d9f-d2eb085e38b5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.741588 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.776112 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160777d7-3533-4376-914e-3754d1d3289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.777100 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160777d7-3533-4376-914e-3754d1d3289f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.777374 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160777d7-3533-4376-914e-3754d1d3289f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.777650 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160777d7-3533-4376-914e-3754d1d3289f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.840063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073c49-3f44-4631-aa3d-dc08660a9efe None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:03.843663 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160777d7-3533-4376-914e-3754d1d3289f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:03.845122 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160777d7-3533-4376-914e-3754d1d3289f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:03.871521 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b7543-0227-4df4-b588-6c3457e555e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:03.872990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7543-0227-4df4-b588-6c3457e555e8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.873274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7543-0227-4df4-b588-6c3457e555e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.873545 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7543-0227-4df4-b588-6c3457e555e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.879986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b7543-0227-4df4-b588-6c3457e555e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:03.881410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b7543-0227-4df4-b588-6c3457e555e8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-7d5b7543-0227-4df4-b588-6c3457e555e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:04:03.896009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:03.897086 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:03.897991 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 527/1048] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:03.898497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b375cb0-518a-41ef-a67f-e246458cafc1 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.898761 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b375cb0-518a-41ef-a67f-e246458cafc1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.899045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b375cb0-518a-41ef-a67f-e246458cafc1 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.900328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 528/1049] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:03.903121 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b375cb0-518a-41ef-a67f-e246458cafc1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:03.940597 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 522/1050] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:04:03.942072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda8490-76e7-47d3-b82d-ee7d51a9715a None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:03.942359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda8490-76e7-47d3-b82d-ee7d51a9715a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:03.942633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda8490-76e7-47d3-b82d-ee7d51a9715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:03.958488 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-1cda8490-76e7-47d3-b82d-ee7d51a9715a None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:03.959673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-1cda8490-76e7-47d3-b82d-ee7d51a9715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:03.999520 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b375cb0-518a-41ef-a67f-e246458cafc1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:04.022922 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 523/1051] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:04.023580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda8490-76e7-47d3-b82d-ee7d51a9715a None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:04.031622 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:04.032321 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:04.032603 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:04.032878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:04.033666 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:04.033975 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:04.035404 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:04.047505 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 529/1052] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:04.048367 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:04.120292 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda8490-76e7-47d3-b82d-ee7d51a9715a None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:04.142453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a405d7-ef37-4582-a163-bc59b0f0bbdc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:04.151781 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42e1b5-ff4f-4805-83ef-5c343473387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:04.152636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42e1b5-ff4f-4805-83ef-5c343473387a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:04.152959 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42e1b5-ff4f-4805-83ef-5c343473387a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:04.153236 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42e1b5-ff4f-4805-83ef-5c343473387a None admin] PATH_INFO: `/v3/projects/7c32ae812e624703832d8fd7571ce036` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:04.154404 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42e1b5-ff4f-4805-83ef-5c343473387a None admin] RBAC: Authorizing `identity:get_project(project_id=7c32ae812e624703832d8fd7571ce036)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:04.155826 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42e1b5-ff4f-4805-83ef-5c343473387a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:04.157489 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 524/1053] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:04 2022] GET /identity/v3/projects/7c32ae812e624703832d8fd7571ce036 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:04.158244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42e1b5-ff4f-4805-83ef-5c343473387a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:04.175033 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:04.175872 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:04.176161 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:04.176473 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] PATH_INFO: `/v3/services/image` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:04.177162 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:04.178527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:04.190679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:04.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:04.192875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 530/1054] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:04:04 2022] GET /identity/v3/services/image => generated 86 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:04.193729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:04.258437 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42e1b5-ff4f-4805-83ef-5c343473387a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:04.286890 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a874a1-e9fc-4fba-a5ba-b056c9f6b887 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:04.290283 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:04.290921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:04.291197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:04.291468 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:04.292321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] RBAC: Adding query filter params (role.id=cd99d12153d2430aabc119f3f7f80c4f, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=4b31cba57e024daf84c6359b7e6a81cc) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:04.292629 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:04.294569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:04.299818 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 525/1055] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:04 2022] GET /identity/v3/role_assignments?user.id=4b31cba57e024daf84c6359b7e6a81cc&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=cd99d12153d2430aabc119f3f7f80c4f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:04.300592 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:04.322144 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:04.322816 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:04.323106 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:04.323365 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:04.324242 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=7c32ae812e624703832d8fd7571ce036, user.id=6967cdfacb744749ac271d03c295c280) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:04.324556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:04.326171 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:04.340041 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 531/1056] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:04 2022] GET /identity/v3/role_assignments?user.id=6967cdfacb744749ac271d03c295c280&scope.project.id=7c32ae812e624703832d8fd7571ce036&role.id=67227061f74f48f293a12155e904b5fc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:04.413177 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa932bf-17e2-4dee-b436-ef28c2a23ce6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:04.451359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:04.452312 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:04.452529 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:04.452795 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:04.453520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] RBAC: Adding query filter params (name=image) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:04.453829 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:04.455378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:04.466715 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 526/1057] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:04.467602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:04.572354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4b9e5-2422-4660-b3a5-2228523e2fdb None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:04.605479 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ab690-b81a-469d-9f88-8565a5186423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:04.606792 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab690-b81a-469d-9f88-8565a5186423 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:04.607179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab690-b81a-469d-9f88-8565a5186423 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:04.607460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ab690-b81a-469d-9f88-8565a5186423 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:04.608200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ab690-b81a-469d-9f88-8565a5186423 None admin] RBAC: Adding query filter params (type=image) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:04.608509 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ab690-b81a-469d-9f88-8565a5186423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:04.609883 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ab690-b81a-469d-9f88-8565a5186423 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:04.614775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 532/1058] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:04.620539 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:04.718492 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d540877-d039-421c-8fa5-99abccfd7675 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:04.750376 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade7de0-f126-4fbe-aec4-2ea140bdccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:04.751028 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7de0-f126-4fbe-aec4-2ea140bdccc8 None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:04.751310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7de0-f126-4fbe-aec4-2ea140bdccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:04.751586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7de0-f126-4fbe-aec4-2ea140bdccc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:04.752361 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade7de0-f126-4fbe-aec4-2ea140bdccc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:04.753717 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade7de0-f126-4fbe-aec4-2ea140bdccc8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:04.779807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 527/1059] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:04:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:04:06.546461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781533f1-9863-4c94-9101-33d1b6eb80ed None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:06.547026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781533f1-9863-4c94-9101-33d1b6eb80ed None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:06.547026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781533f1-9863-4c94-9101-33d1b6eb80ed None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:06.548532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 533/1060] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:06.553531 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1f9eb-85fd-427f-8403-33e08ddea6c3 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:06.553924 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1f9eb-85fd-427f-8403-33e08ddea6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:06.554084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1f9eb-85fd-427f-8403-33e08ddea6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:06.571967 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-f8a1f9eb-85fd-427f-8403-33e08ddea6c3 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:06.573146 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-f8a1f9eb-85fd-427f-8403-33e08ddea6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:06.588619 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec5d87-1785-42b4-b155-e51d6de8ea5a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:06.588896 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec5d87-1785-42b4-b155-e51d6de8ea5a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:06.589166 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec5d87-1785-42b4-b155-e51d6de8ea5a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:06.591211 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 534/1061] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:06.596151 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4f50-c02c-4e0a-9b1c-9e97a339aa4d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:06.596439 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4f50-c02c-4e0a-9b1c-9e97a339aa4d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:06.596714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4f50-c02c-4e0a-9b1c-9e97a339aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:06.613778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6c4d4f50-c02c-4e0a-9b1c-9e97a339aa4d None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:06.614952 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6c4d4f50-c02c-4e0a-9b1c-9e97a339aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:06.647655 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 528/1062] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:06.670923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1f9eb-85fd-427f-8403-33e08ddea6c3 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:06.682186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 535/1063] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:04:06.705794 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4f50-c02c-4e0a-9b1c-9e97a339aa4d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:06.766934 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1f9eb-85fd-427f-8403-33e08ddea6c3 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:06.801051 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4f50-c02c-4e0a-9b1c-9e97a339aa4d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:06.802125 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294687-8ac5-44e3-b12a-acb6906513f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:06.802929 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294687-8ac5-44e3-b12a-acb6906513f4 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:06.803212 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294687-8ac5-44e3-b12a-acb6906513f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:06.803481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78294687-8ac5-44e3-b12a-acb6906513f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:06.814016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78294687-8ac5-44e3-b12a-acb6906513f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-78294687-8ac5-44e3-b12a-acb6906513f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:06.822363 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:06.823466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:06.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 529/1064] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:04:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:06.830626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294687-8ac5-44e3-b12a-acb6906513f4 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:06.838444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134bdd-4352-4a8d-b397-0aa79b1e20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:06.839244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134bdd-4352-4a8d-b397-0aa79b1e20c3 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:06.839527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134bdd-4352-4a8d-b397-0aa79b1e20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:06.840191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72134bdd-4352-4a8d-b397-0aa79b1e20c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:06.851723 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72134bdd-4352-4a8d-b397-0aa79b1e20c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-72134bdd-4352-4a8d-b397-0aa79b1e20c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:06.860428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:06.861382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:06.862244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:06.867160 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 536/1065] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:06.868026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134bdd-4352-4a8d-b397-0aa79b1e20c3 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:06.938590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78294687-8ac5-44e3-b12a-acb6906513f4 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:06.972736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:06.973404 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:06.973691 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:06.973964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:06.974711 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:06.975019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:06.976406 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:06.979703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72134bdd-4352-4a8d-b397-0aa79b1e20c3 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:06.985561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 530/1066] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:04:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:06.991134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.018011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.018674 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.018975 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.019229 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.019990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:07.020290 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.021644 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.030108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 537/1067] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:07.035801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.090345 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a2ee3-359c-444b-9c1b-bf7b22d58830 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.123176 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394964-e33d-4ce5-9e23-26f66f251327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.123994 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394964-e33d-4ce5-9e23-26f66f251327 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.124277 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394964-e33d-4ce5-9e23-26f66f251327 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.124553 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394964-e33d-4ce5-9e23-26f66f251327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.133990 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0cc7-eb15-449c-a2a1-fe8a3c24532c None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.134684 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e394964-e33d-4ce5-9e23-26f66f251327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.136154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e394964-e33d-4ce5-9e23-26f66f251327 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-1e394964-e33d-4ce5-9e23-26f66f251327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:07.152775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:07.153811 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:07.155250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:07.155250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:07.155250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:07.155250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:07.155250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 531/1068] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:07.155602 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b219-ebc2-4041-baa8-4af66b081f28 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.155813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b219-ebc2-4041-baa8-4af66b081f28 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.156097 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b219-ebc2-4041-baa8-4af66b081f28 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.157508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 532/1069] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:07.159552 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b219-ebc2-4041-baa8-4af66b081f28 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.169358 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f22b86-93e7-4df8-ad0e-df1749a37085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.170287 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22b86-93e7-4df8-ad0e-df1749a37085 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.170556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22b86-93e7-4df8-ad0e-df1749a37085 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.170822 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f22b86-93e7-4df8-ad0e-df1749a37085 None admin] PATH_INFO: `/v3/users/6967cdfacb744749ac271d03c295c280` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.172032 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f22b86-93e7-4df8-ad0e-df1749a37085 None admin] RBAC: Authorizing `identity:get_user(user_id=6967cdfacb744749ac271d03c295c280)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.173439 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f22b86-93e7-4df8-ad0e-df1749a37085 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.175022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 538/1070] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/users/6967cdfacb744749ac271d03c295c280 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:07.176164 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e179eae-b88d-49d7-9b66-78a430efce73 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.176444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e179eae-b88d-49d7-9b66-78a430efce73 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.176717 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e179eae-b88d-49d7-9b66-78a430efce73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.193002 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5e179eae-b88d-49d7-9b66-78a430efce73 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:07.194158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5e179eae-b88d-49d7-9b66-78a430efce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:07.257492 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 539/1071] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:07.258313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e179eae-b88d-49d7-9b66-78a430efce73 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.273032 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b219-ebc2-4041-baa8-4af66b081f28 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.305373 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.306019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.306299 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.306568 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.307275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:07.307582 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.308963 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.320256 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 533/1072] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:07.321039 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.357321 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e179eae-b88d-49d7-9b66-78a430efce73 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.389759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6beb17-c2f0-4b88-b2a0-34b6718f141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.390603 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6beb17-c2f0-4b88-b2a0-34b6718f141d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.390878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6beb17-c2f0-4b88-b2a0-34b6718f141d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.391147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6beb17-c2f0-4b88-b2a0-34b6718f141d None admin] PATH_INFO: `/v3/projects/7c32ae812e624703832d8fd7571ce036` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.392330 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6beb17-c2f0-4b88-b2a0-34b6718f141d None admin] RBAC: Authorizing `identity:get_project(project_id=7c32ae812e624703832d8fd7571ce036)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.393742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6beb17-c2f0-4b88-b2a0-34b6718f141d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.395394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 540/1073] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/projects/7c32ae812e624703832d8fd7571ce036 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:07.396160 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6beb17-c2f0-4b88-b2a0-34b6718f141d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.415436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571e2a8-b610-4706-ac0d-fff75bbf19dd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.448062 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879cf9-f5d2-40ad-ab72-b16466f3df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.448709 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879cf9-f5d2-40ad-ab72-b16466f3df76 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.448988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879cf9-f5d2-40ad-ab72-b16466f3df76 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.449260 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879cf9-f5d2-40ad-ab72-b16466f3df76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.489142 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6beb17-c2f0-4b88-b2a0-34b6718f141d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.516826 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879cf9-f5d2-40ad-ab72-b16466f3df76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.518371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879cf9-f5d2-40ad-ab72-b16466f3df76 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.522716 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.523498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.523786 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.524069 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.531677 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.533118 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:04:07.548310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:07.549765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 541/1074] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:07.550736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.615422 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 534/1075] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:07.616320 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879cf9-f5d2-40ad-ab72-b16466f3df76 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.648249 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa26488-61f3-41b5-a6b6-5fcdd7a890d7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.680131 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb78c44-e0df-4f98-8dc0-f6045723f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.681031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78c44-e0df-4f98-8dc0-f6045723f546 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.681311 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78c44-e0df-4f98-8dc0-f6045723f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.681580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78c44-e0df-4f98-8dc0-f6045723f546 None admin] PATH_INFO: `/v3/projects/7c32ae812e624703832d8fd7571ce036/users/6967cdfacb744749ac271d03c295c280/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.683576 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb78c44-e0df-4f98-8dc0-f6045723f546 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c32ae812e624703832d8fd7571ce036, user_id=6967cdfacb744749ac271d03c295c280, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.685557 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb78c44-e0df-4f98-8dc0-f6045723f546 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.698093 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 542/1076] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:04:07 2022] PUT /identity/v3/projects/7c32ae812e624703832d8fd7571ce036/users/6967cdfacb744749ac271d03c295c280/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:07.711961 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb78c44-e0df-4f98-8dc0-f6045723f546 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.716822 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879cf9-f5d2-40ad-ab72-b16466f3df76 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.755327 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.756047 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.756327 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.756595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.757447 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:07.757753 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.759213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.778535 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 535/1077] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:07.784093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.807307 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb78c44-e0df-4f98-8dc0-f6045723f546 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.845129 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.846507 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.847026 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.847535 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.861151 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.863625 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:07.885070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:07.885997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:07.886939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:07.886939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:07.886939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:07.886939 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:07.889254 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 543/1078] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:07.890762 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a445bd-92b5-4835-a831-fa55c289d82d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:07.895365 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.927842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:07.928639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:07.928918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:07.929193 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:07.940015 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:07.941467 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:07.959425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:07.960520 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:07.961564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:07.961564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:07.961564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:07.961564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:07.961564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 536/1079] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:07.966445 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:07.997621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be70a6-11a1-4687-9301-5481cad514e7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:08.030489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:08.031141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:08.031424 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:08.031693 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:08.032433 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:08.032736 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:08.034089 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:08.045997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 544/1080] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:08.067070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03146e1b-bc6e-4d9f-ba76-9a03e1ab26b5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:08.108987 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:08.109664 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:08.109942 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:08.110209 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:08.110938 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:08.111239 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:08.112666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:08.125964 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 537/1081] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:08.132032 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:08.241952 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49c64-ab0b-4c62-9db9-a9369281f874 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:08.278584 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:08.279388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:08.279667 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:08.279976 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:08.286776 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:08.288249 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:04:08.302405 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:08.303595 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:08.304889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 545/1082] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:08.311398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:08.410899 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee3ef3-969f-4068-b2a7-113fdb21d6a9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:08.443222 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd950-74b4-4a22-8234-74e09d16d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:08.443913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd950-74b4-4a22-8234-74e09d16d6dd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:08.444196 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd950-74b4-4a22-8234-74e09d16d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:08.444472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd950-74b4-4a22-8234-74e09d16d6dd None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:08.445252 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd950-74b4-4a22-8234-74e09d16d6dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:08.445563 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd950-74b4-4a22-8234-74e09d16d6dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:08.446981 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd950-74b4-4a22-8234-74e09d16d6dd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:08.459478 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 538/1083] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:08.466677 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:08.563565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69632b-d4c1-4b6b-94f9-525a3920a780 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:08.598261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773d071-0259-4a49-b561-9523be932d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:08.599126 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d071-0259-4a49-b561-9523be932d13 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:08.599407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d071-0259-4a49-b561-9523be932d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:08.599682 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d071-0259-4a49-b561-9523be932d13 None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/4b31cba57e024daf84c6359b7e6a81cc/roles/cd99d12153d2430aabc119f3f7f80c4f` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:08.601869 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773d071-0259-4a49-b561-9523be932d13 None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=4b31cba57e024daf84c6359b7e6a81cc, role_id=cd99d12153d2430aabc119f3f7f80c4f)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:08.603282 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773d071-0259-4a49-b561-9523be932d13 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:08.615855 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 546/1084] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:04:08 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/4b31cba57e024daf84c6359b7e6a81cc/roles/cd99d12153d2430aabc119f3f7f80c4f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:04:09.941864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400204-9189-4124-855d-6fc8a69af847 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:09.942428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400204-9189-4124-855d-6fc8a69af847 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:09.942428 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400204-9189-4124-855d-6fc8a69af847 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:09.943794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 539/1085] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:09.948986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba4a8-b5ea-473a-a013-245c8fbe09ee None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:09.949410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba4a8-b5ea-473a-a013-245c8fbe09ee None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:09.949618 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba4a8-b5ea-473a-a013-245c8fbe09ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:09.966020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d6fba4a8-b5ea-473a-a013-245c8fbe09ee None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:09.967172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d6fba4a8-b5ea-473a-a013-245c8fbe09ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:10.029469 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 547/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:04:10.052864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400204-9189-4124-855d-6fc8a69af847 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:10.151776 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400204-9189-4124-855d-6fc8a69af847 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:10.183773 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139f34f-2921-4489-ac48-944403a62b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:10.184708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139f34f-2921-4489-ac48-944403a62b41 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:10.184984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139f34f-2921-4489-ac48-944403a62b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:10.185254 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139f34f-2921-4489-ac48-944403a62b41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:10.194806 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139f34f-2921-4489-ac48-944403a62b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-7139f34f-2921-4489-ac48-944403a62b41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:10.203013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:10.204061 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:10.205398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 540/1087] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:10.210112 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba4a8-b5ea-473a-a013-245c8fbe09ee None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:10.303462 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba4a8-b5ea-473a-a013-245c8fbe09ee None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:10.335593 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:10.336282 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:10.336561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:10.336833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:10.337572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:10.337879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:10.339229 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:10.347543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 548/1088] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:10.353263 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139f34f-2921-4489-ac48-944403a62b41 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:10.448159 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139f34f-2921-4489-ac48-944403a62b41 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:10.480308 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce93e5c-ce4c-4cf2-933c-1a9ef8035155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:10.482107 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93e5c-ce4c-4cf2-933c-1a9ef8035155 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:10.482382 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93e5c-ce4c-4cf2-933c-1a9ef8035155 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:10.482651 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93e5c-ce4c-4cf2-933c-1a9ef8035155 None admin] PATH_INFO: `/v3/users/6967cdfacb744749ac271d03c295c280` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:10.483851 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce93e5c-ce4c-4cf2-933c-1a9ef8035155 None admin] RBAC: Authorizing `identity:get_user(user_id=6967cdfacb744749ac271d03c295c280)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:10.485270 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce93e5c-ce4c-4cf2-933c-1a9ef8035155 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:10.486875 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 541/1089] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:10 2022] GET /identity/v3/users/6967cdfacb744749ac271d03c295c280 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:10.492707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:10.588102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4bb48-8e14-41db-85ad-737824592d8a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:10.618697 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae670dff-fd1c-4158-86ca-75304b70aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:10.619358 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670dff-fd1c-4158-86ca-75304b70aa3d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:10.619635 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670dff-fd1c-4158-86ca-75304b70aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:10.619931 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae670dff-fd1c-4158-86ca-75304b70aa3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:10.688529 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae670dff-fd1c-4158-86ca-75304b70aa3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:10.689967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae670dff-fd1c-4158-86ca-75304b70aa3d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:10.782553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 549/1090] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:10.788339 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce93e5c-ce4c-4cf2-933c-1a9ef8035155 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:10.847097 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21d03-29aa-42e9-964c-6c29217ec035 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:10.847397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21d03-29aa-42e9-964c-6c29217ec035 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:10.847682 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb21d03-29aa-42e9-964c-6c29217ec035 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:10.849075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 550/1091] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:10.854168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d77a-11c8-469c-98f8-16eb093a23ce None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:10.854452 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d77a-11c8-469c-98f8-16eb093a23ce None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:10.854725 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d77a-11c8-469c-98f8-16eb093a23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:10.871306 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-67f4d77a-11c8-469c-98f8-16eb093a23ce None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:10.872704 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-67f4d77a-11c8-469c-98f8-16eb093a23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:10.883475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce93e5c-ce4c-4cf2-933c-1a9ef8035155 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:10.915564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b97c7-e745-4178-bd37-16ffee707f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:10.916436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b97c7-e745-4178-bd37-16ffee707f33 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:10.916714 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b97c7-e745-4178-bd37-16ffee707f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:10.916983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b97c7-e745-4178-bd37-16ffee707f33 None admin] PATH_INFO: `/v3/projects/7c32ae812e624703832d8fd7571ce036` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:10.918130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b97c7-e745-4178-bd37-16ffee707f33 None admin] RBAC: Authorizing `identity:get_project(project_id=7c32ae812e624703832d8fd7571ce036)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:10.919741 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b97c7-e745-4178-bd37-16ffee707f33 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:10.921436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 542/1092] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:10 2022] GET /identity/v3/projects/7c32ae812e624703832d8fd7571ce036 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:10.927279 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b97c7-e745-4178-bd37-16ffee707f33 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:10.935400 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 551/1093] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:04:10.959530 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d77a-11c8-469c-98f8-16eb093a23ce None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:11.021965 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b97c7-e745-4178-bd37-16ffee707f33 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:11.052299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d77a-11c8-469c-98f8-16eb093a23ce None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:11.054905 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:11.055556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:11.055977 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:11.056258 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:11.057081 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=7c32ae812e624703832d8fd7571ce036, user.id=6967cdfacb744749ac271d03c295c280) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:11.057394 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:11.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:11.079798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 543/1094] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:10 2022] GET /identity/v3/role_assignments?user.id=6967cdfacb744749ac271d03c295c280&scope.project.id=7c32ae812e624703832d8fd7571ce036&role.id=67227061f74f48f293a12155e904b5fc => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:11.087465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0bd64-278b-46b0-8fcb-50d5507ec405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:11.088410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0bd64-278b-46b0-8fcb-50d5507ec405 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:11.088695 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0bd64-278b-46b0-8fcb-50d5507ec405 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:11.088970 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0bd64-278b-46b0-8fcb-50d5507ec405 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:11.101278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0bd64-278b-46b0-8fcb-50d5507ec405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-48d0bd64-278b-46b0-8fcb-50d5507ec405 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:11.109996 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:11.111183 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:11.112077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 552/1095] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:04:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:11.117730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:11.223091 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19afd0-5f58-4435-a981-1deeb4072210 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:11.257244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:11.257918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:11.258198 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:11.258471 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:11.259212 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:11.259511 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:11.261021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:11.270183 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 544/1096] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:04:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:11.276077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0bd64-278b-46b0-8fcb-50d5507ec405 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:11.373251 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0bd64-278b-46b0-8fcb-50d5507ec405 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:11.405701 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:11.406485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:11.406765 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:11.407037 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:11.417102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:11.418815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:11.436049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:11.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:11.437988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:11.437988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:11.437988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:11.437988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:11.437988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 553/1097] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:11.442919 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:11.541465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f929ee0-2845-4a84-ae95-66c39a691ac1 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:11.575182 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:11.575887 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:11.576170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:11.576441 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:11.577410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:11.577711 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:11.579070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:11.590929 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 545/1098] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:11.596518 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:11.693194 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd78ed-75f0-4000-9139-cc982e42866a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:11.725259 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:11.726049 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:11.726333 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:11.726610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:11.734487 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:11.735958 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:04:11.749972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:11.751080 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:11.752320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 554/1099] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:04:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:11.758873 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:11.854142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc6be2-efd6-4079-bd5c-f1b76b847770 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:11.888073 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:11.888891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:11.889178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:11.889452 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:11.890279 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:11.890590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:11.892026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:11.908680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 546/1100] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:04:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:11.914325 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:12.009628 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3b79-8fb6-4856-906b-cd51f52c088a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:12.041323 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb351-9c96-42fa-b035-eee01cf853d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:12.041956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb351-9c96-42fa-b035-eee01cf853d7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:12.042239 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb351-9c96-42fa-b035-eee01cf853d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:12.042515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffb351-9c96-42fa-b035-eee01cf853d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:12.106135 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffb351-9c96-42fa-b035-eee01cf853d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:12.107568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffb351-9c96-42fa-b035-eee01cf853d7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:12.200572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 555/1101] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:04:12.206545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:12.303175 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642870aa-61ae-4a6b-855f-bfb6098e0013 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:12.336088 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:12.336872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:12.337156 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:12.337432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:12.347401 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:12.348891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:12.366155 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:12.367153 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:12.368574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:12.368574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:12.368574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:12.368574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:12.368574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 547/1102] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:12.373710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb351-9c96-42fa-b035-eee01cf853d7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:12.466730 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffb351-9c96-42fa-b035-eee01cf853d7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:12.499456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:12.500147 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:12.500432 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:12.500707 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:12.501418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:12.501729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:12.503096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:12.514123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 556/1103] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:12.519781 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:12.616005 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba1c6-8d9c-45c7-bead-48fabd70b4a6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:12.648661 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:12.649469 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:12.649747 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:12.650020 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:12.657123 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:12.658541 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:04:12.672385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:12.673463 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:12.674439 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 548/1104] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:12.679578 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:12.775265 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ae981-0c31-4519-8a6e-1dc412f34975 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:12.808115 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f953-7d13-4e9d-9d71-7ac37b44017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:12.808808 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f953-7d13-4e9d-9d71-7ac37b44017d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:12.809200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f953-7d13-4e9d-9d71-7ac37b44017d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:12.809478 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f953-7d13-4e9d-9d71-7ac37b44017d None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:12.810252 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f953-7d13-4e9d-9d71-7ac37b44017d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:12.810554 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f953-7d13-4e9d-9d71-7ac37b44017d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:12.811979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f953-7d13-4e9d-9d71-7ac37b44017d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:12.823414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 557/1105] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:12.830315 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:12.930259 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff671fd-84cc-4e9a-9ac8-5fa42c1a56a5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:12.963724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8b431-193d-423c-8e8d-a5d424514b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:12.964395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b431-193d-423c-8e8d-a5d424514b40 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:12.964675 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b431-193d-423c-8e8d-a5d424514b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:12.964947 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b431-193d-423c-8e8d-a5d424514b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:12.966724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8b431-193d-423c-8e8d-a5d424514b40 None admin] RBAC: Adding query filter params (role.id=cd99d12153d2430aabc119f3f7f80c4f, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=4b31cba57e024daf84c6359b7e6a81cc) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:12.967038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8b431-193d-423c-8e8d-a5d424514b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:12.968497 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8b431-193d-423c-8e8d-a5d424514b40 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:12.974249 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 549/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:12 2022] GET /identity/v3/role_assignments?user.id=4b31cba57e024daf84c6359b7e6a81cc&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=cd99d12153d2430aabc119f3f7f80c4f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:13.357427 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e8401-14cf-45c2-971c-38d3ad1d0da9 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:13.357932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e8401-14cf-45c2-971c-38d3ad1d0da9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:13.357932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e8401-14cf-45c2-971c-38d3ad1d0da9 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:13.359244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 558/1107] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:13.364961 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8d32-435a-4e59-9ca6-419f7f85f767 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:13.365392 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8d32-435a-4e59-9ca6-419f7f85f767 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:13.365514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8d32-435a-4e59-9ca6-419f7f85f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:13.382593 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-d32c8d32-435a-4e59-9ca6-419f7f85f767 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:13.383847 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-d32c8d32-435a-4e59-9ca6-419f7f85f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:13.450753 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 550/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:13.475513 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e8401-14cf-45c2-971c-38d3ad1d0da9 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:13.576525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e8401-14cf-45c2-971c-38d3ad1d0da9 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:13.609450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad927-922b-4ff8-8e29-87a638054ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:13.610177 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad927-922b-4ff8-8e29-87a638054ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:13.610456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad927-922b-4ff8-8e29-87a638054ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:13.610738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad927-922b-4ff8-8e29-87a638054ef7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:13.611937 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ad927-922b-4ff8-8e29-87a638054ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:13.613369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ad927-922b-4ff8-8e29-87a638054ef7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:13.614977 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 559/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:13.620881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8d32-435a-4e59-9ca6-419f7f85f767 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:13.721029 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8d32-435a-4e59-9ca6-419f7f85f767 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:13.755692 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c6543-b5f9-4387-8403-b7b9055ca1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:13.756386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c6543-b5f9-4387-8403-b7b9055ca1ec None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:13.756669 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c6543-b5f9-4387-8403-b7b9055ca1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:13.756941 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c6543-b5f9-4387-8403-b7b9055ca1ec None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:13.757649 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c6543-b5f9-4387-8403-b7b9055ca1ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:13.759072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c6543-b5f9-4387-8403-b7b9055ca1ec None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:13.778949 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 551/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:04:13 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:16.052122 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989359-8e9c-4d3b-904c-54ba4425a5bc None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:16.052674 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989359-8e9c-4d3b-904c-54ba4425a5bc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:16.052674 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989359-8e9c-4d3b-904c-54ba4425a5bc None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:16.054024 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 560/1111] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:16.059468 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a8129-2894-4398-9a73-82c08f407db4 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:16.059867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a8129-2894-4398-9a73-82c08f407db4 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:16.060060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a8129-2894-4398-9a73-82c08f407db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:16.077074 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-2e1a8129-2894-4398-9a73-82c08f407db4 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:16.078249 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-2e1a8129-2894-4398-9a73-82c08f407db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:16.141921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 552/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:16.165979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c989359-8e9c-4d3b-904c-54ba4425a5bc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:16.259403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c989359-8e9c-4d3b-904c-54ba4425a5bc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:16.292617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666e04-d1e8-4ffb-80cc-962614a7fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:16.293552 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666e04-d1e8-4ffb-80cc-962614a7fc4e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:16.293834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666e04-d1e8-4ffb-80cc-962614a7fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:16.294110 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666e04-d1e8-4ffb-80cc-962614a7fc4e None admin] PATH_INFO: `/v3/roles/abb44eff7ea447f6b105452bacf3892b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:16.295572 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5666e04-d1e8-4ffb-80cc-962614a7fc4e None admin] RBAC: Authorizing `identity:get_role(role_id=abb44eff7ea447f6b105452bacf3892b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:16.296977 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5666e04-d1e8-4ffb-80cc-962614a7fc4e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:16.298324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 561/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:16 2022] GET /identity/v3/roles/abb44eff7ea447f6b105452bacf3892b => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:16.304198 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a8129-2894-4398-9a73-82c08f407db4 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:16.399876 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a8129-2894-4398-9a73-82c08f407db4 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:16.430696 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9591b-5026-433b-871d-469e40fb4fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:16.431534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9591b-5026-433b-871d-469e40fb4fcc None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:16.431833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9591b-5026-433b-871d-469e40fb4fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:16.432103 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9591b-5026-433b-871d-469e40fb4fcc None admin] PATH_INFO: `/v3/users/289a280d3138480682c353df20bb123c` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:16.444910 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9591b-5026-433b-871d-469e40fb4fcc None admin] RBAC: Authorizing `identity:get_user(user_id=289a280d3138480682c353df20bb123c)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:16.446329 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9591b-5026-433b-871d-469e40fb4fcc None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:16.447954 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 553/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:16 2022] GET /identity/v3/users/289a280d3138480682c353df20bb123c => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:16.454847 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666e04-d1e8-4ffb-80cc-962614a7fc4e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:16.549331 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666e04-d1e8-4ffb-80cc-962614a7fc4e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:16.582104 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f8334-a87d-4509-b7cc-5a5c1dcefc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:16.582679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f8334-a87d-4509-b7cc-5a5c1dcefc06 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:16.582962 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f8334-a87d-4509-b7cc-5a5c1dcefc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:16.583236 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f8334-a87d-4509-b7cc-5a5c1dcefc06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:16.647213 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f8334-a87d-4509-b7cc-5a5c1dcefc06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:16.648667 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f8334-a87d-4509-b7cc-5a5c1dcefc06 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:16.740187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 562/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:16.746810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9591b-5026-433b-871d-469e40fb4fcc None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:16.840405 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9591b-5026-433b-871d-469e40fb4fcc None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:16.873869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e26dff-13af-4696-9ade-cf95dc1cf5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:16.874712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e26dff-13af-4696-9ade-cf95dc1cf5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:16.874987 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e26dff-13af-4696-9ade-cf95dc1cf5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:16.875252 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e26dff-13af-4696-9ade-cf95dc1cf5e8 None admin] PATH_INFO: `/v3/projects/7c32ae812e624703832d8fd7571ce036` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:16.876395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e26dff-13af-4696-9ade-cf95dc1cf5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=7c32ae812e624703832d8fd7571ce036)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:16.877804 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e26dff-13af-4696-9ade-cf95dc1cf5e8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:16.879448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 554/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:16 2022] GET /identity/v3/projects/7c32ae812e624703832d8fd7571ce036 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:16.885680 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f8334-a87d-4509-b7cc-5a5c1dcefc06 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:16.978510 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f8334-a87d-4509-b7cc-5a5c1dcefc06 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:17.010935 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d380bd3-969f-4df7-a8d6-b531b7b34d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:17.011565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d380bd3-969f-4df7-a8d6-b531b7b34d26 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:17.011988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d380bd3-969f-4df7-a8d6-b531b7b34d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:17.012262 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d380bd3-969f-4df7-a8d6-b531b7b34d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:17.013070 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d380bd3-969f-4df7-a8d6-b531b7b34d26 None admin] RBAC: Adding query filter params (role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=7c32ae812e624703832d8fd7571ce036, user.id=289a280d3138480682c353df20bb123c) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:17.013375 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d380bd3-969f-4df7-a8d6-b531b7b34d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:17.014811 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d380bd3-969f-4df7-a8d6-b531b7b34d26 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:17.019896 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 563/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:16 2022] GET /identity/v3/role_assignments?user.id=289a280d3138480682c353df20bb123c&scope.project.id=7c32ae812e624703832d8fd7571ce036&role.id=abb44eff7ea447f6b105452bacf3892b => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:19.209481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85191d97-ba03-428e-b18e-83bf4adfe22b None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:19.210001 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85191d97-ba03-428e-b18e-83bf4adfe22b None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:19.210001 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85191d97-ba03-428e-b18e-83bf4adfe22b None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:19.211378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 555/1118] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:19.216792 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe9282-3434-4f88-adc5-891b79e459a1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:19.217198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe9282-3434-4f88-adc5-891b79e459a1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:19.217334 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe9282-3434-4f88-adc5-891b79e459a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:19.233802 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-6fbe9282-3434-4f88-adc5-891b79e459a1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:19.234957 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6fbe9282-3434-4f88-adc5-891b79e459a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:19.298098 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 564/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:19.320212 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85191d97-ba03-428e-b18e-83bf4adfe22b None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:19.414454 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85191d97-ba03-428e-b18e-83bf4adfe22b None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:19.445966 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefce83-1b29-4f3c-a9b2-920d303029aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:19.446798 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefce83-1b29-4f3c-a9b2-920d303029aa None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:19.447072 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefce83-1b29-4f3c-a9b2-920d303029aa None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:19.447341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefce83-1b29-4f3c-a9b2-920d303029aa None admin] PATH_INFO: `/v3/roles/abb44eff7ea447f6b105452bacf3892b` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:19.448787 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefce83-1b29-4f3c-a9b2-920d303029aa None admin] RBAC: Authorizing `identity:get_role(role_id=abb44eff7ea447f6b105452bacf3892b)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:19.450190 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefce83-1b29-4f3c-a9b2-920d303029aa None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:19.451522 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 556/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:19 2022] GET /identity/v3/roles/abb44eff7ea447f6b105452bacf3892b => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:19.457529 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe9282-3434-4f88-adc5-891b79e459a1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:19.560910 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe9282-3434-4f88-adc5-891b79e459a1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:19.593640 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f83fcf-7da4-4dd8-874d-2bb6ba91aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:19.594497 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83fcf-7da4-4dd8-874d-2bb6ba91aa1d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:19.594782 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83fcf-7da4-4dd8-874d-2bb6ba91aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:19.595059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f83fcf-7da4-4dd8-874d-2bb6ba91aa1d None admin] PATH_INFO: `/v3/users/289a280d3138480682c353df20bb123c` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:19.596255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f83fcf-7da4-4dd8-874d-2bb6ba91aa1d None admin] RBAC: Authorizing `identity:get_user(user_id=289a280d3138480682c353df20bb123c)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:19.597674 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f83fcf-7da4-4dd8-874d-2bb6ba91aa1d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:19.599277 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 565/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:19 2022] GET /identity/v3/users/289a280d3138480682c353df20bb123c => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:19.605031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefce83-1b29-4f3c-a9b2-920d303029aa None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:19.698326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefce83-1b29-4f3c-a9b2-920d303029aa None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:19.731540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25154a3-8980-45c6-94b8-f5e5a18c61f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:19.732401 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25154a3-8980-45c6-94b8-f5e5a18c61f1 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:19.732681 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25154a3-8980-45c6-94b8-f5e5a18c61f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:19.732952 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25154a3-8980-45c6-94b8-f5e5a18c61f1 None admin] PATH_INFO: `/v3/projects/7c32ae812e624703832d8fd7571ce036` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:19.734101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25154a3-8980-45c6-94b8-f5e5a18c61f1 None admin] RBAC: Authorizing `identity:get_project(project_id=7c32ae812e624703832d8fd7571ce036)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:19.735508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25154a3-8980-45c6-94b8-f5e5a18c61f1 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:19.737190 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 557/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:19 2022] GET /identity/v3/projects/7c32ae812e624703832d8fd7571ce036 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:19.743172 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f83fcf-7da4-4dd8-874d-2bb6ba91aa1d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:19.839077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f83fcf-7da4-4dd8-874d-2bb6ba91aa1d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:19.872823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85f532-b149-40e7-a7f4-aa068e329d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:19.873705 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f532-b149-40e7-a7f4-aa068e329d69 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:19.873985 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f532-b149-40e7-a7f4-aa068e329d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:19.874262 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85f532-b149-40e7-a7f4-aa068e329d69 None admin] PATH_INFO: `/v3/projects/7c32ae812e624703832d8fd7571ce036/users/289a280d3138480682c353df20bb123c/roles/abb44eff7ea447f6b105452bacf3892b` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:19.876467 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85f532-b149-40e7-a7f4-aa068e329d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c32ae812e624703832d8fd7571ce036, user_id=289a280d3138480682c353df20bb123c, role_id=abb44eff7ea447f6b105452bacf3892b)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:19.877889 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85f532-b149-40e7-a7f4-aa068e329d69 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:19.889933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 566/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:04:19 2022] PUT /identity/v3/projects/7c32ae812e624703832d8fd7571ce036/users/289a280d3138480682c353df20bb123c/roles/abb44eff7ea447f6b105452bacf3892b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:22.093271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545b39-c92d-4f16-9207-6edac85c0899 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:22.093724 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545b39-c92d-4f16-9207-6edac85c0899 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:22.093814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545b39-c92d-4f16-9207-6edac85c0899 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:22.095157 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 558/1124] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:22.100471 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98332430-d587-418f-a557-dfdb42ac6c48 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:22.100843 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98332430-d587-418f-a557-dfdb42ac6c48 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:22.101029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98332430-d587-418f-a557-dfdb42ac6c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:22.117646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-98332430-d587-418f-a557-dfdb42ac6c48 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:22.118812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-98332430-d587-418f-a557-dfdb42ac6c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:22.181677 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 567/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:22.205746 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545b39-c92d-4f16-9207-6edac85c0899 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:22.302474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545b39-c92d-4f16-9207-6edac85c0899 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:22.334599 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1079d3a-9c23-49c4-a07e-b2bd253eca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:22.335372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079d3a-9c23-49c4-a07e-b2bd253eca3a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:22.335654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079d3a-9c23-49c4-a07e-b2bd253eca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:22.335953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1079d3a-9c23-49c4-a07e-b2bd253eca3a None admin] PATH_INFO: `/v3/roles/abb44eff7ea447f6b105452bacf3892b` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:22.337414 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1079d3a-9c23-49c4-a07e-b2bd253eca3a None admin] RBAC: Authorizing `identity:get_role(role_id=abb44eff7ea447f6b105452bacf3892b)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:22.338775 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1079d3a-9c23-49c4-a07e-b2bd253eca3a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:22.340700 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 559/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:22 2022] GET /identity/v3/roles/abb44eff7ea447f6b105452bacf3892b => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:22.346432 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98332430-d587-418f-a557-dfdb42ac6c48 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:22.444732 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98332430-d587-418f-a557-dfdb42ac6c48 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:22.477599 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc927-386e-4351-8352-14ecd62e26da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:22.478463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc927-386e-4351-8352-14ecd62e26da None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:22.478746 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc927-386e-4351-8352-14ecd62e26da None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:22.479020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc927-386e-4351-8352-14ecd62e26da None admin] PATH_INFO: `/v3/users/289a280d3138480682c353df20bb123c` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:22.480257 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc927-386e-4351-8352-14ecd62e26da None admin] RBAC: Authorizing `identity:get_user(user_id=289a280d3138480682c353df20bb123c)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:22.482654 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc927-386e-4351-8352-14ecd62e26da None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:22.484284 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 568/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:22 2022] GET /identity/v3/users/289a280d3138480682c353df20bb123c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:22.490027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1079d3a-9c23-49c4-a07e-b2bd253eca3a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:22.584213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1079d3a-9c23-49c4-a07e-b2bd253eca3a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:22.617442 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bab4f-54c4-461b-883a-052c493b328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:22.618017 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bab4f-54c4-461b-883a-052c493b328a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:22.618299 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bab4f-54c4-461b-883a-052c493b328a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:22.618574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bab4f-54c4-461b-883a-052c493b328a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:22.681628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bab4f-54c4-461b-883a-052c493b328a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:22.683057 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bab4f-54c4-461b-883a-052c493b328a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:22.776351 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 560/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:22.782832 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc927-386e-4351-8352-14ecd62e26da None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:22.876831 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc927-386e-4351-8352-14ecd62e26da None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:22.908551 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18b25f-0072-4402-b176-3e2397374927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:22.909382 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18b25f-0072-4402-b176-3e2397374927 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:22.909661 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18b25f-0072-4402-b176-3e2397374927 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:22.909933 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18b25f-0072-4402-b176-3e2397374927 None admin] PATH_INFO: `/v3/projects/7c32ae812e624703832d8fd7571ce036` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:22.911071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18b25f-0072-4402-b176-3e2397374927 None admin] RBAC: Authorizing `identity:get_project(project_id=7c32ae812e624703832d8fd7571ce036)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:22.912503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18b25f-0072-4402-b176-3e2397374927 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:22.914137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 569/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:22 2022] GET /identity/v3/projects/7c32ae812e624703832d8fd7571ce036 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:22.920842 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bab4f-54c4-461b-883a-052c493b328a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:23.012966 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bab4f-54c4-461b-883a-052c493b328a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:23.044372 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d6e32-e2d7-44ce-8896-a410b8f9ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:23.045002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6e32-e2d7-44ce-8896-a410b8f9ae2a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:23.045283 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6e32-e2d7-44ce-8896-a410b8f9ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:23.045551 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6e32-e2d7-44ce-8896-a410b8f9ae2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:23.046368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d6e32-e2d7-44ce-8896-a410b8f9ae2a None admin] RBAC: Adding query filter params (role.id=abb44eff7ea447f6b105452bacf3892b, scope.project.id=7c32ae812e624703832d8fd7571ce036, user.id=289a280d3138480682c353df20bb123c) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:23.046674 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d6e32-e2d7-44ce-8896-a410b8f9ae2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:23.048112 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d6e32-e2d7-44ce-8896-a410b8f9ae2a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:23.053560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 561/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:22 2022] GET /identity/v3/role_assignments?user.id=289a280d3138480682c353df20bb123c&scope.project.id=7c32ae812e624703832d8fd7571ce036&role.id=abb44eff7ea447f6b105452bacf3892b => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:25.275998 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce952ba-71a5-4f45-84c9-48e2fe3a635b None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:25.276522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce952ba-71a5-4f45-84c9-48e2fe3a635b None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:25.276627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce952ba-71a5-4f45-84c9-48e2fe3a635b None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:25.278480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 570/1131] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:25.283809 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ee1a-96c2-4944-8972-858427be4321 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:25.284219 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ee1a-96c2-4944-8972-858427be4321 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:25.284368 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ee1a-96c2-4944-8972-858427be4321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:25.300826 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-f031ee1a-96c2-4944-8972-858427be4321 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:25.302028 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-f031ee1a-96c2-4944-8972-858427be4321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:25.367130 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 562/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:25.391402 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce952ba-71a5-4f45-84c9-48e2fe3a635b None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:25.487580 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce952ba-71a5-4f45-84c9-48e2fe3a635b None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:25.521644 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110328cc-0a7d-4978-bfef-234d7249bbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:25.522436 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110328cc-0a7d-4978-bfef-234d7249bbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:25.522714 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110328cc-0a7d-4978-bfef-234d7249bbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:25.522986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110328cc-0a7d-4978-bfef-234d7249bbd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:25.524154 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110328cc-0a7d-4978-bfef-234d7249bbd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:25.525566 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110328cc-0a7d-4978-bfef-234d7249bbd5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:25.527343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 571/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:25.533146 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ee1a-96c2-4944-8972-858427be4321 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:25.638970 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ee1a-96c2-4944-8972-858427be4321 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:25.672544 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb6d9-0b35-4831-ad97-d66800f3742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:25.673201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb6d9-0b35-4831-ad97-d66800f3742f None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:25.673484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb6d9-0b35-4831-ad97-d66800f3742f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:25.673758 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb6d9-0b35-4831-ad97-d66800f3742f None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:25.674553 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cb6d9-0b35-4831-ad97-d66800f3742f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:25.676013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cb6d9-0b35-4831-ad97-d66800f3742f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:25.702507 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 563/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:04:25 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:27.966292 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b9da-0843-4965-bd7e-7f9cf2182ea1 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:27.966829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b9da-0843-4965-bd7e-7f9cf2182ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:27.966829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b9da-0843-4965-bd7e-7f9cf2182ea1 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:27.968216 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 572/1135] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:27.973507 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d954e8-c9dc-4de2-beb3-16ac8a943262 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:27.974028 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d954e8-c9dc-4de2-beb3-16ac8a943262 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:27.974126 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d954e8-c9dc-4de2-beb3-16ac8a943262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:27.991040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-04d954e8-c9dc-4de2-beb3-16ac8a943262 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:27.992285 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-04d954e8-c9dc-4de2-beb3-16ac8a943262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:28.054998 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 564/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:28.080002 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b9da-0843-4965-bd7e-7f9cf2182ea1 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:28.174940 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b9da-0843-4965-bd7e-7f9cf2182ea1 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:28.206769 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02585b-9523-4853-ac5f-cf2f0f88f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:28.207538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02585b-9523-4853-ac5f-cf2f0f88f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:28.207842 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02585b-9523-4853-ac5f-cf2f0f88f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:28.208119 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02585b-9523-4853-ac5f-cf2f0f88f2f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:28.209271 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02585b-9523-4853-ac5f-cf2f0f88f2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:28.210688 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02585b-9523-4853-ac5f-cf2f0f88f2f4 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:28.212290 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 573/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:04:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:28.218051 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d954e8-c9dc-4de2-beb3-16ac8a943262 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:28.310578 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d954e8-c9dc-4de2-beb3-16ac8a943262 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:28.342187 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984b6f1-416f-4be9-853b-6b0e6421461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:28.342824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b6f1-416f-4be9-853b-6b0e6421461b None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:28.343100 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b6f1-416f-4be9-853b-6b0e6421461b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:28.343369 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984b6f1-416f-4be9-853b-6b0e6421461b None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:28.344101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984b6f1-416f-4be9-853b-6b0e6421461b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:28.345502 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984b6f1-416f-4be9-853b-6b0e6421461b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:28.364776 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 565/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:04:28 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:04:30.616578 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c3b9-e9cd-4d46-bc3d-dcc3e9443da7 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:30.617156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c3b9-e9cd-4d46-bc3d-dcc3e9443da7 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:30.617156 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c3b9-e9cd-4d46-bc3d-dcc3e9443da7 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:30.618474 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 574/1139] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:30.623752 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867961a-b349-4741-8e73-8114fe7fc650 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:30.624175 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867961a-b349-4741-8e73-8114fe7fc650 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:30.624330 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867961a-b349-4741-8e73-8114fe7fc650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:30.640551 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-3867961a-b349-4741-8e73-8114fe7fc650 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:30.641712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-3867961a-b349-4741-8e73-8114fe7fc650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:30.705432 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 566/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:04:30.728498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66c3b9-e9cd-4d46-bc3d-dcc3e9443da7 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:30.822641 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66c3b9-e9cd-4d46-bc3d-dcc3e9443da7 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:30.856056 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f99365-91b4-4071-92f5-9659b1263b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:30.856848 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99365-91b4-4071-92f5-9659b1263b5a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:30.857124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99365-91b4-4071-92f5-9659b1263b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:30.857392 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99365-91b4-4071-92f5-9659b1263b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:30.867480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f99365-91b4-4071-92f5-9659b1263b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-87f99365-91b4-4071-92f5-9659b1263b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:30.875180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:30.876359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:30.877414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 575/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:30.882395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867961a-b349-4741-8e73-8114fe7fc650 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:30.975273 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867961a-b349-4741-8e73-8114fe7fc650 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.006615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74855a-9506-47cf-9194-524065938569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.007276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74855a-9506-47cf-9194-524065938569 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.007556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74855a-9506-47cf-9194-524065938569 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.007858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74855a-9506-47cf-9194-524065938569 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.008604 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74855a-9506-47cf-9194-524065938569 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:31.008914 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74855a-9506-47cf-9194-524065938569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.010273 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74855a-9506-47cf-9194-524065938569 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.018982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 567/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:31.024748 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f99365-91b4-4071-92f5-9659b1263b5a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.120444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f99365-91b4-4071-92f5-9659b1263b5a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.151558 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69399d93-d4d2-4d1f-9b46-d3bea27b8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.153195 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69399d93-d4d2-4d1f-9b46-d3bea27b8506 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.153482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69399d93-d4d2-4d1f-9b46-d3bea27b8506 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.153760 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69399d93-d4d2-4d1f-9b46-d3bea27b8506 None admin] PATH_INFO: `/v3/users/2aaa14b791114c1889583d888fafe303` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.166194 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69399d93-d4d2-4d1f-9b46-d3bea27b8506 None admin] RBAC: Authorizing `identity:get_user(user_id=2aaa14b791114c1889583d888fafe303)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.167675 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69399d93-d4d2-4d1f-9b46-d3bea27b8506 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.169404 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 576/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/users/2aaa14b791114c1889583d888fafe303 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:31.175137 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74855a-9506-47cf-9194-524065938569 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.268816 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74855a-9506-47cf-9194-524065938569 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.300664 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61bbb9-18d7-4889-be3d-57a0daa0bd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.301295 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61bbb9-18d7-4889-be3d-57a0daa0bd7c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.301578 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61bbb9-18d7-4889-be3d-57a0daa0bd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.301850 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61bbb9-18d7-4889-be3d-57a0daa0bd7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.363932 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61bbb9-18d7-4889-be3d-57a0daa0bd7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.365339 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61bbb9-18d7-4889-be3d-57a0daa0bd7c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.456466 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 568/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:31.462304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69399d93-d4d2-4d1f-9b46-d3bea27b8506 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.553989 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69399d93-d4d2-4d1f-9b46-d3bea27b8506 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.586245 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd16d-7723-48c4-94d8-04d983e26470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.587071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd16d-7723-48c4-94d8-04d983e26470 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.587349 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd16d-7723-48c4-94d8-04d983e26470 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.587621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd16d-7723-48c4-94d8-04d983e26470 None admin] PATH_INFO: `/v3/projects/319d1fed63bb405d8feff82d2d6e2044` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.588796 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bd16d-7723-48c4-94d8-04d983e26470 None admin] RBAC: Authorizing `identity:get_project(project_id=319d1fed63bb405d8feff82d2d6e2044)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.590272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bd16d-7723-48c4-94d8-04d983e26470 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.591912 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 577/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/projects/319d1fed63bb405d8feff82d2d6e2044 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:31.597898 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61bbb9-18d7-4889-be3d-57a0daa0bd7c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.691536 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61bbb9-18d7-4889-be3d-57a0daa0bd7c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.724518 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575942f-37b0-419a-953d-94104418099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.725104 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575942f-37b0-419a-953d-94104418099e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.725385 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575942f-37b0-419a-953d-94104418099e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.725658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575942f-37b0-419a-953d-94104418099e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.726477 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575942f-37b0-419a-953d-94104418099e None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=319d1fed63bb405d8feff82d2d6e2044, user.id=2aaa14b791114c1889583d888fafe303) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:31.726790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575942f-37b0-419a-953d-94104418099e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.728251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575942f-37b0-419a-953d-94104418099e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.733960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 569/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/role_assignments?user.id=2aaa14b791114c1889583d888fafe303&scope.project.id=319d1fed63bb405d8feff82d2d6e2044&role.id=67227061f74f48f293a12155e904b5fc => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:33.928343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529f313-bf9f-405e-9046-1f81a952aaee None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:33.928880 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529f313-bf9f-405e-9046-1f81a952aaee None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:33.928968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529f313-bf9f-405e-9046-1f81a952aaee None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:33.930263 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 578/1147] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:33.935446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6589c-0d61-45d6-99fc-8f45aaa2f801 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:33.935879 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6589c-0d61-45d6-99fc-8f45aaa2f801 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:33.936047 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6589c-0d61-45d6-99fc-8f45aaa2f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:33.953532 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-e4f6589c-0d61-45d6-99fc-8f45aaa2f801 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:33.954737 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-e4f6589c-0d61-45d6-99fc-8f45aaa2f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:34.019179 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 570/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:34.042059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529f313-bf9f-405e-9046-1f81a952aaee None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:34.142699 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529f313-bf9f-405e-9046-1f81a952aaee None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:34.178010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb78b-2f2e-4fba-b7a3-39d36fd04908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:34.178801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb78b-2f2e-4fba-b7a3-39d36fd04908 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.179081 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb78b-2f2e-4fba-b7a3-39d36fd04908 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.179350 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb78b-2f2e-4fba-b7a3-39d36fd04908 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:34.189494 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bb78b-2f2e-4fba-b7a3-39d36fd04908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-ef2bb78b-2f2e-4fba-b7a3-39d36fd04908 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:34.197208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:34.198886 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:34.200072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 579/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:34.205849 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6589c-0d61-45d6-99fc-8f45aaa2f801 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:34.331701 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6589c-0d61-45d6-99fc-8f45aaa2f801 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:34.369335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:34.369997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.370814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.371084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:34.371849 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:34.372154 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:34.373518 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:34.388720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 571/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:34.395160 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb78b-2f2e-4fba-b7a3-39d36fd04908 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:34.508236 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb78b-2f2e-4fba-b7a3-39d36fd04908 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:34.548804 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662765f3-aab3-4dd6-bb2d-4e3037335411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:34.549671 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662765f3-aab3-4dd6-bb2d-4e3037335411 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.549951 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662765f3-aab3-4dd6-bb2d-4e3037335411 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.550220 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662765f3-aab3-4dd6-bb2d-4e3037335411 None admin] PATH_INFO: `/v3/users/2aaa14b791114c1889583d888fafe303` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:34.551416 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662765f3-aab3-4dd6-bb2d-4e3037335411 None admin] RBAC: Authorizing `identity:get_user(user_id=2aaa14b791114c1889583d888fafe303)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:34.552882 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662765f3-aab3-4dd6-bb2d-4e3037335411 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:34.554498 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 580/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:34 2022] GET /identity/v3/users/2aaa14b791114c1889583d888fafe303 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:34.560937 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:34.682282 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a8f3b-d2ce-4f9c-8e49-6221c0a86d75 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:34.724025 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce26dc-701f-40c6-9c32-4e45ca79e2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:34.724882 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce26dc-701f-40c6-9c32-4e45ca79e2ec None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.725162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce26dc-701f-40c6-9c32-4e45ca79e2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.725437 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce26dc-701f-40c6-9c32-4e45ca79e2ec None admin] PATH_INFO: `/v3/projects/319d1fed63bb405d8feff82d2d6e2044` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:34.726601 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce26dc-701f-40c6-9c32-4e45ca79e2ec None admin] RBAC: Authorizing `identity:get_project(project_id=319d1fed63bb405d8feff82d2d6e2044)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:34.728060 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce26dc-701f-40c6-9c32-4e45ca79e2ec None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:34.731278 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 572/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:34 2022] GET /identity/v3/projects/319d1fed63bb405d8feff82d2d6e2044 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:34.737850 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662765f3-aab3-4dd6-bb2d-4e3037335411 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:34.846383 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662765f3-aab3-4dd6-bb2d-4e3037335411 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:34.878992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731486b-8ec3-4bd3-9deb-8eee24838dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:34.879893 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731486b-8ec3-4bd3-9deb-8eee24838dd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.880179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731486b-8ec3-4bd3-9deb-8eee24838dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.880456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731486b-8ec3-4bd3-9deb-8eee24838dd3 None admin] PATH_INFO: `/v3/projects/319d1fed63bb405d8feff82d2d6e2044/users/2aaa14b791114c1889583d888fafe303/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:34.882388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731486b-8ec3-4bd3-9deb-8eee24838dd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=319d1fed63bb405d8feff82d2d6e2044, user_id=2aaa14b791114c1889583d888fafe303, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:34.883835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731486b-8ec3-4bd3-9deb-8eee24838dd3 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:34.897542 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 581/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:04:34 2022] PUT /identity/v3/projects/319d1fed63bb405d8feff82d2d6e2044/users/2aaa14b791114c1889583d888fafe303/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:37.077906 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e3a17-bf4e-4cea-918e-efab1e90185e None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.078431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e3a17-bf4e-4cea-918e-efab1e90185e None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.078431 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e3a17-bf4e-4cea-918e-efab1e90185e None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.079827 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 573/1154] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:37.085020 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7807a5-b613-43e3-80ba-fc97763de790 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.085402 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7807a5-b613-43e3-80ba-fc97763de790 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.085577 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7807a5-b613-43e3-80ba-fc97763de790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.101778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ce7807a5-b613-43e3-80ba-fc97763de790 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:37.102961 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ce7807a5-b613-43e3-80ba-fc97763de790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:37.166774 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 582/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:37.189901 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e3a17-bf4e-4cea-918e-efab1e90185e None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:37.289941 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e3a17-bf4e-4cea-918e-efab1e90185e None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:37.321437 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ece5b-ee3d-4b99-a10d-787ce43dae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:37.322214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ece5b-ee3d-4b99-a10d-787ce43dae76 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.322496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ece5b-ee3d-4b99-a10d-787ce43dae76 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.322770 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ece5b-ee3d-4b99-a10d-787ce43dae76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.333672 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ece5b-ee3d-4b99-a10d-787ce43dae76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-d83ece5b-ee3d-4b99-a10d-787ce43dae76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:37.341872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:37.342997 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:37.344041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 574/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:37.349153 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7807a5-b613-43e3-80ba-fc97763de790 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:37.443623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7807a5-b613-43e3-80ba-fc97763de790 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:37.476170 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:37.476823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.477105 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.477381 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.478111 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:37.478418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:37.479846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:37.487463 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 583/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:37.493249 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ece5b-ee3d-4b99-a10d-787ce43dae76 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:37.590832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ece5b-ee3d-4b99-a10d-787ce43dae76 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:37.622818 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece0f6-a44a-415d-b4d8-c290268d6d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:37.623664 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece0f6-a44a-415d-b4d8-c290268d6d30 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.623970 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece0f6-a44a-415d-b4d8-c290268d6d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.624245 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ece0f6-a44a-415d-b4d8-c290268d6d30 None admin] PATH_INFO: `/v3/users/2aaa14b791114c1889583d888fafe303` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.625418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ece0f6-a44a-415d-b4d8-c290268d6d30 None admin] RBAC: Authorizing `identity:get_user(user_id=2aaa14b791114c1889583d888fafe303)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:37.626838 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ece0f6-a44a-415d-b4d8-c290268d6d30 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:37.628483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 575/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:37 2022] GET /identity/v3/users/2aaa14b791114c1889583d888fafe303 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:37.634219 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:37.727121 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6829c2a-dd06-4b04-a5fb-ffb281716735 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:37.759712 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836ee29-c815-4254-82e3-2118eb994667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:37.760380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ee29-c815-4254-82e3-2118eb994667 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.760698 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ee29-c815-4254-82e3-2118eb994667 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.760975 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836ee29-c815-4254-82e3-2118eb994667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.823807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836ee29-c815-4254-82e3-2118eb994667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:37.825247 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836ee29-c815-4254-82e3-2118eb994667 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:37.918582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 584/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:37.924400 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece0f6-a44a-415d-b4d8-c290268d6d30 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:38.018390 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ece0f6-a44a-415d-b4d8-c290268d6d30 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:38.050426 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162e919-635d-4161-87b9-f143b9df8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:38.051265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e919-635d-4161-87b9-f143b9df8705 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:38.051545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e919-635d-4161-87b9-f143b9df8705 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:38.051845 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e919-635d-4161-87b9-f143b9df8705 None admin] PATH_INFO: `/v3/projects/319d1fed63bb405d8feff82d2d6e2044` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:38.052995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162e919-635d-4161-87b9-f143b9df8705 None admin] RBAC: Authorizing `identity:get_project(project_id=319d1fed63bb405d8feff82d2d6e2044)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:38.054406 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162e919-635d-4161-87b9-f143b9df8705 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:38.056104 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 576/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:37 2022] GET /identity/v3/projects/319d1fed63bb405d8feff82d2d6e2044 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:38.062823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836ee29-c815-4254-82e3-2118eb994667 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:38.154486 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836ee29-c815-4254-82e3-2118eb994667 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:38.186166 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c31af-f391-4728-9e3e-2751c5e93b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:38.186807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c31af-f391-4728-9e3e-2751c5e93b07 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:38.187082 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c31af-f391-4728-9e3e-2751c5e93b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:38.187349 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c31af-f391-4728-9e3e-2751c5e93b07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:38.188186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c31af-f391-4728-9e3e-2751c5e93b07 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=319d1fed63bb405d8feff82d2d6e2044, user.id=2aaa14b791114c1889583d888fafe303) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:38.188492 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c31af-f391-4728-9e3e-2751c5e93b07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:38.189894 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c31af-f391-4728-9e3e-2751c5e93b07 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:38.195331 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 585/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:38 2022] GET /identity/v3/role_assignments?user.id=2aaa14b791114c1889583d888fafe303&scope.project.id=319d1fed63bb405d8feff82d2d6e2044&role.id=67227061f74f48f293a12155e904b5fc => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:40.443821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175927-11af-4345-96f9-d01d68dd24ed None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:40.444384 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175927-11af-4345-96f9-d01d68dd24ed None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:40.444384 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a175927-11af-4345-96f9-d01d68dd24ed None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:40.445730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 577/1162] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:40.451544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12ff52-cd6a-40d0-9722-08297d8a4275 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:40.451984 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12ff52-cd6a-40d0-9722-08297d8a4275 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:40.452129 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12ff52-cd6a-40d0-9722-08297d8a4275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:40.468956 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7e12ff52-cd6a-40d0-9722-08297d8a4275 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:40.470158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7e12ff52-cd6a-40d0-9722-08297d8a4275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:40.533766 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 586/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:40.556665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a175927-11af-4345-96f9-d01d68dd24ed None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:40.653421 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a175927-11af-4345-96f9-d01d68dd24ed None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:40.686588 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96e8c-d209-4072-a320-c3a6ae3a55bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:40.687214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96e8c-d209-4072-a320-c3a6ae3a55bd None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:40.687496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96e8c-d209-4072-a320-c3a6ae3a55bd None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:40.687793 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96e8c-d209-4072-a320-c3a6ae3a55bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:40.751229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96e8c-d209-4072-a320-c3a6ae3a55bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:40.752637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96e8c-d209-4072-a320-c3a6ae3a55bd None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:40.845539 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 578/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:40.851418 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12ff52-cd6a-40d0-9722-08297d8a4275 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:40.945867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12ff52-cd6a-40d0-9722-08297d8a4275 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:40.978132 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa10055-fd5d-4696-8b70-322f00bffbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:40.978917 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa10055-fd5d-4696-8b70-322f00bffbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:40.979196 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa10055-fd5d-4696-8b70-322f00bffbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:40.980011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa10055-fd5d-4696-8b70-322f00bffbd0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:40.986421 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa10055-fd5d-4696-8b70-322f00bffbd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:40.987881 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa10055-fd5d-4696-8b70-322f00bffbd0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-3fa10055-fd5d-4696-8b70-322f00bffbd0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:41.002075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:41.003532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:41.004841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 587/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:04:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:41.009013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96e8c-d209-4072-a320-c3a6ae3a55bd None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:41.103237 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96e8c-d209-4072-a320-c3a6ae3a55bd None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:41.135790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b05ed-1233-4bb7-bd05-7fcabe50da2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:41.136509 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b05ed-1233-4bb7-bd05-7fcabe50da2b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:41.136791 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b05ed-1233-4bb7-bd05-7fcabe50da2b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:41.137067 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b05ed-1233-4bb7-bd05-7fcabe50da2b None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:41.137786 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b05ed-1233-4bb7-bd05-7fcabe50da2b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:41.138093 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b05ed-1233-4bb7-bd05-7fcabe50da2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:41.139452 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b05ed-1233-4bb7-bd05-7fcabe50da2b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:41.146319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 579/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:04:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:43.371923 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59bb0-8073-4ec4-bae7-1ea99a6aacf0 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:43.372450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59bb0-8073-4ec4-bae7-1ea99a6aacf0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:43.372450 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59bb0-8073-4ec4-bae7-1ea99a6aacf0 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:43.373742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 588/1167] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:43.379081 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfbeb9-f909-45e0-b331-719712bc3222 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:43.379481 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfbeb9-f909-45e0-b331-719712bc3222 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:43.379630 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfbeb9-f909-45e0-b331-719712bc3222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:43.396398 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-efdfbeb9-f909-45e0-b331-719712bc3222 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:43.397573 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-efdfbeb9-f909-45e0-b331-719712bc3222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:43.460834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 580/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:43.483925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59bb0-8073-4ec4-bae7-1ea99a6aacf0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:43.580266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59bb0-8073-4ec4-bae7-1ea99a6aacf0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:43.611399 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b125-1a07-43f3-b856-cb2122e5c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:43.612072 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b125-1a07-43f3-b856-cb2122e5c3e8 None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:43.612357 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b125-1a07-43f3-b856-cb2122e5c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:43.612634 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b125-1a07-43f3-b856-cb2122e5c3e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:43.613376 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b125-1a07-43f3-b856-cb2122e5c3e8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:43.614727 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b125-1a07-43f3-b856-cb2122e5c3e8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:43.629079 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 589/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Mon May 9 15:04:43 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:45.907095 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbeaf1-6976-4d38-9b0f-64f07a7ccbf6 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:45.907652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbeaf1-6976-4d38-9b0f-64f07a7ccbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:45.907652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbeaf1-6976-4d38-9b0f-64f07a7ccbf6 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:45.909039 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 581/1170] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:45.914170 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b136-68b7-4c43-aa3f-d1662e9fef8f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:45.914561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b136-68b7-4c43-aa3f-d1662e9fef8f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:45.914719 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b136-68b7-4c43-aa3f-d1662e9fef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:45.939325 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7c62b136-68b7-4c43-aa3f-d1662e9fef8f None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:45.940618 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7c62b136-68b7-4c43-aa3f-d1662e9fef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:46.004318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 590/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:46.028682 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbeaf1-6976-4d38-9b0f-64f07a7ccbf6 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:46.127475 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbeaf1-6976-4d38-9b0f-64f07a7ccbf6 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:46.160566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47305ac-858f-4892-9742-ee3b54a2ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:46.161348 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47305ac-858f-4892-9742-ee3b54a2ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.161627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47305ac-858f-4892-9742-ee3b54a2ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.161903 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47305ac-858f-4892-9742-ee3b54a2ebe3 None admin] PATH_INFO: `/v3/domains/1b34241dc0f04797a8d14c114dc36490` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.172955 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47305ac-858f-4892-9742-ee3b54a2ebe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b34241dc0f04797a8d14c114dc36490)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:46.174379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47305ac-858f-4892-9742-ee3b54a2ebe3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:46.176016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 582/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 9 15:04:46 2022] GET /identity/v3/domains/1b34241dc0f04797a8d14c114dc36490 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:46.181747 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b136-68b7-4c43-aa3f-d1662e9fef8f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:46.274343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b136-68b7-4c43-aa3f-d1662e9fef8f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:46.308110 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1420f-31c1-4cc6-93b8-1eaca676a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:46.308754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1420f-31c1-4cc6-93b8-1eaca676a46c None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.309035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1420f-31c1-4cc6-93b8-1eaca676a46c None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.309304 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1420f-31c1-4cc6-93b8-1eaca676a46c None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.310009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1420f-31c1-4cc6-93b8-1eaca676a46c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:46.311427 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1420f-31c1-4cc6-93b8-1eaca676a46c None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:46.336174 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 591/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:04:46 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:48.577810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82cf1-d37b-4483-92bf-5dd664a23f1d None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.578371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82cf1-d37b-4483-92bf-5dd664a23f1d None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.578371 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82cf1-d37b-4483-92bf-5dd664a23f1d None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.579707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 583/1174] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:48.585191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9b4c-7e40-4a45-9773-d0798f948a12 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.585574 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9b4c-7e40-4a45-9773-d0798f948a12 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.585740 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9b4c-7e40-4a45-9773-d0798f948a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.602161 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-487d9b4c-7e40-4a45-9773-d0798f948a12 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:48.603324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-487d9b4c-7e40-4a45-9773-d0798f948a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:48.665802 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 592/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:48.690889 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf82cf1-d37b-4483-92bf-5dd664a23f1d None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.785496 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf82cf1-d37b-4483-92bf-5dd664a23f1d None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.817512 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61eefc-cb94-4138-bc8d-27a6a4a833cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.818357 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61eefc-cb94-4138-bc8d-27a6a4a833cb None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.818636 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61eefc-cb94-4138-bc8d-27a6a4a833cb None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.818913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61eefc-cb94-4138-bc8d-27a6a4a833cb None admin] PATH_INFO: `/v3/domains/1b34241dc0f04797a8d14c114dc36490` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.820094 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61eefc-cb94-4138-bc8d-27a6a4a833cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=1b34241dc0f04797a8d14c114dc36490)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.821506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61eefc-cb94-4138-bc8d-27a6a4a833cb None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.823298 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 584/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/domains/1b34241dc0f04797a8d14c114dc36490 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:48.829334 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9b4c-7e40-4a45-9773-d0798f948a12 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.944230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9b4c-7e40-4a45-9773-d0798f948a12 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.977453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce616add-13fa-4085-b6cf-973fc86a606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.978108 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616add-13fa-4085-b6cf-973fc86a606f None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.978385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616add-13fa-4085-b6cf-973fc86a606f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.978657 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce616add-13fa-4085-b6cf-973fc86a606f None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.979997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce616add-13fa-4085-b6cf-973fc86a606f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.981413 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce616add-13fa-4085-b6cf-973fc86a606f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:49.000587 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 593/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:04:48 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:51.240201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95374951-9926-4c85-b15b-ceade744d1ef None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.240735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95374951-9926-4c85-b15b-ceade744d1ef None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.240828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95374951-9926-4c85-b15b-ceade744d1ef None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.242118 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 585/1178] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:51.247969 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06a44-6dd5-460c-a775-b0904bb4641f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.248365 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06a44-6dd5-460c-a775-b0904bb4641f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.248538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a06a44-6dd5-460c-a775-b0904bb4641f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.265271 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-89a06a44-6dd5-460c-a775-b0904bb4641f None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:51.266429 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-89a06a44-6dd5-460c-a775-b0904bb4641f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:51.328875 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 594/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:51.352076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95374951-9926-4c85-b15b-ceade744d1ef None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:51.448614 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95374951-9926-4c85-b15b-ceade744d1ef None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:51.480358 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14f4d-864e-448b-9387-73d9abae6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:51.481135 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14f4d-864e-448b-9387-73d9abae6afc None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.481415 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14f4d-864e-448b-9387-73d9abae6afc None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.481685 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14f4d-864e-448b-9387-73d9abae6afc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.491598 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b14f4d-864e-448b-9387-73d9abae6afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-e7b14f4d-864e-448b-9387-73d9abae6afc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:51.499707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:51.500855 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:51.501923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 586/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:51.506888 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a06a44-6dd5-460c-a775-b0904bb4641f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:51.599844 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a06a44-6dd5-460c-a775-b0904bb4641f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:51.631721 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:51.632342 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.632622 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.632894 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.633624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:51.633928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:51.635948 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:51.643502 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 595/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:51.649235 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14f4d-864e-448b-9387-73d9abae6afc None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:51.744203 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14f4d-864e-448b-9387-73d9abae6afc None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:51.777402 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b943d2-18d4-42e7-8340-0e47118f8fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:51.778246 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b943d2-18d4-42e7-8340-0e47118f8fcf None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.778530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b943d2-18d4-42e7-8340-0e47118f8fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.778807 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b943d2-18d4-42e7-8340-0e47118f8fcf None admin] PATH_INFO: `/v3/users/b56e63691dc54216aaa915a05fa71bb9` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b943d2-18d4-42e7-8340-0e47118f8fcf None admin] RBAC: Authorizing `identity:get_user(user_id=b56e63691dc54216aaa915a05fa71bb9)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:51.793204 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b943d2-18d4-42e7-8340-0e47118f8fcf None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:51.794815 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 587/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:51 2022] GET /identity/v3/users/b56e63691dc54216aaa915a05fa71bb9 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:51.800369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:51.904248 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b29f-668c-48df-b336-555fa17b2e16 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:51.935800 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1b756-5d0c-45e4-9ec4-4b0c9dedc7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:51.936434 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b756-5d0c-45e4-9ec4-4b0c9dedc7fc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.936713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b756-5d0c-45e4-9ec4-4b0c9dedc7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.937010 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1b756-5d0c-45e4-9ec4-4b0c9dedc7fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.000257 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1b756-5d0c-45e4-9ec4-4b0c9dedc7fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:52.001798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1b756-5d0c-45e4-9ec4-4b0c9dedc7fc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:52.092473 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 596/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:52.098239 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b943d2-18d4-42e7-8340-0e47118f8fcf None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.191632 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b943d2-18d4-42e7-8340-0e47118f8fcf None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.223494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba426642-389a-4c47-99d0-3bec12bc39ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.224367 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426642-389a-4c47-99d0-3bec12bc39ad None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.224648 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426642-389a-4c47-99d0-3bec12bc39ad None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.224921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426642-389a-4c47-99d0-3bec12bc39ad None admin] PATH_INFO: `/v3/projects/ebda539141464de989009b4d8827a058` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.226067 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba426642-389a-4c47-99d0-3bec12bc39ad None admin] RBAC: Authorizing `identity:get_project(project_id=ebda539141464de989009b4d8827a058)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:52.227474 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba426642-389a-4c47-99d0-3bec12bc39ad None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:52.229231 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 588/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:52 2022] GET /identity/v3/projects/ebda539141464de989009b4d8827a058 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:52.235300 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1b756-5d0c-45e4-9ec4-4b0c9dedc7fc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.331461 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1b756-5d0c-45e4-9ec4-4b0c9dedc7fc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.363538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d1db2-eabe-493b-b2df-80fbd525ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.364207 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d1db2-eabe-493b-b2df-80fbd525ff23 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.364490 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d1db2-eabe-493b-b2df-80fbd525ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.364763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d1db2-eabe-493b-b2df-80fbd525ff23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.365668 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d1db2-eabe-493b-b2df-80fbd525ff23 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=ebda539141464de989009b4d8827a058, user.id=b56e63691dc54216aaa915a05fa71bb9) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:52.365979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d1db2-eabe-493b-b2df-80fbd525ff23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:52.367407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d1db2-eabe-493b-b2df-80fbd525ff23 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:52.373218 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 597/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:52 2022] GET /identity/v3/role_assignments?user.id=b56e63691dc54216aaa915a05fa71bb9&scope.project.id=ebda539141464de989009b4d8827a058&role.id=67227061f74f48f293a12155e904b5fc => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:54.611902 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c116a7-f609-40aa-9a15-1db16e501412 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.612455 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c116a7-f609-40aa-9a15-1db16e501412 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.612455 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c116a7-f609-40aa-9a15-1db16e501412 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.613818 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 589/1186] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:54.619075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56994a00-ed9a-434f-a437-e267445290ed None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.619490 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56994a00-ed9a-434f-a437-e267445290ed None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.619878 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56994a00-ed9a-434f-a437-e267445290ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.636312 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-56994a00-ed9a-434f-a437-e267445290ed None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:54.637454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-56994a00-ed9a-434f-a437-e267445290ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:54.699384 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 598/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:54.722564 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c116a7-f609-40aa-9a15-1db16e501412 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.817663 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c116a7-f609-40aa-9a15-1db16e501412 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:54.850338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36542c8-167c-492c-9b8f-296e8a62d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:54.851116 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36542c8-167c-492c-9b8f-296e8a62d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.851395 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36542c8-167c-492c-9b8f-296e8a62d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.851666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36542c8-167c-492c-9b8f-296e8a62d8e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.861390 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36542c8-167c-492c-9b8f-296e8a62d8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-f36542c8-167c-492c-9b8f-296e8a62d8e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:54.868989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:54.870483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:04:54.871347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 590/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:54.876444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56994a00-ed9a-434f-a437-e267445290ed None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.969855 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56994a00-ed9a-434f-a437-e267445290ed None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.001742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.002397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.002679 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.002949 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.003678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:55.004009 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:55.005373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:55.013066 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 599/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:55.018980 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36542c8-167c-492c-9b8f-296e8a62d8e2 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:55.115233 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36542c8-167c-492c-9b8f-296e8a62d8e2 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.146309 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edef58-86f9-4715-b7ce-0c492064252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.147104 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edef58-86f9-4715-b7ce-0c492064252a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.147379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edef58-86f9-4715-b7ce-0c492064252a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.147649 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edef58-86f9-4715-b7ce-0c492064252a None admin] PATH_INFO: `/v3/users/b56e63691dc54216aaa915a05fa71bb9` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.148833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edef58-86f9-4715-b7ce-0c492064252a None admin] RBAC: Authorizing `identity:get_user(user_id=b56e63691dc54216aaa915a05fa71bb9)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:55.150242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23edef58-86f9-4715-b7ce-0c492064252a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:55.152484 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 591/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:55 2022] GET /identity/v3/users/b56e63691dc54216aaa915a05fa71bb9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:55.158212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:55.256587 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8906c-f6f4-45ea-9ff9-7f26d9433d97 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.287952 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e55908-0ab2-42eb-a823-f3ddb1e90cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.288792 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55908-0ab2-42eb-a823-f3ddb1e90cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.289071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55908-0ab2-42eb-a823-f3ddb1e90cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.289344 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e55908-0ab2-42eb-a823-f3ddb1e90cb2 None admin] PATH_INFO: `/v3/projects/ebda539141464de989009b4d8827a058` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.290509 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e55908-0ab2-42eb-a823-f3ddb1e90cb2 None admin] RBAC: Authorizing `identity:get_project(project_id=ebda539141464de989009b4d8827a058)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:55.292600 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e55908-0ab2-42eb-a823-f3ddb1e90cb2 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:55.294286 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 600/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:55 2022] GET /identity/v3/projects/ebda539141464de989009b4d8827a058 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:55.300250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edef58-86f9-4715-b7ce-0c492064252a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:55.395471 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edef58-86f9-4715-b7ce-0c492064252a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.427365 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094dfaa-b2ea-4d28-b8d7-eacc222207a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.428185 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094dfaa-b2ea-4d28-b8d7-eacc222207a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.428464 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094dfaa-b2ea-4d28-b8d7-eacc222207a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.428734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094dfaa-b2ea-4d28-b8d7-eacc222207a9 None admin] PATH_INFO: `/v3/projects/ebda539141464de989009b4d8827a058/users/b56e63691dc54216aaa915a05fa71bb9/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.430655 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094dfaa-b2ea-4d28-b8d7-eacc222207a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebda539141464de989009b4d8827a058, user_id=b56e63691dc54216aaa915a05fa71bb9, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:55.432684 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094dfaa-b2ea-4d28-b8d7-eacc222207a9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:55.444832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 592/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:04:55 2022] PUT /identity/v3/projects/ebda539141464de989009b4d8827a058/users/b56e63691dc54216aaa915a05fa71bb9/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:57.631968 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9b11-93a3-4ff9-87a0-73a66edfd8d0 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.632525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9b11-93a3-4ff9-87a0-73a66edfd8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.632525 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9b11-93a3-4ff9-87a0-73a66edfd8d0 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.633879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 601/1193] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:57.639817 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944109-60e1-4eea-9edc-a1cd8bbda684 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.640224 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944109-60e1-4eea-9edc-a1cd8bbda684 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.640378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37944109-60e1-4eea-9edc-a1cd8bbda684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.657045 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-37944109-60e1-4eea-9edc-a1cd8bbda684 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:57.658202 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-37944109-60e1-4eea-9edc-a1cd8bbda684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:57.720774 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 593/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:04:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:04:57.743821 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d9b11-93a3-4ff9-87a0-73a66edfd8d0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:57.839354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d9b11-93a3-4ff9-87a0-73a66edfd8d0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:57.871617 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56f37-7cce-4b1c-a457-6abb6ff34d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:57.872411 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56f37-7cce-4b1c-a457-6abb6ff34d28 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.872691 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56f37-7cce-4b1c-a457-6abb6ff34d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.872960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56f37-7cce-4b1c-a457-6abb6ff34d28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.882709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56f37-7cce-4b1c-a457-6abb6ff34d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-06c56f37-7cce-4b1c-a457-6abb6ff34d28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:57.890464 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:57.891407 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:04:57.892296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 602/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:57.897700 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944109-60e1-4eea-9edc-a1cd8bbda684 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:57.991862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37944109-60e1-4eea-9edc-a1cd8bbda684 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.024145 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.024797 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.025076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.025870 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.026599 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:58.026899 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.028837 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.036961 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 594/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:58.043380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56f37-7cce-4b1c-a457-6abb6ff34d28 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.137698 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56f37-7cce-4b1c-a457-6abb6ff34d28 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.169504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd502-8bee-4d5e-84c5-370685de08d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.170358 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd502-8bee-4d5e-84c5-370685de08d5 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.170642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd502-8bee-4d5e-84c5-370685de08d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.170925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dd502-8bee-4d5e-84c5-370685de08d5 None admin] PATH_INFO: `/v3/users/b56e63691dc54216aaa915a05fa71bb9` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.172121 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dd502-8bee-4d5e-84c5-370685de08d5 None admin] RBAC: Authorizing `identity:get_user(user_id=b56e63691dc54216aaa915a05fa71bb9)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.173543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dd502-8bee-4d5e-84c5-370685de08d5 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.175137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 603/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/users/b56e63691dc54216aaa915a05fa71bb9 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:58.180993 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.274854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd895fb-91d3-4d16-90b1-7c508aa1e78e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.308071 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783170d8-7106-4034-a884-acfcae6dce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.308711 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783170d8-7106-4034-a884-acfcae6dce39 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.308992 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783170d8-7106-4034-a884-acfcae6dce39 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.309265 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783170d8-7106-4034-a884-acfcae6dce39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.372362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783170d8-7106-4034-a884-acfcae6dce39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.373786 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783170d8-7106-4034-a884-acfcae6dce39 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.466781 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 595/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:04:58.472718 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd502-8bee-4d5e-84c5-370685de08d5 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.568829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dd502-8bee-4d5e-84c5-370685de08d5 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.600485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e9f8e-912f-4ff2-9acf-2b45a63354ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.601322 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9f8e-912f-4ff2-9acf-2b45a63354ec None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.601599 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9f8e-912f-4ff2-9acf-2b45a63354ec None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.601867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e9f8e-912f-4ff2-9acf-2b45a63354ec None admin] PATH_INFO: `/v3/projects/ebda539141464de989009b4d8827a058` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.603012 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e9f8e-912f-4ff2-9acf-2b45a63354ec None admin] RBAC: Authorizing `identity:get_project(project_id=ebda539141464de989009b4d8827a058)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.605457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e9f8e-912f-4ff2-9acf-2b45a63354ec None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.607101 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 604/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/projects/ebda539141464de989009b4d8827a058 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:58.613100 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783170d8-7106-4034-a884-acfcae6dce39 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.705606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783170d8-7106-4034-a884-acfcae6dce39 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.738256 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8861-c62c-4f80-a7c7-2323739a9fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.738833 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8861-c62c-4f80-a7c7-2323739a9fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.739113 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8861-c62c-4f80-a7c7-2323739a9fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.739386 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8861-c62c-4f80-a7c7-2323739a9fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.740234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8861-c62c-4f80-a7c7-2323739a9fb7 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=ebda539141464de989009b4d8827a058, user.id=b56e63691dc54216aaa915a05fa71bb9) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:58.740544 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8861-c62c-4f80-a7c7-2323739a9fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.741958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8861-c62c-4f80-a7c7-2323739a9fb7 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.748321 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 596/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/role_assignments?user.id=b56e63691dc54216aaa915a05fa71bb9&scope.project.id=ebda539141464de989009b4d8827a058&role.id=67227061f74f48f293a12155e904b5fc => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:59.933457 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9b77-b853-4b21-9775-6171410cc42f None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.934077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9b77-b853-4b21-9775-6171410cc42f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.934077 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9b77-b853-4b21-9775-6171410cc42f None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.935446 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 605/1201] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:59.942164 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217955-8a11-4e6c-9108-1f8419654cf1 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.942699 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217955-8a11-4e6c-9108-1f8419654cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.942699 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd217955-8a11-4e6c-9108-1f8419654cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.962379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-cd217955-8a11-4e6c-9108-1f8419654cf1 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:59.963712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-cd217955-8a11-4e6c-9108-1f8419654cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:00.046827 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 597/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:05:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:00.072264 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9b77-b853-4b21-9775-6171410cc42f None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.188894 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9b77-b853-4b21-9775-6171410cc42f None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.226482 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.227252 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.227519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.227808 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.238394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.240031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:00.259385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:00.260504 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:00.262045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:00.262045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:00.262045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:00.262045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:00.262045 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 606/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:00.268792 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217955-8a11-4e6c-9108-1f8419654cf1 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.370146 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd217955-8a11-4e6c-9108-1f8419654cf1 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.405629 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67381b66-0898-4a36-9bab-7f2a4b3ff00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.406300 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67381b66-0898-4a36-9bab-7f2a4b3ff00d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.406583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67381b66-0898-4a36-9bab-7f2a4b3ff00d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.406863 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67381b66-0898-4a36-9bab-7f2a4b3ff00d None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.407586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67381b66-0898-4a36-9bab-7f2a4b3ff00d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:00.407930 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67381b66-0898-4a36-9bab-7f2a4b3ff00d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.409297 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67381b66-0898-4a36-9bab-7f2a4b3ff00d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.421795 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 598/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:00.427645 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.536543 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fbaf7-d2b5-44a9-ac3d-b1446d5bd16d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.571885 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d279d2-b8dc-4b99-93ae-cd9813f2c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.572553 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d279d2-b8dc-4b99-93ae-cd9813f2c22a None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.572871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d279d2-b8dc-4b99-93ae-cd9813f2c22a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.573107 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d279d2-b8dc-4b99-93ae-cd9813f2c22a None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.573846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d279d2-b8dc-4b99-93ae-cd9813f2c22a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.575483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d279d2-b8dc-4b99-93ae-cd9813f2c22a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.596862 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 607/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:06:00 2022] POST /identity/v3/users => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:03.146533 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8c21d-8a94-4417-a413-ccfdb254aa46 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.147237 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8c21d-8a94-4417-a413-ccfdb254aa46 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.147237 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8c21d-8a94-4417-a413-ccfdb254aa46 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.148872 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 599/1206] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:03.154349 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c1be-ddfe-40b4-a090-ed46fd1440cc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.154957 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c1be-ddfe-40b4-a090-ed46fd1440cc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.154957 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c1be-ddfe-40b4-a090-ed46fd1440cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.172757 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-5a33c1be-ddfe-40b4-a090-ed46fd1440cc None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:03.173994 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-5a33c1be-ddfe-40b4-a090-ed46fd1440cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:03.248014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 608/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:03.271293 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8c21d-8a94-4417-a413-ccfdb254aa46 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.389512 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8c21d-8a94-4417-a413-ccfdb254aa46 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:03.427580 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a0a30-a0f4-40da-bef9-175487f54aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:03.428563 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0a30-a0f4-40da-bef9-175487f54aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.428846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0a30-a0f4-40da-bef9-175487f54aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.429119 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0a30-a0f4-40da-bef9-175487f54aa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.440294 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a0a30-a0f4-40da-bef9-175487f54aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-9a2a0a30-a0f4-40da-bef9-175487f54aa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:03.448472 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:03.449561 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:03.451253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 600/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:06:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:03.456317 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33c1be-ddfe-40b4-a090-ed46fd1440cc None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.573600 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33c1be-ddfe-40b4-a090-ed46fd1440cc None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:03.612212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:03.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.613199 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.613606 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.614385 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:03.614737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:03.617205 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:03.626517 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 609/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:06:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:03.632776 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a0a30-a0f4-40da-bef9-175487f54aa5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.749259 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a0a30-a0f4-40da-bef9-175487f54aa5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:03.785982 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:03.786877 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.787229 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.787574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.798593 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:03.800134 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:03.821639 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:03.822854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:03.824040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:03.824040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:03.824040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:03.824040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:03.825121 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 601/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:03.831532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.944123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51817d-0ff8-4810-b082-2f915014fcd8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:03.985369 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:03.986054 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.986359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.986660 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.987451 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:03.987815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:03.989232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:04.004065 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 610/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:04.010124 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:04.119079 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0248716-92fa-44be-a5d7-b2e10bd33730 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.156215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.157022 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.157290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.157556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.165750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:04.167173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:04.185555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:04.186641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:04.192713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 602/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:04.196847 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:04.323524 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc8712-95e6-47e0-91e7-a504660f24a6 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.364272 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.364945 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.365217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.365490 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.366389 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:04.366682 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:04.368125 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:04.387758 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 611/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:06:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:04.393507 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:04.509181 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c7125-a9c8-4c9c-accf-8fca3832bd4c None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.547822 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422511-551a-44b8-852f-2d32c0f05849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.548514 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422511-551a-44b8-852f-2d32c0f05849 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.548835 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422511-551a-44b8-852f-2d32c0f05849 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.549168 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27422511-551a-44b8-852f-2d32c0f05849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.621215 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422511-551a-44b8-852f-2d32c0f05849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:04.622590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27422511-551a-44b8-852f-2d32c0f05849 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:04.732628 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 603/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:06:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:04.738752 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:04.853628 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179fc30-7640-4c22-96f9-291c7dd8681e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.893123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.893780 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.894062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.894338 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.906379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:04.907988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:04.927709 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:04.929280 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:04.930261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:04.930261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:04.930261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:04.930261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:04.930261 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 612/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:04.935617 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422511-551a-44b8-852f-2d32c0f05849 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.054198 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27422511-551a-44b8-852f-2d32c0f05849 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.093090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.093904 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.094353 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.094688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.095756 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:05.096207 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.097810 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.115814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 604/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:05.118882 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.236834 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670efaca-798f-4b46-842b-bff1f416bc77 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.278953 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.279928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.282827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.282827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.289745 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.291451 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:05.307866 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:05.310801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:05.311710 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 613/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:05.315409 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.435081 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460716b-1ebb-4e64-89c0-950e8c58eab9 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.479583 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e524a4b-6752-493e-bb40-5665b5b23e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.480302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e524a4b-6752-493e-bb40-5665b5b23e19 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.480588 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e524a4b-6752-493e-bb40-5665b5b23e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.480864 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e524a4b-6752-493e-bb40-5665b5b23e19 None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.481680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e524a4b-6752-493e-bb40-5665b5b23e19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:05.482013 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e524a4b-6752-493e-bb40-5665b5b23e19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.483603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e524a4b-6752-493e-bb40-5665b5b23e19 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.497689 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 605/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:05.504064 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.626967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811af009-22b6-44c5-aeb5-be2a9887112a None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.668148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348fce5-0f98-47d3-80fe-9a6853c7e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.668801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348fce5-0f98-47d3-80fe-9a6853c7e990 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.669081 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348fce5-0f98-47d3-80fe-9a6853c7e990 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.669351 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348fce5-0f98-47d3-80fe-9a6853c7e990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.670179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348fce5-0f98-47d3-80fe-9a6853c7e990 None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=c51cf23836aa4601b54d7a7369cef09f) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:05.670483 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348fce5-0f98-47d3-80fe-9a6853c7e990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.671934 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348fce5-0f98-47d3-80fe-9a6853c7e990 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.677992 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 614/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/role_assignments?user.id=c51cf23836aa4601b54d7a7369cef09f&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:07.981146 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb17f8-48b7-4f3f-b11a-ad0771a6e215 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.981697 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb17f8-48b7-4f3f-b11a-ad0771a6e215 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.981697 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb17f8-48b7-4f3f-b11a-ad0771a6e215 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.983354 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 606/1220] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:07.988856 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559887f-b5a9-4380-8c38-e690e8b53b61 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.989325 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559887f-b5a9-4380-8c38-e690e8b53b61 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.989426 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559887f-b5a9-4380-8c38-e690e8b53b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.008402 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-7559887f-b5a9-4380-8c38-e690e8b53b61 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:08.009783 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-7559887f-b5a9-4380-8c38-e690e8b53b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:08.088828 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 615/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:08.116857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb17f8-48b7-4f3f-b11a-ad0771a6e215 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.239228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb17f8-48b7-4f3f-b11a-ad0771a6e215 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.279661 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77939e4-74e2-4014-bb4d-4eb5b1cf7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.280607 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77939e4-74e2-4014-bb4d-4eb5b1cf7089 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.280984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77939e4-74e2-4014-bb4d-4eb5b1cf7089 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.281333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77939e4-74e2-4014-bb4d-4eb5b1cf7089 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.294779 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77939e4-74e2-4014-bb4d-4eb5b1cf7089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-d77939e4-74e2-4014-bb4d-4eb5b1cf7089 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:08.304290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:08.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:08.306379 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 607/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:08.312037 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559887f-b5a9-4380-8c38-e690e8b53b61 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.427219 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559887f-b5a9-4380-8c38-e690e8b53b61 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.465169 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.465997 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.466288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.466712 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.467591 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:08.467972 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.469586 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.479505 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 616/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:08.486003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77939e4-74e2-4014-bb4d-4eb5b1cf7089 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.603910 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77939e4-74e2-4014-bb4d-4eb5b1cf7089 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.639075 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.639934 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.640183 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.640506 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.652096 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.653537 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:08.671318 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:08.672640 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:08.673585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:08.673585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:08.673585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:08.673585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:08.673585 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 608/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:08.678737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.787127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d5800-5271-4b44-b500-6f5f851996a7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.823588 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.824298 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.824829 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.825159 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.825911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:08.826217 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.827661 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.840541 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 617/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:08.846873 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.957076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72311b-d45a-4ca6-969e-d0f3fa7bd6b3 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.999555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.000425 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.000755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.001226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.011983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.013549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:09.030131 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:09.031276 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:09.032566 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 609/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:09.038346 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.150797 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bd09-e1f4-4c6e-9b9c-10703a70531e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.187148 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.187924 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.188208 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.188484 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.189318 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:09.189629 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.191150 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.209263 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 618/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:09.215275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.317637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfeffa-e4c3-4bbb-a1d1-055fcaa46fb5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.355695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.356958 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.357266 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.357667 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.370530 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.372239 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:09.390813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:09.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:09.392871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:09.392871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:09.392871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:09.392871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:09.392871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 610/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:09.398763 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.503790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687cb65-58c2-472f-a85c-163922cf1cda None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.541394 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.542087 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.542347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.542620 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.543343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:09.543653 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.545061 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.557472 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 619/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:09.565034 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.675680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8f3d7-fe61-4fd7-a2c9-3754173700e5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.713054 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.713962 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.714244 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.714534 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.721823 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.723393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:09.738616 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:09.739784 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:09.740862 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 611/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:09.746827 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.850899 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f000b7-fd1b-431d-b9ae-d7f5bc7bf87d None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.885801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee48a1-b46e-49d1-b75f-f0f042bfb695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.886489 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee48a1-b46e-49d1-b75f-f0f042bfb695 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.886787 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee48a1-b46e-49d1-b75f-f0f042bfb695 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.887093 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee48a1-b46e-49d1-b75f-f0f042bfb695 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.887965 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee48a1-b46e-49d1-b75f-f0f042bfb695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:09.888275 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee48a1-b46e-49d1-b75f-f0f042bfb695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.889696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee48a1-b46e-49d1-b75f-f0f042bfb695 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.902621 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 620/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:09.908921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.020764 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fe091-9b0a-4380-a929-a32b8e7dd918 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.058186 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8569782-d268-4787-ba55-1aabaa63cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.059238 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569782-d268-4787-ba55-1aabaa63cc8a None admin] REQUEST_METHOD: `PUT` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.059643 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569782-d268-4787-ba55-1aabaa63cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.060008 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8569782-d268-4787-ba55-1aabaa63cc8a None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/c51cf23836aa4601b54d7a7369cef09f/roles/24a80586c13847a5b38391521300ce84` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.077128 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8569782-d268-4787-ba55-1aabaa63cc8a None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=c51cf23836aa4601b54d7a7369cef09f, role_id=24a80586c13847a5b38391521300ce84)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.078896 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8569782-d268-4787-ba55-1aabaa63cc8a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:10.093938 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 612/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:06:09 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/c51cf23836aa4601b54d7a7369cef09f/roles/24a80586c13847a5b38391521300ce84 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:12.442565 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5933-3ca7-4224-97d7-8c093efb2ef3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.443191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5933-3ca7-4224-97d7-8c093efb2ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.443191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5933-3ca7-4224-97d7-8c093efb2ef3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.445047 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 621/1233] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:12.450790 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea39d44-470f-41f4-9e0b-2b2711450a9a None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.451235 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea39d44-470f-41f4-9e0b-2b2711450a9a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.451345 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea39d44-470f-41f4-9e0b-2b2711450a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.467869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-cea39d44-470f-41f4-9e0b-2b2711450a9a None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:12.469221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-cea39d44-470f-41f4-9e0b-2b2711450a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:12.545787 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 613/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:12.575373 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc5933-3ca7-4224-97d7-8c093efb2ef3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:12.701254 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc5933-3ca7-4224-97d7-8c093efb2ef3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:12.737519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b0d4-3972-4fad-94fd-f72925e8a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:12.738431 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b0d4-3972-4fad-94fd-f72925e8a002 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.738741 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b0d4-3972-4fad-94fd-f72925e8a002 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.739048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b0d4-3972-4fad-94fd-f72925e8a002 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.750522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7b0d4-3972-4fad-94fd-f72925e8a002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-42b7b0d4-3972-4fad-94fd-f72925e8a002 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:12.760485 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:12.761836 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:12.762819 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 622/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:06:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:12.767919 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea39d44-470f-41f4-9e0b-2b2711450a9a None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:12.884290 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea39d44-470f-41f4-9e0b-2b2711450a9a None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:12.919258 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:12.919975 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.920267 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.920546 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.921312 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:12.921610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:12.922988 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:12.935562 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 614/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:12.943902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b0d4-3972-4fad-94fd-f72925e8a002 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.067630 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b0d4-3972-4fad-94fd-f72925e8a002 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.108109 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.109075 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.109376 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.109794 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.123260 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.124731 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:13.143152 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:13.144223 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:13.150186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:13.150186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:13.150186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:13.150186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:13.150186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 623/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:13.150653 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.264304 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e4c97-7620-46ae-878b-06a3d1167c4f None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.296595 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.297351 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.297704 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.298012 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.298814 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:13.299121 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.300813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:13.313293 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 615/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:13.320428 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.434892 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd92f5-2120-4765-a767-c95a44615a87 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.473713 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.474511 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.475870 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.476293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.484873 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.486432 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:13.504692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:13.506062 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:13.507388 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 624/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:13.512311 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.626225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486be40-f31a-43eb-bf94-df4ed42a7444 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.660796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.661480 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.661751 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.662023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.663606 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:13.663971 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.665390 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:13.685201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 616/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:13.691197 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.799558 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf559d9-0adf-4a5c-ad13-d01c7604126e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.837395 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e924a-e96e-4374-8d10-e9b37e0f7468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.838016 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e924a-e96e-4374-8d10-e9b37e0f7468 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.838290 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e924a-e96e-4374-8d10-e9b37e0f7468 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.838561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e924a-e96e-4374-8d10-e9b37e0f7468 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.912613 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e924a-e96e-4374-8d10-e9b37e0f7468 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.914586 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e924a-e96e-4374-8d10-e9b37e0f7468 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.026372 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 625/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:14.033194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.144396 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa5c8e-d19b-43e6-b252-0bfaa42ff8aa None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.184211 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.185019 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.185341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.185637 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.197925 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.199736 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:14.219347 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:14.220581 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:14.221731 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:14.221731 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:14.221731 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:14.221731 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:14.225762 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 617/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:14.226974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e924a-e96e-4374-8d10-e9b37e0f7468 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.337125 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e924a-e96e-4374-8d10-e9b37e0f7468 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.376941 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.377731 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.378017 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.378423 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:14.379786 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.381776 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.394644 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 626/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:14.400632 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.512162 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fae224-169f-4e8f-bc96-fede33fffba6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.553738 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.554882 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.555333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.555813 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.565707 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.567868 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:14.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:14.586960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:14.588189 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 618/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:14.594409 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.704813 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a2a6-26e6-4a2d-8eda-3ca150927f67 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.741762 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476039d2-17c0-4d35-b257-04bfa63e047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.742690 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476039d2-17c0-4d35-b257-04bfa63e047f None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.742973 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476039d2-17c0-4d35-b257-04bfa63e047f None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.743245 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476039d2-17c0-4d35-b257-04bfa63e047f None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.744068 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476039d2-17c0-4d35-b257-04bfa63e047f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:14.744430 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476039d2-17c0-4d35-b257-04bfa63e047f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.745921 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476039d2-17c0-4d35-b257-04bfa63e047f None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.758660 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 627/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:14.764828 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.879022 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10d989-839b-4f29-bf32-0479754f5294 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.916613 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf708-034c-4710-996a-f41226ac120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.917271 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf708-034c-4710-996a-f41226ac120c None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.917551 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf708-034c-4710-996a-f41226ac120c None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.917823 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf708-034c-4710-996a-f41226ac120c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.918654 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf708-034c-4710-996a-f41226ac120c None admin] RBAC: Adding query filter params (role.id=24a80586c13847a5b38391521300ce84, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=c51cf23836aa4601b54d7a7369cef09f) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:14.918991 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf708-034c-4710-996a-f41226ac120c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.920452 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daf708-034c-4710-996a-f41226ac120c None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.927555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 619/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/role_assignments?user.id=c51cf23836aa4601b54d7a7369cef09f&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=24a80586c13847a5b38391521300ce84 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:17.286397 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764e6d-da82-4c90-9e71-49d729b57363 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.287734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764e6d-da82-4c90-9e71-49d729b57363 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.287734 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6764e6d-da82-4c90-9e71-49d729b57363 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.289313 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 628/1247] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:17.295399 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf9da-0df8-48e3-a8bd-a660aa1db476 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.295995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf9da-0df8-48e3-a8bd-a660aa1db476 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.295995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf9da-0df8-48e3-a8bd-a660aa1db476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.313440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-af5bf9da-0df8-48e3-a8bd-a660aa1db476 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:17.314677 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-af5bf9da-0df8-48e3-a8bd-a660aa1db476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:17.395390 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 620/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:17.419578 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764e6d-da82-4c90-9e71-49d729b57363 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:17.525744 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6764e6d-da82-4c90-9e71-49d729b57363 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:17.567042 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037862-0029-4132-90a0-294740b9361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:17.568295 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037862-0029-4132-90a0-294740b9361e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.569320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037862-0029-4132-90a0-294740b9361e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.569838 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037862-0029-4132-90a0-294740b9361e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.582927 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c037862-0029-4132-90a0-294740b9361e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2c037862-0029-4132-90a0-294740b9361e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:17.592316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:17.593522 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:17.594532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 629/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:06:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:17.601096 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bf9da-0df8-48e3-a8bd-a660aa1db476 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:17.721907 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bf9da-0df8-48e3-a8bd-a660aa1db476 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:17.761214 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:17.762250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.762658 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.762939 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.763697 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:17.764157 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:17.765673 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:17.776224 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 621/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:17.782285 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037862-0029-4132-90a0-294740b9361e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:17.899074 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037862-0029-4132-90a0-294740b9361e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:17.938455 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:17.939370 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.939684 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.940137 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.954568 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:17.956063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:17.973820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:17.975435 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:17.976909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:17.976909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:17.976909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:17.976909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:17.976909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 630/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:17.981965 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.096740 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b236bdb-1979-4c0e-90da-b3d645f8347d None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.136732 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.137414 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.137694 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.137961 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.138705 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:18.139007 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.140461 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.153626 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 622/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:18.159408 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.264491 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f9d1c-2c0e-4a7c-ac12-26ddb836ec47 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.298962 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.299797 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.300079 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.300353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.308986 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.310444 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:18.325759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:18.326823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:18.327817 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 631/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:18.332928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.437709 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c6e0-3b92-4d59-acd4-d358395e1198 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.472668 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.473343 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.473622 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.473899 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.475629 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:18.475962 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.477440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.494587 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 623/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:18.500348 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.616305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dffeda-e447-4be8-abda-b07f3599ebfc None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.654909 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b114c-4492-4815-b11a-a30da29e69ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.655564 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b114c-4492-4815-b11a-a30da29e69ed None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.655880 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b114c-4492-4815-b11a-a30da29e69ed None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.656158 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b114c-4492-4815-b11a-a30da29e69ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.723532 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b114c-4492-4815-b11a-a30da29e69ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.725059 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b114c-4492-4815-b11a-a30da29e69ed None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.817458 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 632/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:18.824052 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.919042 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdec6a-9d39-4518-8253-475f9abe4cf5 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.951641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.952446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.952728 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.953003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.962558 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.964026 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:18.981264 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:18.982328 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:18.983594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:18.983594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:18.983594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:18.983594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:18.983594 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 624/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:18.988081 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b114c-4492-4815-b11a-a30da29e69ed None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.082867 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b114c-4492-4815-b11a-a30da29e69ed None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.116222 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.116865 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.117143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.117414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.118115 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:19.118420 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.119798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.130747 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 633/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:19.136270 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.235251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192083e6-345b-4e1d-a066-79e4ba2beb30 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.268213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.268991 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.269269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.269537 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.276448 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.277882 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:19.291968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:19.293030 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:19.294194 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 625/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:19.299053 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.393879 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d85f8f-0b02-4446-bb0d-bc34ca855e4e None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.425641 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8953-b8ba-4b85-badb-3be6dcf8b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.426278 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8953-b8ba-4b85-badb-3be6dcf8b3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.426555 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8953-b8ba-4b85-badb-3be6dcf8b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.426823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8953-b8ba-4b85-badb-3be6dcf8b3f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.428363 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf8953-b8ba-4b85-badb-3be6dcf8b3f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:19.428675 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf8953-b8ba-4b85-badb-3be6dcf8b3f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.430073 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf8953-b8ba-4b85-badb-3be6dcf8b3f0 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.441328 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 634/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:19.447314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.546683 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d808c58-c6a8-41e6-9444-18140cf3d6ef None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.578556 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067b5f4-68da-4a30-a9a2-4e82d18934d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.579193 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b5f4-68da-4a30-a9a2-4e82d18934d8 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.579551 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b5f4-68da-4a30-a9a2-4e82d18934d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.579852 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067b5f4-68da-4a30-a9a2-4e82d18934d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.580678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b5f4-68da-4a30-a9a2-4e82d18934d8 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=c51cf23836aa4601b54d7a7369cef09f) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:19.580990 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b5f4-68da-4a30-a9a2-4e82d18934d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.582401 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067b5f4-68da-4a30-a9a2-4e82d18934d8 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.587691 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 626/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/role_assignments?user.id=c51cf23836aa4601b54d7a7369cef09f&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=67227061f74f48f293a12155e904b5fc => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:21.776692 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb42d-0ab4-4596-b8fd-59273739318a None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.777266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb42d-0ab4-4596-b8fd-59273739318a None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.777266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb42d-0ab4-4596-b8fd-59273739318a None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.778596 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 635/1261] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:21.783743 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cbed-37e4-40b0-8554-51206d70944a None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.784191 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cbed-37e4-40b0-8554-51206d70944a None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.784302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3cbed-37e4-40b0-8554-51206d70944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.800953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-3da3cbed-37e4-40b0-8554-51206d70944a None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:21.802101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-3da3cbed-37e4-40b0-8554-51206d70944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:21.869607 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 627/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:21.896199 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bb42d-0ab4-4596-b8fd-59273739318a None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:21.993205 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bb42d-0ab4-4596-b8fd-59273739318a None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.025597 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8551716-1954-4276-8ccb-614cd2d64f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.026371 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8551716-1954-4276-8ccb-614cd2d64f76 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.026652 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8551716-1954-4276-8ccb-614cd2d64f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.026979 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8551716-1954-4276-8ccb-614cd2d64f76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.036473 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8551716-1954-4276-8ccb-614cd2d64f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-f8551716-1954-4276-8ccb-614cd2d64f76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:22.044696 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:22.045775 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:22.046807 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 636/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:22.051794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3cbed-37e4-40b0-8554-51206d70944a None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.148149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3cbed-37e4-40b0-8554-51206d70944a None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.182177 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.182846 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.183125 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.183399 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.184172 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:22.184476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.185831 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.194097 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 628/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:22.200120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8551716-1954-4276-8ccb-614cd2d64f76 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.295835 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8551716-1954-4276-8ccb-614cd2d64f76 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.327583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.328380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.328663 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.328936 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.339831 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.341256 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:22.358929 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:22.360116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:22.361237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:22.361237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:22.361237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:22.361237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:22.361237 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 637/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:22.366298 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.461783 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9c146-286c-4cd3-9d56-e090ab8e1f0b None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.493633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.494272 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.494554 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.494829 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.495542 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:22.495892 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.497232 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.508926 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 629/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:22.514610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.628961 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c328394-74a0-4bda-849e-97944faf62bf None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.660188 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.660974 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.661255 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.661527 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.669286 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.670717 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:22.685120 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:22.686063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:22.687085 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 638/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:22.692310 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.788593 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b720c-03c5-4114-ba7b-54121b63362e None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.820779 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.821436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.821715 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.821989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] PATH_INFO: `/v3/users` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.822819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:22.823129 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.824819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.841943 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 630/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:22.847563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.945212 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ae02-d52f-4edb-842b-c509552ca8c8 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.978071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.978840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.979123 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.979396 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.990552 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.992014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:23.008738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:23.009798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:23.010754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:23.010754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:23.010754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:23.010754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:23.010754 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 639/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:23.016941 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.113535 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4a1a-54ef-4fa9-9319-966bab2d4383 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.145340 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.145989 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.146832 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.147103 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.147835 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:23.148139 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.149490 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.160158 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 631/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:23.166258 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.261510 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e23e-86a2-46c9-94be-875394cca757 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.292899 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.293674 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.293955 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.294230 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.300558 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.301984 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:23.315901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:23.316959 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:23.318607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 640/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:23.323251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.417931 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79854b44-c48c-47bc-9442-60e013c5b6b6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98909f30-d9d8-4a5e-8877-9784469d73ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.450471 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909f30-d9d8-4a5e-8877-9784469d73ba None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.450750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909f30-d9d8-4a5e-8877-9784469d73ba None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.451021 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98909f30-d9d8-4a5e-8877-9784469d73ba None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.451819 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98909f30-d9d8-4a5e-8877-9784469d73ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:23.452167 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98909f30-d9d8-4a5e-8877-9784469d73ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.453578 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98909f30-d9d8-4a5e-8877-9784469d73ba None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.465218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 632/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:23.471018 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.585563 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8982c5-b30d-4dfd-ae3f-76aae5f93305 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.617403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27fb56-a462-4380-98d6-6eba5c413212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.618274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27fb56-a462-4380-98d6-6eba5c413212 None admin] REQUEST_METHOD: `PUT` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.618556 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27fb56-a462-4380-98d6-6eba5c413212 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.618833 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27fb56-a462-4380-98d6-6eba5c413212 None admin] PATH_INFO: `/v3/projects/419b0bc00313443fad69015a99f495ae/users/c51cf23836aa4601b54d7a7369cef09f/roles/67227061f74f48f293a12155e904b5fc` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.620790 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27fb56-a462-4380-98d6-6eba5c413212 None admin] RBAC: Authorizing `identity:create_grant(project_id=419b0bc00313443fad69015a99f495ae, user_id=c51cf23836aa4601b54d7a7369cef09f, role_id=67227061f74f48f293a12155e904b5fc)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.622211 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27fb56-a462-4380-98d6-6eba5c413212 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.634285 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 641/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:06:23 2022] PUT /identity/v3/projects/419b0bc00313443fad69015a99f495ae/users/c51cf23836aa4601b54d7a7369cef09f/roles/67227061f74f48f293a12155e904b5fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:25.816250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e4d4-5d5b-4947-95c5-07f6d07d182d None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.816785 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e4d4-5d5b-4947-95c5-07f6d07d182d None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.816785 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0e4d4-5d5b-4947-95c5-07f6d07d182d None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.818171 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 633/1274] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:25.823550 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef054821-d8b1-4500-9977-634aa4afce63 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.823988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef054821-d8b1-4500-9977-634aa4afce63 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.824141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef054821-d8b1-4500-9977-634aa4afce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.840954 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ef054821-d8b1-4500-9977-634aa4afce63 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:25.842140 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ef054821-d8b1-4500-9977-634aa4afce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:25.905928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 642/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:25.929794 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0e4d4-5d5b-4947-95c5-07f6d07d182d None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.034040 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0e4d4-5d5b-4947-95c5-07f6d07d182d None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.067710 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e2abb-60c7-4adb-a893-153d5e1bd8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.068476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2abb-60c7-4adb-a893-153d5e1bd8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.068754 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2abb-60c7-4adb-a893-153d5e1bd8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.069028 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e2abb-60c7-4adb-a893-153d5e1bd8a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.079016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e2abb-60c7-4adb-a893-153d5e1bd8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-3b8e2abb-60c7-4adb-a893-153d5e1bd8a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:26.087317 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:26.088465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:26.089335 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 634/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:26.094587 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef054821-d8b1-4500-9977-634aa4afce63 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.191566 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef054821-d8b1-4500-9977-634aa4afce63 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.226058 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.226814 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.227102 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.227377 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] PATH_INFO: `/v3/roles` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.228149 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:26.228456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.229812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.237361 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 643/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:26.243141 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e2abb-60c7-4adb-a893-153d5e1bd8a6 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.339099 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e2abb-60c7-4adb-a893-153d5e1bd8a6 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.369918 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.370688 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.370972 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.371249 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.381821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.383250 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:26.401550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:26.402586 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:26.403540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:26.403540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:26.403540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:26.403540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:26.403540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 635/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:26.408615 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.514438 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcb14-6905-47ab-ad34-16b268af5794 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.555124 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.555861 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.556243 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.556627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] PATH_INFO: `/v3/domains` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.557607 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:26.557949 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.559708 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.574134 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 644/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:26.580695 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.678392 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48782dc5-c11d-43e8-affc-cdc93b1c4c7a None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.709559 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.710333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.710608 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.710874 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.718655 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.720101 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:26.733687 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:26.734805 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:26.736014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 636/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:26.741179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.834187 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3ec0e-95cc-4b7b-a990-9f4b2636a2ea None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.866462 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.867127 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.867403 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.867672 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] PATH_INFO: `/v3/users` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.868517 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:26.868823 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.870232 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.886449 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 645/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:26.892257 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.987084 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5d0a9-68e1-4a48-9f2d-75fc13283170 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.018435 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc7093-8350-4c29-9e6e-e12c55e4efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.019065 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7093-8350-4c29-9e6e-e12c55e4efe4 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.019343 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7093-8350-4c29-9e6e-e12c55e4efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.019613 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7093-8350-4c29-9e6e-e12c55e4efe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.083854 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc7093-8350-4c29-9e6e-e12c55e4efe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.085378 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc7093-8350-4c29-9e6e-e12c55e4efe4 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.178886 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 637/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:27.184749 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.277988 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7cbc-5792-4af7-bcb8-b2e91c9885c7 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.309575 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.310343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.310624 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.310897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.320377 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.321801 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:27.339193 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:27.340293 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:27.341380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:27.341380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:27.341380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:27.341380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:27.341380 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 646/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:27.346002 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc7093-8350-4c29-9e6e-e12c55e4efe4 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.438800 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc7093-8350-4c29-9e6e-e12c55e4efe4 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.471065 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.471708 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.472017 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.472294 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] PATH_INFO: `/v3/domains` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.473003 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:27.473308 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.485609 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 638/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:27.492048 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.592354 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ba5ea-2986-4dbe-8d87-5b07c0472eaf None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.624538 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.625303 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.625582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.625854 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.632210 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.633630 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:27.646902 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application with Lock( May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:27.647871 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: ERROR keystone.server.flask.application May 09 15:06:27.648840 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 647/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:27.653907 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.749150 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68ea0a-8711-4b8c-8abb-1d8be2e49894 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.780103 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c126cd-b1c9-489d-83dd-d8d82306ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.780746 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c126cd-b1c9-489d-83dd-d8d82306ce6d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.781027 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c126cd-b1c9-489d-83dd-d8d82306ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.781304 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c126cd-b1c9-489d-83dd-d8d82306ce6d None admin] PATH_INFO: `/v3/projects` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.782081 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c126cd-b1c9-489d-83dd-d8d82306ce6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:27.782393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c126cd-b1c9-489d-83dd-d8d82306ce6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.783821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c126cd-b1c9-489d-83dd-d8d82306ce6d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.795969 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 639/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:27.802093 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.909887 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22becc-d7a1-4018-89dd-2d1844bc1fce None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.941698 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c8fa-078e-4d9e-a7cc-c727c1f8e112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.942332 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c8fa-078e-4d9e-a7cc-c727c1f8e112 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.942632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c8fa-078e-4d9e-a7cc-c727c1f8e112 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.942913 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c8fa-078e-4d9e-a7cc-c727c1f8e112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.943856 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c8fa-078e-4d9e-a7cc-c727c1f8e112 None admin] RBAC: Adding query filter params (role.id=67227061f74f48f293a12155e904b5fc, scope.project.id=419b0bc00313443fad69015a99f495ae, user.id=c51cf23836aa4601b54d7a7369cef09f) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:27.944168 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c8fa-078e-4d9e-a7cc-c727c1f8e112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.945591 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c8fa-078e-4d9e-a7cc-c727c1f8e112 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.951281 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 648/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/role_assignments?user.id=c51cf23836aa4601b54d7a7369cef09f&scope.project.id=419b0bc00313443fad69015a99f495ae&role.id=67227061f74f48f293a12155e904b5fc => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:30.179197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131ac65-0389-4116-9efd-12908a654919 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.179748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131ac65-0389-4116-9efd-12908a654919 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.179748 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131ac65-0389-4116-9efd-12908a654919 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.181142 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 640/1288] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:30.186365 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3775e57-525a-4b47-ae27-151f93762d3d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.186805 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3775e57-525a-4b47-ae27-151f93762d3d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.186916 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3775e57-525a-4b47-ae27-151f93762d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.203738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-b3775e57-525a-4b47-ae27-151f93762d3d None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:30.204928 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b3775e57-525a-4b47-ae27-151f93762d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:30.268756 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 649/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:30.290655 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131ac65-0389-4116-9efd-12908a654919 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.389253 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131ac65-0389-4116-9efd-12908a654919 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.421844 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.422617 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.422897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.423170 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.423834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.425197 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:30.437483 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:30.438734 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:30.440006 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 641/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:30.445163 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3775e57-525a-4b47-ae27-151f93762d3d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.544250 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3775e57-525a-4b47-ae27-151f93762d3d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.581622 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab4798-f6fa-4e10-8861-ab38f31cd8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.582406 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab4798-f6fa-4e10-8861-ab38f31cd8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.582728 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab4798-f6fa-4e10-8861-ab38f31cd8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.583006 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab4798-f6fa-4e10-8861-ab38f31cd8d9 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.584678 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab4798-f6fa-4e10-8861-ab38f31cd8d9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:30.584984 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab4798-f6fa-4e10-8861-ab38f31cd8d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.586637 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab4798-f6fa-4e10-8861-ab38f31cd8d9 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.591697 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 650/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:30.598178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.694933 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c648c-813e-47bc-985e-76a367d59c75 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.726540 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff4963-c74c-4b72-9240-f77ab221696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.727174 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4963-c74c-4b72-9240-f77ab221696d None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.727451 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4963-c74c-4b72-9240-f77ab221696d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.727720 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff4963-c74c-4b72-9240-f77ab221696d None admin] PATH_INFO: `/v3/services` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.728441 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4963-c74c-4b72-9240-f77ab221696d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:30.728740 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4963-c74c-4b72-9240-f77ab221696d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.730081 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff4963-c74c-4b72-9240-f77ab221696d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.734239 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 642/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:32.947935 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b68bc-8c55-475f-b616-a7bea8847262 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:32.948470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b68bc-8c55-475f-b616-a7bea8847262 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:32.948470 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b68bc-8c55-475f-b616-a7bea8847262 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:32.950071 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 651/1293] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:32.955314 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a36553-6a6a-4dbf-b52b-cdf74549fdbb None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:32.955713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a36553-6a6a-4dbf-b52b-cdf74549fdbb None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:32.955897 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a36553-6a6a-4dbf-b52b-cdf74549fdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:32.972550 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-97a36553-6a6a-4dbf-b52b-cdf74549fdbb None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:32.974302 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-97a36553-6a6a-4dbf-b52b-cdf74549fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:33.038957 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 643/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:33.061688 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b68bc-8c55-475f-b616-a7bea8847262 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:33.157131 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b68bc-8c55-475f-b616-a7bea8847262 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:33.189116 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf1714-0ddf-423c-b2a7-38fa4a90991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:33.189759 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf1714-0ddf-423c-b2a7-38fa4a90991b None admin] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.190039 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf1714-0ddf-423c-b2a7-38fa4a90991b None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.190311 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf1714-0ddf-423c-b2a7-38fa4a90991b None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.191029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf1714-0ddf-423c-b2a7-38fa4a90991b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:33.192436 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf1714-0ddf-423c-b2a7-38fa4a90991b None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:33.204930 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 652/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:06:33 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:35.457370 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb63e4-d268-4a32-9279-a57e005ddf2b None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:35.457944 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb63e4-d268-4a32-9279-a57e005ddf2b None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:35.457944 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb63e4-d268-4a32-9279-a57e005ddf2b None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:35.459362 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 644/1296] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:35.464705 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f340e-80d3-4d57-94ac-5cbd9512bfff None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:35.465122 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f340e-80d3-4d57-94ac-5cbd9512bfff None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:35.465249 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f340e-80d3-4d57-94ac-5cbd9512bfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:35.482032 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0d2f340e-80d3-4d57-94ac-5cbd9512bfff None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:35.483185 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0d2f340e-80d3-4d57-94ac-5cbd9512bfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:35.560056 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 653/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:35.582818 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb63e4-d268-4a32-9279-a57e005ddf2b None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:35.678921 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb63e4-d268-4a32-9279-a57e005ddf2b None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:35.710983 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:35.711702 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:35.712011 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:35.712286 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:35.712928 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:35.714279 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:35.726338 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:35.727560 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:35.728574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 645/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:06:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:35.733560 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f340e-80d3-4d57-94ac-5cbd9512bfff None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:35.825253 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f340e-80d3-4d57-94ac-5cbd9512bfff None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:35.857643 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:35.858291 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:35.858573 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:35.858852 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:35.859544 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:35.859880 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:35.861231 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:35.866162 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 654/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:06:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:35.872010 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:35.968341 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b3e8f-a196-4c25-98c9-4693b6399d04 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:36.000860 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0ab6b-92c3-4491-8cd0-e382204d75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:36.001513 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ab6b-92c3-4491-8cd0-e382204d75ad None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:36.001795 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ab6b-92c3-4491-8cd0-e382204d75ad None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:36.002070 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ab6b-92c3-4491-8cd0-e382204d75ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:36.002913 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0ab6b-92c3-4491-8cd0-e382204d75ad None admin] RBAC: Adding query filter params (interface=public, service_id=a2ebb8eaaed844419c99aa2f09fb2f9f, region_id=RegionOne) {{(pid=80127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:36.003226 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0ab6b-92c3-4491-8cd0-e382204d75ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:36.005733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0ab6b-92c3-4491-8cd0-e382204d75ad None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:36.010052 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 646/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:06:35 2022] GET /identity/v3/endpoints?service_id=a2ebb8eaaed844419c99aa2f09fb2f9f&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:36.015758 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:36.112417 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffdacb-7299-42b4-850b-cb1435d33447 None admin] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:36.147198 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8d74-ced2-4f6a-adeb-a73fa0509e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:36.147865 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8d74-ced2-4f6a-adeb-a73fa0509e08 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:36.148146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8d74-ced2-4f6a-adeb-a73fa0509e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:36.148419 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8d74-ced2-4f6a-adeb-a73fa0509e08 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:36.149088 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd8d74-ced2-4f6a-adeb-a73fa0509e08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:36.150439 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd8d74-ced2-4f6a-adeb-a73fa0509e08 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:36.156911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 655/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:06:36 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:06:38.469545 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66bc5f-95b2-4017-a65a-517b1abe6422 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.470336 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66bc5f-95b2-4017-a65a-517b1abe6422 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.470557 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66bc5f-95b2-4017-a65a-517b1abe6422 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.471968 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 647/1302] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:38.477622 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683cca1-2053-4ecc-9b9b-0ad125975db4 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.478029 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683cca1-2053-4ecc-9b9b-0ad125975db4 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.478174 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683cca1-2053-4ecc-9b9b-0ad125975db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.494849 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-d683cca1-2053-4ecc-9b9b-0ad125975db4 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:38.496031 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d683cca1-2053-4ecc-9b9b-0ad125975db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:38.558329 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 656/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:06:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:38.581095 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66bc5f-95b2-4017-a65a-517b1abe6422 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.698327 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66bc5f-95b2-4017-a65a-517b1abe6422 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.729554 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.730275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.730554 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.730824 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.731462 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.732845 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:38.744680 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:38.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application with Lock( May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: ERROR keystone.server.flask.application May 09 15:06:38.746923 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 648/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:38.751945 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683cca1-2053-4ecc-9b9b-0ad125975db4 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.844302 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683cca1-2053-4ecc-9b9b-0ad125975db4 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.876274 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbd434-fdba-4ee6-906e-4b72ffa1b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.876916 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd434-fdba-4ee6-906e-4b72ffa1b021 None admin] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.877191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd434-fdba-4ee6-906e-4b72ffa1b021 None admin] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.877460 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd434-fdba-4ee6-906e-4b72ffa1b021 None admin] PATH_INFO: `/v3/services` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.878143 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbd434-fdba-4ee6-906e-4b72ffa1b021 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:38.878443 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbd434-fdba-4ee6-906e-4b72ffa1b021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.880439 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbd434-fdba-4ee6-906e-4b72ffa1b021 None admin] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.885236 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 657/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:38.890802 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.997869 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676594f-7520-431b-8b26-7223bd14ad99 None admin] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:39.031634 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5128e-092d-4313-a3a9-defeb7b80e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e589d5b5944217aa6bbd924fcc21dc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:39.032298 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5128e-092d-4313-a3a9-defeb7b80e4d None admin] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:39.032574 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5128e-092d-4313-a3a9-defeb7b80e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:39.032845 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5128e-092d-4313-a3a9-defeb7b80e4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:39.033569 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5128e-092d-4313-a3a9-defeb7b80e4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:39.034914 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5128e-092d-4313-a3a9-defeb7b80e4d None admin] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:39.053413 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 649/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:06:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:07:43.259815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c1c46-b70b-4184-8606-92aae63291ef None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:43.260782 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c1c46-b70b-4184-8606-92aae63291ef None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:43.261225 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c1c46-b70b-4184-8606-92aae63291ef None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:43.268880 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096fe25-5c61-4eeb-a1e6-abbb3f05ed8c None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:43.269733 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096fe25-5c61-4eeb-a1e6-abbb3f05ed8c None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:43.270173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096fe25-5c61-4eeb-a1e6-abbb3f05ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:43.273932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 658/1307] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:07:43 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:43.348614 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-7096fe25-5c61-4eeb-a1e6-abbb3f05ed8c None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:43.351023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-7096fe25-5c61-4eeb-a1e6-abbb3f05ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:43.579984 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 650/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:07:43.638236 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50f4c-1dc8-449a-b213-98fb71ce473c None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:43.638519 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50f4c-1dc8-449a-b213-98fb71ce473c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:43.639004 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd50f4c-1dc8-449a-b213-98fb71ce473c None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:43.640898 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 659/1309] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 9 15:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:43.647821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7b9b4-999a-43a1-9349-6ba69765aaa9 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:43.648508 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7b9b4-999a-43a1-9349-6ba69765aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:43.648749 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7b9b4-999a-43a1-9349-6ba69765aaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:43.737871 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-5ed7b9b4-999a-43a1-9349-6ba69765aaa9 None None] MFA Rules not processed for user `2243986a25be4ad0866b80d488ab5d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:43.739225 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-5ed7b9b4-999a-43a1-9349-6ba69765aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:43.823528 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 651/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 9 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:07:43.833179 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd50f4c-1dc8-449a-b213-98fb71ce473c None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:43.834891 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-8dd50f4c-1dc8-449a-b213-98fb71ce473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:43.957630 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd50f4c-1dc8-449a-b213-98fb71ce473c None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:44.033244 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5b049-dd39-4fb5-a0a9-43dbbd798a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:44.033901 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b049-dd39-4fb5-a0a9-43dbbd798a8e service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:44.034182 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b049-dd39-4fb5-a0a9-43dbbd798a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:44.034471 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b049-dd39-4fb5-a0a9-43dbbd798a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:44.036248 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4eb5b049-dd39-4fb5-a0a9-43dbbd798a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:44.146906 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5b049-dd39-4fb5-a0a9-43dbbd798a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:44.148506 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5b049-dd39-4fb5-a0a9-43dbbd798a8e service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:44.169141 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 660/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:07:46.695802 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31083-a7a1-4cd9-bf81-7be34c491acb None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:46.696326 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31083-a7a1-4cd9-bf81-7be34c491acb None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:46.696437 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a31083-a7a1-4cd9-bf81-7be34c491acb None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:46.698140 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 652/1312] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:46.703288 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035ee5d-b646-4a7c-9c51-11259ac80609 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:46.703691 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035ee5d-b646-4a7c-9c51-11259ac80609 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:46.703934 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035ee5d-b646-4a7c-9c51-11259ac80609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:46.786219 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-1035ee5d-b646-4a7c-9c51-11259ac80609 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:46.787414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-1035ee5d-b646-4a7c-9c51-11259ac80609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:46.881948 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 661/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:07:46.918702 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a31083-a7a1-4cd9-bf81-7be34c491acb None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:46.920251 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-02a31083-a7a1-4cd9-bf81-7be34c491acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:47.024399 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a31083-a7a1-4cd9-bf81-7be34c491acb None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:47.098381 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32d3ce-e8ee-42de-8e27-bcc730210156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:47.099044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d3ce-e8ee-42de-8e27-bcc730210156 service neutron] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:47.099325 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d3ce-e8ee-42de-8e27-bcc730210156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:47.099604 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d3ce-e8ee-42de-8e27-bcc730210156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:47.101284 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-6d32d3ce-e8ee-42de-8e27-bcc730210156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:47.213649 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32d3ce-e8ee-42de-8e27-bcc730210156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:47.215076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32d3ce-e8ee-42de-8e27-bcc730210156 service neutron] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:47.232446 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 653/1314] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:07:49.860155 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28bdc9-f1c1-44ee-b140-5d87096f5aca None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:49.860751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28bdc9-f1c1-44ee-b140-5d87096f5aca None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:49.860751 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28bdc9-f1c1-44ee-b140-5d87096f5aca None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:49.862067 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 662/1315] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:49.867294 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80b718-83ab-48d7-a036-d12ce5ded64f None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:49.867722 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80b718-83ab-48d7-a036-d12ce5ded64f None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:49.867893 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80b718-83ab-48d7-a036-d12ce5ded64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:49.932287 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-ec80b718-83ab-48d7-a036-d12ce5ded64f None None] MFA Rules not processed for user `d10b080250d04a0999342a6933d185ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:49.933490 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-ec80b718-83ab-48d7-a036-d12ce5ded64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:50.027082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 654/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:07:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:07:50.067099 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28bdc9-f1c1-44ee-b140-5d87096f5aca None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:50.068781 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ea28bdc9-f1c1-44ee-b140-5d87096f5aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:50.170005 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28bdc9-f1c1-44ee-b140-5d87096f5aca None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:50.239987 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a8d66-3393-4c32-817f-abb1694b174b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:50.240639 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8d66-3393-4c32-817f-abb1694b174b service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:50.240917 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8d66-3393-4c32-817f-abb1694b174b service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:50.241191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8d66-3393-4c32-817f-abb1694b174b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:50.242820 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e59a8d66-3393-4c32-817f-abb1694b174b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:50.357253 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a8d66-3393-4c32-817f-abb1694b174b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:50.358689 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a8d66-3393-4c32-817f-abb1694b174b service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:50.378114 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 663/1317] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:07:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:07:53.167468 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20378332-cfc6-4695-9e40-3fb23c6fc0e0 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:53.168014 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20378332-cfc6-4695-9e40-3fb23c6fc0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:53.168109 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20378332-cfc6-4695-9e40-3fb23c6fc0e0 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:53.169418 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 655/1318] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:53.175228 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b021-e3a7-4585-8b34-ad0a76b3333d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:53.175632 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b021-e3a7-4585-8b34-ad0a76b3333d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:53.175787 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b021-e3a7-4585-8b34-ad0a76b3333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:53.238245 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-9872b021-e3a7-4585-8b34-ad0a76b3333d None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:53.239422 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9872b021-e3a7-4585-8b34-ad0a76b3333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:53.329146 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 664/1319] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:07:53.383208 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f1029-c464-4d1c-8d41-f87b08e1ed31 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:53.383498 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f1029-c464-4d1c-8d41-f87b08e1ed31 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:53.383803 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f1029-c464-4d1c-8d41-f87b08e1ed31 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:53.385176 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 656/1320] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 9 15:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:53.391314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d9557-30f5-4880-aee3-7566bf8aa8d1 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:53.391612 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d9557-30f5-4880-aee3-7566bf8aa8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:53.391923 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d9557-30f5-4880-aee3-7566bf8aa8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:53.464035 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2d1d9557-30f5-4880-aee3-7566bf8aa8d1 None None] MFA Rules not processed for user `2243986a25be4ad0866b80d488ab5d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:53.465224 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2d1d9557-30f5-4880-aee3-7566bf8aa8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:53.541512 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 665/1321] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 9 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:07:53.550730 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f1029-c464-4d1c-8d41-f87b08e1ed31 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:53.552256 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-e76f1029-c464-4d1c-8d41-f87b08e1ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:53.651666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f1029-c464-4d1c-8d41-f87b08e1ed31 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:53.724038 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c4ef3-4ece-4438-98ea-383345de62b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:53.724676 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c4ef3-4ece-4438-98ea-383345de62b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:53.724953 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c4ef3-4ece-4438-98ea-383345de62b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:53.725221 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c4ef3-4ece-4438-98ea-383345de62b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:53.726826 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-3b9c4ef3-4ece-4438-98ea-383345de62b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:53.840152 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c4ef3-4ece-4438-98ea-383345de62b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:53.841590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c4ef3-4ece-4438-98ea-383345de62b9 service neutron] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:53.859366 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 657/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:07:57.209286 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e5c5-fd67-4f4c-aa78-d8c085d3d968 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:57.209815 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e5c5-fd67-4f4c-aa78-d8c085d3d968 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:57.209911 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3e5c5-fd67-4f4c-aa78-d8c085d3d968 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:57.211200 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 666/1323] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:57.216618 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb3f5-dac8-43e4-af92-6a55519cae95 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:57.217011 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb3f5-dac8-43e4-af92-6a55519cae95 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:57.217184 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcb3f5-dac8-43e4-af92-6a55519cae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:57.280867 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-29dcb3f5-dac8-43e4-af92-6a55519cae95 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:57.282129 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-29dcb3f5-dac8-43e4-af92-6a55519cae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:57.374646 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 658/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:07:57.409698 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3e5c5-fd67-4f4c-aa78-d8c085d3d968 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:57.411299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-6bf3e5c5-fd67-4f4c-aa78-d8c085d3d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:57.511583 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3e5c5-fd67-4f4c-aa78-d8c085d3d968 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:57.585096 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5103e6c-0a54-442c-ac7b-6e7194034d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:57.585742 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103e6c-0a54-442c-ac7b-6e7194034d72 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:57.586021 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103e6c-0a54-442c-ac7b-6e7194034d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:57.586289 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103e6c-0a54-442c-ac7b-6e7194034d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:57.587952 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-b5103e6c-0a54-442c-ac7b-6e7194034d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:57.700589 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5103e6c-0a54-442c-ac7b-6e7194034d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:57.702008 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5103e6c-0a54-442c-ac7b-6e7194034d72 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:57.721690 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 667/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:00.010618 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674951c4-5feb-42c7-8305-e37e93e3f7df None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:00.011192 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674951c4-5feb-42c7-8305-e37e93e3f7df None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:00.011192 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674951c4-5feb-42c7-8305-e37e93e3f7df None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:00.012568 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 659/1326] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:00.018618 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5e33-c410-4b85-be2f-95ce5a0e85d2 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:00.019195 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5e33-c410-4b85-be2f-95ce5a0e85d2 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:00.019305 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5e33-c410-4b85-be2f-95ce5a0e85d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:00.085186 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-df8d5e33-c410-4b85-be2f-95ce5a0e85d2 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:00.085453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-df8d5e33-c410-4b85-be2f-95ce5a0e85d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:00.179874 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 668/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:00.216359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674951c4-5feb-42c7-8305-e37e93e3f7df None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:00.217962 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-674951c4-5feb-42c7-8305-e37e93e3f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:00.318485 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674951c4-5feb-42c7-8305-e37e93e3f7df None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:00.387837 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690b850-2fff-4ba3-95c5-055f2cf8416b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:00.388476 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b850-2fff-4ba3-95c5-055f2cf8416b service neutron] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:00.388760 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b850-2fff-4ba3-95c5-055f2cf8416b service neutron] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:00.389023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b850-2fff-4ba3-95c5-055f2cf8416b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:00.390610 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-e690b850-2fff-4ba3-95c5-055f2cf8416b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:00.494947 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690b850-2fff-4ba3-95c5-055f2cf8416b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:00.496393 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690b850-2fff-4ba3-95c5-055f2cf8416b service neutron] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:00.513471 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 660/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:02.808609 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fabd2-5c78-4044-98a9-30c3a8eca8bb None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:02.809180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fabd2-5c78-4044-98a9-30c3a8eca8bb None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:02.809180 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fabd2-5c78-4044-98a9-30c3a8eca8bb None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:02.810627 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 669/1329] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:02.816517 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ea370-6c7c-468a-a27a-68070d8f04c3 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:02.816943 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ea370-6c7c-468a-a27a-68070d8f04c3 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:02.817200 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ea370-6c7c-468a-a27a-68070d8f04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:02.881563 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-570ea370-6c7c-468a-a27a-68070d8f04c3 None None] MFA Rules not processed for user `d10b080250d04a0999342a6933d185ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:02.882785 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-570ea370-6c7c-468a-a27a-68070d8f04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:02.978126 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 661/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:03.015454 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fabd2-5c78-4044-98a9-30c3a8eca8bb None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:03.017126 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-724fabd2-5c78-4044-98a9-30c3a8eca8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:03.121729 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fabd2-5c78-4044-98a9-30c3a8eca8bb None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:03.196570 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728371e-82fb-47ac-be22-75548498134b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:03.197465 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728371e-82fb-47ac-be22-75548498134b service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:03.197743 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728371e-82fb-47ac-be22-75548498134b service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:03.198014 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728371e-82fb-47ac-be22-75548498134b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:03.199616 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-d728371e-82fb-47ac-be22-75548498134b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:03.306301 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728371e-82fb-47ac-be22-75548498134b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:03.307730 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728371e-82fb-47ac-be22-75548498134b service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:03.325316 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 670/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:05.790201 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e68a0-1cea-40b8-971b-37b0156f8fac None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:05.790656 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e68a0-1cea-40b8-971b-37b0156f8fac None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:05.790856 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e68a0-1cea-40b8-971b-37b0156f8fac None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:05.792174 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 662/1332] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:05.798746 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b82f3-932a-4cf3-ba70-4ac726cea05c None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:05.799203 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b82f3-932a-4cf3-ba70-4ac726cea05c None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:05.799297 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b82f3-932a-4cf3-ba70-4ac726cea05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:05.879551 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-525b82f3-932a-4cf3-ba70-4ac726cea05c None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:05.880896 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-525b82f3-932a-4cf3-ba70-4ac726cea05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:05.977416 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 671/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:06.013218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e68a0-1cea-40b8-971b-37b0156f8fac None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:06.014731 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-5e8e68a0-1cea-40b8-971b-37b0156f8fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:06.117615 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e68a0-1cea-40b8-971b-37b0156f8fac None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:06.189821 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ba460-dcfc-475b-be73-4121a6b36ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:06.190488 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba460-dcfc-475b-be73-4121a6b36ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:06.190755 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba460-dcfc-475b-be73-4121a6b36ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:06.191028 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba460-dcfc-475b-be73-4121a6b36ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:06.192756 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-295ba460-dcfc-475b-be73-4121a6b36ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:06.298016 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ba460-dcfc-475b-be73-4121a6b36ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:06.299459 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ba460-dcfc-475b-be73-4121a6b36ebf service neutron] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:06.317686 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 663/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:08.605796 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779eb9d-0333-4657-9afa-9fca9c82b1e0 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:08.606343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779eb9d-0333-4657-9afa-9fca9c82b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:08.606343 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779eb9d-0333-4657-9afa-9fca9c82b1e0 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:08.607677 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 672/1335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:08.613713 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64df21a-af05-4adb-bb24-d45840b5ca15 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:08.614127 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64df21a-af05-4adb-bb24-d45840b5ca15 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:08.614268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64df21a-af05-4adb-bb24-d45840b5ca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:08.677801 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-a64df21a-af05-4adb-bb24-d45840b5ca15 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:08.679023 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-a64df21a-af05-4adb-bb24-d45840b5ca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:08.772609 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 664/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:08.812157 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779eb9d-0333-4657-9afa-9fca9c82b1e0 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:08.814600 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-9779eb9d-0333-4657-9afa-9fca9c82b1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:08.913191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779eb9d-0333-4657-9afa-9fca9c82b1e0 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:08.983234 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e1fa3-3725-4b7c-aa3d-42aefd0130a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:08.983914 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e1fa3-3725-4b7c-aa3d-42aefd0130a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:08.984203 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e1fa3-3725-4b7c-aa3d-42aefd0130a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:08.985131 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e1fa3-3725-4b7c-aa3d-42aefd0130a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:08.986758 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-cd6e1fa3-3725-4b7c-aa3d-42aefd0130a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:09.105876 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e1fa3-3725-4b7c-aa3d-42aefd0130a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:09.107359 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e1fa3-3725-4b7c-aa3d-42aefd0130a4 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:09.125944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 673/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:11.701735 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cea631-7d11-45f4-bfe5-d1882e25a627 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:11.702273 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cea631-7d11-45f4-bfe5-d1882e25a627 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:11.702273 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cea631-7d11-45f4-bfe5-d1882e25a627 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:11.703817 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 665/1338] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:11.709131 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9babf-1e23-41f5-a7ae-2f3b229da8dc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:11.709533 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9babf-1e23-41f5-a7ae-2f3b229da8dc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:11.709697 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9babf-1e23-41f5-a7ae-2f3b229da8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:11.773282 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ccf9babf-1e23-41f5-a7ae-2f3b229da8dc None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:11.774477 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ccf9babf-1e23-41f5-a7ae-2f3b229da8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:11.874368 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 674/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:08:11.911242 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cea631-7d11-45f4-bfe5-d1882e25a627 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:11.912796 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-64cea631-7d11-45f4-bfe5-d1882e25a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:12.019392 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cea631-7d11-45f4-bfe5-d1882e25a627 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:12.098333 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9341c9-b48a-4b10-9df0-fc14c8b7f13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:12.098987 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9341c9-b48a-4b10-9df0-fc14c8b7f13f service neutron] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:12.099268 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9341c9-b48a-4b10-9df0-fc14c8b7f13f service neutron] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:12.099535 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9341c9-b48a-4b10-9df0-fc14c8b7f13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:12.101207 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-7d9341c9-b48a-4b10-9df0-fc14c8b7f13f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:12.205275 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9341c9-b48a-4b10-9df0-fc14c8b7f13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:12.206681 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9341c9-b48a-4b10-9df0-fc14c8b7f13f service neutron] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:12.223715 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 666/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:16.510738 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71507-395d-44e3-be54-edc00fd3b182 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:16.511324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71507-395d-44e3-be54-edc00fd3b182 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:16.511324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71507-395d-44e3-be54-edc00fd3b182 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:16.512673 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 675/1341] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:16.518874 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e940-7cd4-4737-bcf7-07ea924592ea None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:16.519323 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e940-7cd4-4737-bcf7-07ea924592ea None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:16.519420 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e940-7cd4-4737-bcf7-07ea924592ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:16.590778 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-61c0e940-7cd4-4737-bcf7-07ea924592ea None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:16.591960 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-61c0e940-7cd4-4737-bcf7-07ea924592ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:16.694834 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 667/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:16.733416 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f71507-395d-44e3-be54-edc00fd3b182 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:16.735920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-51f71507-395d-44e3-be54-edc00fd3b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:16.840191 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f71507-395d-44e3-be54-edc00fd3b182 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:16.843703 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a83d9-307b-4cfd-b023-3656f824f5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:16.844376 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a83d9-307b-4cfd-b023-3656f824f5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:16.844655 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a83d9-307b-4cfd-b023-3656f824f5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:16.844936 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a83d9-307b-4cfd-b023-3656f824f5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:16.853861 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a83d9-307b-4cfd-b023-3656f824f5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:16.855275 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a83d9-307b-4cfd-b023-3656f824f5d3 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:16.864998 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 676/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:19.682944 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2e81-b032-41f4-be40-9a842deb77df None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:19.683494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2e81-b032-41f4-be40-9a842deb77df None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:19.683494 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2e81-b032-41f4-be40-9a842deb77df None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:19.684909 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 668/1344] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:19.690985 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece434c6-d606-425c-85e2-a023c49458a0 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:19.691434 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece434c6-d606-425c-85e2-a023c49458a0 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:19.691642 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece434c6-d606-425c-85e2-a023c49458a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:19.719346 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-ece434c6-d606-425c-85e2-a023c49458a0 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:19.720481 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-ece434c6-d606-425c-85e2-a023c49458a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:19.793846 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 677/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:19.831421 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da2e81-b032-41f4-be40-9a842deb77df None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:19.841985 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da2e81-b032-41f4-be40-9a842deb77df None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:19.846031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f61f5-54be-4036-9ca7-728b027197fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:19.846744 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f61f5-54be-4036-9ca7-728b027197fc service neutron] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:19.847090 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f61f5-54be-4036-9ca7-728b027197fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:19.847430 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f61f5-54be-4036-9ca7-728b027197fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:19.857380 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f61f5-54be-4036-9ca7-728b027197fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:19.859450 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f61f5-54be-4036-9ca7-728b027197fc service neutron] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:19.868750 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 669/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:24.159799 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b9ded-d561-4f1a-9616-63607fa1ec5d None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:24.160299 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b9ded-d561-4f1a-9616-63607fa1ec5d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:24.160414 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b9ded-d561-4f1a-9616-63607fa1ec5d None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:24.161849 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 678/1347] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:24.167031 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949400e-519a-4092-a02d-2c9f4da3b929 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:24.167436 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949400e-519a-4092-a02d-2c9f4da3b929 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:24.167665 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949400e-519a-4092-a02d-2c9f4da3b929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:24.184881 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-7949400e-519a-4092-a02d-2c9f4da3b929 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:24.187555 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-7949400e-519a-4092-a02d-2c9f4da3b929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:24.194668 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 670/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:24.232582 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b9ded-d561-4f1a-9616-63607fa1ec5d None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:24.243998 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b9ded-d561-4f1a-9616-63607fa1ec5d None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:24.247456 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112bc4-4d3e-4a22-81d9-b1d082df0f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243986a25be4ad0866b80d488ab5d7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:24.248125 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112bc4-4d3e-4a22-81d9-b1d082df0f39 service neutron] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:24.248411 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112bc4-4d3e-4a22-81d9-b1d082df0f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:24.248688 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112bc4-4d3e-4a22-81d9-b1d082df0f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:24.257646 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93112bc4-4d3e-4a22-81d9-b1d082df0f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:24.259063 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93112bc4-4d3e-4a22-81d9-b1d082df0f39 service neutron] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:24.268978 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 679/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:29.806269 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d8a3-89fd-41b3-97f2-1cc0983a1a01 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:29.807218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d8a3-89fd-41b3-97f2-1cc0983a1a01 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:29.807645 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d8a3-89fd-41b3-97f2-1cc0983a1a01 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:29.809527 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 671/1350] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:29.820480 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33c10-2179-4053-b02e-ff8a757a952f None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:29.821353 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33c10-2179-4053-b02e-ff8a757a952f None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:29.821778 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33c10-2179-4053-b02e-ff8a757a952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:29.898503 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-bad33c10-2179-4053-b02e-ff8a757a952f None None] MFA Rules not processed for user `c51cf23836aa4601b54d7a7369cef09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:29.899967 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-bad33c10-2179-4053-b02e-ff8a757a952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:29.973932 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 680/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:08:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:34.479641 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327ff1-d109-4773-934e-6f52359ff596 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:34.480213 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327ff1-d109-4773-934e-6f52359ff596 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:34.480593 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34327ff1-d109-4773-934e-6f52359ff596 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:34.482449 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 672/1352] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:34.488623 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf4871-cca2-4af8-ba60-ac8a6b237d62 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:34.489515 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf4871-cca2-4af8-ba60-ac8a6b237d62 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:34.489869 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf4871-cca2-4af8-ba60-ac8a6b237d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:34.508434 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-83bf4871-cca2-4af8-ba60-ac8a6b237d62 None None] MFA Rules not processed for user `c51cf23836aa4601b54d7a7369cef09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:34.510324 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-83bf4871-cca2-4af8-ba60-ac8a6b237d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:34.519830 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 681/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:08:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:36.090996 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85449-5e9a-49d6-b031-6ccde3f08d93 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:36.091444 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85449-5e9a-49d6-b031-6ccde3f08d93 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:36.091712 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d85449-5e9a-49d6-b031-6ccde3f08d93 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:36.093502 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 673/1354] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:36.098404 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0267e-b198-47c6-aa97-4c71f6cfdbe8 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:36.098798 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0267e-b198-47c6-aa97-4c71f6cfdbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:36.098963 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0267e-b198-47c6-aa97-4c71f6cfdbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:36.118256 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-0aa0267e-b198-47c6-aa97-4c71f6cfdbe8 None None] MFA Rules not processed for user `c51cf23836aa4601b54d7a7369cef09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:36.119434 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-0aa0267e-b198-47c6-aa97-4c71f6cfdbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:36.128869 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 682/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:08:40.144465 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561670-aaf0-4289-a015-9508f9109417 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:40.145041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561670-aaf0-4289-a015-9508f9109417 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:40.145041 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a561670-aaf0-4289-a015-9508f9109417 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:40.146633 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 674/1356] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:40.151887 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163887b-c184-4e5c-8ce9-47a2d3cb2c85 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:40.152307 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163887b-c184-4e5c-8ce9-47a2d3cb2c85 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:40.152508 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163887b-c184-4e5c-8ce9-47a2d3cb2c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:40.171349 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-e163887b-c184-4e5c-8ce9-47a2d3cb2c85 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:40.172937 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-e163887b-c184-4e5c-8ce9-47a2d3cb2c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:40.181257 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 683/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:40.231035 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2718b2-8468-470d-9417-e7792a7ef1c7 None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:40.231452 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2718b2-8468-470d-9417-e7792a7ef1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:40.231858 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2718b2-8468-470d-9417-e7792a7ef1c7 None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:40.233346 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 675/1358] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 9 15:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:40.238960 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a6cd-9356-434f-92c6-14c30cf9787d None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:40.239453 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a6cd-9356-434f-92c6-14c30cf9787d None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:40.239812 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6a6cd-9356-434f-92c6-14c30cf9787d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:40.292296 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-2bf6a6cd-9356-434f-92c6-14c30cf9787d None None] MFA Rules not processed for user `4b31cba57e024daf84c6359b7e6a81cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:40.293826 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-2bf6a6cd-9356-434f-92c6-14c30cf9787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:40.380046 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 684/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 9 15:08:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:40.387943 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2718b2-8468-470d-9417-e7792a7ef1c7 None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:40.404157 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2718b2-8468-470d-9417-e7792a7ef1c7 None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:40.410621 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a88fe5-5c12-47a8-960f-cee717e7bccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b31cba57e024daf84c6359b7e6a81cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:40.411319 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88fe5-5c12-47a8-960f-cee717e7bccb service nova] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:40.411666 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88fe5-5c12-47a8-960f-cee717e7bccb service nova] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:40.412149 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a88fe5-5c12-47a8-960f-cee717e7bccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:40.421234 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88fe5-5c12-47a8-960f-cee717e7bccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:40.423844 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a88fe5-5c12-47a8-960f-cee717e7bccb service nova] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:40.434095 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 676/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:42.914897 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf160618-6e86-46a1-81b1-83e5327a1f58 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:42.915409 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf160618-6e86-46a1-81b1-83e5327a1f58 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:42.915409 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf160618-6e86-46a1-81b1-83e5327a1f58 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:42.916740 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 685/1361] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:42.922627 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81d881-63b3-4785-bc49-afadcd43364b None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:42.923278 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81d881-63b3-4785-bc49-afadcd43364b None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:42.923278 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81d881-63b3-4785-bc49-afadcd43364b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:42.940995 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-2e81d881-63b3-4785-bc49-afadcd43364b None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:42.942187 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-2e81d881-63b3-4785-bc49-afadcd43364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:42.950410 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 677/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:43.009044 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf160618-6e86-46a1-81b1-83e5327a1f58 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:43.029320 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf160618-6e86-46a1-81b1-83e5327a1f58 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:43.035931 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683d322-570d-49e9-8917-9f6b81fbb1bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b31cba57e024daf84c6359b7e6a81cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:43.036670 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683d322-570d-49e9-8917-9f6b81fbb1bf service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:43.036951 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683d322-570d-49e9-8917-9f6b81fbb1bf service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:43.037226 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683d322-570d-49e9-8917-9f6b81fbb1bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:43.046723 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683d322-570d-49e9-8917-9f6b81fbb1bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:43.048387 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683d322-570d-49e9-8917-9f6b81fbb1bf service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:43.058196 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 686/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:45.609073 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff84a99-3ffa-4fe8-9ea6-7ae1ef46077f None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:45.609671 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff84a99-3ffa-4fe8-9ea6-7ae1ef46077f None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:45.609671 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff84a99-3ffa-4fe8-9ea6-7ae1ef46077f None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:45.610998 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 678/1364] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:45.616445 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d065a-6727-4209-8fd0-01a80d6233fc None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:45.616869 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d065a-6727-4209-8fd0-01a80d6233fc None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:45.617011 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d065a-6727-4209-8fd0-01a80d6233fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:45.635314 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-352d065a-6727-4209-8fd0-01a80d6233fc None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:45.636561 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-352d065a-6727-4209-8fd0-01a80d6233fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:45.645841 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 687/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:45.691495 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90969da-f402-497e-88dc-f1eb1e1df09b None None] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:45.692100 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90969da-f402-497e-88dc-f1eb1e1df09b None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:45.692464 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90969da-f402-497e-88dc-f1eb1e1df09b None None] PATH_INFO: `/` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:45.694218 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 679/1366] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 9 15:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:45.700078 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521aa4d-29e0-4619-b454-6928a38cdd41 None None] REQUEST_METHOD: `POST` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:45.700365 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521aa4d-29e0-4619-b454-6928a38cdd41 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:45.700638 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521aa4d-29e0-4619-b454-6928a38cdd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:45.720331 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.auth.core [None req-4521aa4d-29e0-4619-b454-6928a38cdd41 None None] MFA Rules not processed for user `4b31cba57e024daf84c6359b7e6a81cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:45.721500 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.fernet_utils [None req-4521aa4d-29e0-4619-b454-6928a38cdd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:45.730774 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 688/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 9 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:45.738359 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90969da-f402-497e-88dc-f1eb1e1df09b None None] Authenticating user token {{(pid=80127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:45.753173 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90969da-f402-497e-88dc-f1eb1e1df09b None None] Validating token access rules against request {{(pid=80127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:45.758440 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac6647-638f-4b3d-b07a-162a588a0617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b31cba57e024daf84c6359b7e6a81cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:45.759076 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6647-638f-4b3d-b07a-162a588a0617 service nova] REQUEST_METHOD: `GET` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:45.759353 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6647-638f-4b3d-b07a-162a588a0617 service nova] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:45.759623 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6647-638f-4b3d-b07a-162a588a0617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:45.768652 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac6647-638f-4b3d-b07a-162a588a0617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:45.770227 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac6647-638f-4b3d-b07a-162a588a0617 service nova] RBAC: Authorization granted {{(pid=80127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:45.781082 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 680/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:08:46.630737 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0dbae-8556-44d9-b41e-4dd6c21798b9 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:46.631310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0dbae-8556-44d9-b41e-4dd6c21798b9 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:46.631310 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0dbae-8556-44d9-b41e-4dd6c21798b9 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:46.633022 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 689/1369] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:46.638228 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b47f12-fe3c-4b19-9423-9b504d0dfa33 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:46.638678 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b47f12-fe3c-4b19-9423-9b504d0dfa33 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:46.638771 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b47f12-fe3c-4b19-9423-9b504d0dfa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:46.658590 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-11b47f12-fe3c-4b19-9423-9b504d0dfa33 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:46.660549 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-11b47f12-fe3c-4b19-9423-9b504d0dfa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:46.670209 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 681/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:48.156379 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fab48d-8dd0-4cc0-a3b4-1f4b06c5c6d3 None None] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:48.156944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fab48d-8dd0-4cc0-a3b4-1f4b06c5c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:48.156944 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fab48d-8dd0-4cc0-a3b4-1f4b06c5c6d3 None None] PATH_INFO: `/` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:48.158266 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 690/1371] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:08:48.163603 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2416a-c704-4676-b654-3e861a7dccc0 None None] REQUEST_METHOD: `POST` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:48.164044 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2416a-c704-4676-b654-3e861a7dccc0 None None] SCRIPT_NAME: `/identity` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:48.164178 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2416a-c704-4676-b654-3e861a7dccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:48.181400 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.auth.core [None req-d8c2416a-c704-4676-b654-3e861a7dccc0 None None] MFA Rules not processed for user `f4e589d5b5944217aa6bbd924fcc21dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:08:48.182572 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: DEBUG keystone.common.fernet_utils [None req-d8c2416a-c704-4676-b654-3e861a7dccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:08:48.190967 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: [pid: 80127|app: 0|req: 682/1372] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:08:48.241920 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fab48d-8dd0-4cc0-a3b4-1f4b06c5c6d3 None None] Authenticating user token {{(pid=80128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:08:48.257249 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fab48d-8dd0-4cc0-a3b4-1f4b06c5c6d3 None None] Validating token access rules against request {{(pid=80128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:08:48.262602 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfe37f-9cdc-46bd-bba7-5767ebfe9286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b31cba57e024daf84c6359b7e6a81cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '419b0bc00313443fad69015a99f495ae', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:08:48.263228 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe37f-9cdc-46bd-bba7-5767ebfe9286 service nova] REQUEST_METHOD: `GET` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:08:48.263508 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe37f-9cdc-46bd-bba7-5767ebfe9286 service nova] SCRIPT_NAME: `/identity` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:08:48.263802 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe37f-9cdc-46bd-bba7-5767ebfe9286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:08:48.272347 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe37f-9cdc-46bd-bba7-5767ebfe9286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:08:48.273925 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfe37f-9cdc-46bd-bba7-5767ebfe9286 service nova] RBAC: Authorization granted {{(pid=80128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:08:48.283410 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: [pid: 80128|app: 0|req: 691/1373] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:09:10.154283 dv-cinder-841125-1-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 09 15:09:10.154651 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: Mon May 9 15:09:10 2022 - graceful shutdown triggered... May 09 15:09:10.155163 dv-cinder-841125-1-iscsi devstack@keystone.service[80127]: Gracefully killing worker 1 (pid: 80127)... May 09 15:09:10.155610 dv-cinder-841125-1-iscsi devstack@keystone.service[80128]: Gracefully killing worker 2 (pid: 80128)... May 09 15:09:11.155783 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: worker 1 buried after 1 seconds May 09 15:09:11.156177 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: worker 2 buried after 1 seconds May 09 15:09:11.156177 dv-cinder-841125-1-iscsi devstack@keystone.service[80117]: goodbye to uWSGI. May 09 15:09:11.157360 dv-cinder-841125-1-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 09 15:09:11.157904 dv-cinder-841125-1-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 09 15:14:34.847584 dv-cinder-841125-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 15:14:34.855234 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 15:14:34 2022] *** May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: nodename: dv-cinder-841125-1-iscsi May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: machine: x86_64 May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: clock source: unix May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: pcre jit disabled May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: detected number of CPU cores: 4 May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: current working directory: / May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: detected binary path: /usr/bin/uwsgi-core May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: your processes number limit is 47680 May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: your memory page size is 4096 bytes May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: detected max file descriptor number: 2048 May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: lock engine: pthread robust mutexes May 09 15:14:34.858587 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: thunder lock: enabled May 09 15:14:34.862177 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 15:14:34.862177 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 15:14:34.905047 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: Python main interpreter initialized at 0x5564428cf9c0 May 09 15:14:34.905047 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: python threads support enabled May 09 15:14:34.905047 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: your server socket listen backlog is limited to 100 connections May 09 15:14:34.905047 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: your mercy for graceful operations on workers is 90 seconds May 09 15:14:34.905503 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: mapped 403077 bytes (393 KB) for 2 cores May 09 15:14:34.905586 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: *** Operational MODE: preforking *** May 09 15:14:34.905819 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: *** uWSGI is running in multiple interpreter mode *** May 09 15:14:34.905819 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: spawned uWSGI master process (pid: 143171) May 09 15:14:34.906025 dv-cinder-841125-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 15:14:34.907191 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: spawned uWSGI worker 1 (pid: 143187, cores: 1) May 09 15:14:34.907191 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: spawned uWSGI worker 2 (pid: 143188, cores: 1) May 09 15:14:34.907191 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 15:14:40.773291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:14:40.773291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: from cryptography.utils import int_from_bytes May 09 15:14:40.774182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:14:40.774182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: from cryptography.utils import int_from_bytes May 09 15:14:40.774671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:14:40.774671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: from cryptography.utils import int_from_bytes May 09 15:14:40.775166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:14:40.775166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: from cryptography.utils import int_from_bytes May 09 15:14:40.824047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:14:40.824229 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:14:40.824448 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] command line args: [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:14:40.824546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:14:40.824704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:14:40.824823 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:14:40.824906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ================================================================================ {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:14:40.824990 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] command line args: [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:14:40.825160 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] admin_token = **** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.825268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:14:40.825268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ================================================================================ {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:14:40.825436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] config_dir = [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.825519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.825607 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] admin_token = **** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.825696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] config_source = [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.825773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] config_dir = [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.825855 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] debug = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.825933 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.826171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.828498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] config_source = [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.828498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] debug = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.828659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.828740 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.828850 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] insecure_debug = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.828941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829110 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] insecure_debug = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829187 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] list_limit = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829415 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829485 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] log_config_append = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] list_limit = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] log_config_append = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829823 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] log_dir = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829903 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.829974 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] log_file = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830055 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] log_dir = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] log_file = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830290 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830453 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830621 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830707 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830778 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830855 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.830934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831281 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831358 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831440 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831597 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.831677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.832830 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.833063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.833288 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.833513 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.833747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.834005 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.834255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] notification_format = cadf {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.834483 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.834706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.834926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] notification_format = cadf {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.834926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.835332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.835332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] publish_errors = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.835332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.836008 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.836008 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] publish_errors = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.836428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.836428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.836861 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.837068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.837284 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.837284 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.837726 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.837929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.838163 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] standard_threads = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.838313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.838521 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] strict_password_check = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.838687 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] standard_threads = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.838845 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.838845 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] use_eventlog = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.839150 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] strict_password_check = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.839302 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] use_journal = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.839470 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.839628 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] use_json = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.839803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] use_eventlog = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.839969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] use_stderr = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.840124 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] use_journal = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.840269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] use_syslog = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.840419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] use_json = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.840578 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] watch_log_file = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.840742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] use_stderr = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.840742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] use_syslog = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.841028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.841179 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] watch_log_file = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:14:40.841340 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.841493 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.841639 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.841887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.842043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.842043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.842335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.842479 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.842634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.842791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.842936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.843095 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.843258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.843414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.843573 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.843727 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.843937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.844101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.844252 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.844403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.844560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.844714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.844858 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.845002 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.845161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.845318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.845478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.845661 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.845808 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.846005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.846161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.846312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.846459 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.846615 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.846781 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.846926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.847091 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.847255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.847406 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.848164 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.848381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.848530 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.848675 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.848839 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.849013 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.849180 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.849340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.849485 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.849629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.849787 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.849944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.850102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.850249 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.850404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.850560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.850756 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.850922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.851088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.851240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.851398 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.851563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.851715 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.851944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.852108 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.852261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.852413 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.852567 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.852721 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.852879 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.853024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.853167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.853318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.853318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.853616 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.853768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.853919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.854076 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.854221 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.854381 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.854537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.854700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.854852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.854996 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.855139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.855289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.855442 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.855601 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.855752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.855932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.856091 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.856242 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.856396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.856557 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.856724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.856892 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.857045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.857203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.857355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.857508 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.857666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.857821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.857965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.858108 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.858257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.858413 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.858569 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.858719 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.858879 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.859024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.859185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.859352 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.859503 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.859659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.859852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.860010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.860155 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.860317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.860468 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.860613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.860757 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.860916 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.861072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.861226 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.861386 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.861531 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.861692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.861850 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.862005 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.862150 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.862150 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.862431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.862431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.862720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.862882 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.863049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.863234 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.863385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.863529 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.863673 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.863673 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.863987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.864150 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.864295 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.864451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.864613 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.864613 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.864945 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.enabled = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.865112 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.865268 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.865427 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.865572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.865715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.865867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.865867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.866147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.enabled = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.866298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.866443 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.866607 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.866760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.866920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.867083 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.867243 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.867387 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.867540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.867685 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.867868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.868039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.868201 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.868353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.868507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.868687 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.868987 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.869155 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.869320 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.869475 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.869629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.869773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.869927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.870085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.870237 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.870396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.870568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.870857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.871036 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.871192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.871344 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.871509 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.871752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.871978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.872139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.872291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.872448 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.872600 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.872756 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.872907 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.873052 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.873202 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.873362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.873506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.873759 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.873922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.874086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.874231 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.874375 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] auth.external = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.874535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.874689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] auth.mapped = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.874841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.874985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.875217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.875392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.875547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.875701 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] auth.password = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.875881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] auth.external = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.876041 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] auth.token = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.876197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] auth.mapped = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.876349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.876518 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.876676 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] catalog.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.876841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.877006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.877169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] auth.password = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.877323 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.877468 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] auth.token = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.877624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.877778 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.877923 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.878115 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] catalog.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.878264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.878419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.878575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] credential.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.878729 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.878932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] credential.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.878932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.879225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.879372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.879535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.879691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.879872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.879872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] credential.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.880154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.880154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.880463 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] credential.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.880622 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.880768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.880920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.881076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.881221 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.881364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.881521 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.881673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.881673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.881958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.882160 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.882310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.882473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.882727 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.882892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.883040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.883183 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.883338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.883338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] federation.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.883629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.883867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.884028 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.884174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] federation.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.884333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.884493 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.884644 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.884801 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.884958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.885125 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.885286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] federation.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.885440 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.885584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.885738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.885896 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] federation.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.886041 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.886184 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.886335 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.886494 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.886638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.886781 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.886951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.887105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.887250 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.887536 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.887694 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.887892 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.888055 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.888200 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.888343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.888486 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.888641 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.888791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.888991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.889263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.889443 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.889604 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.889793 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.889943 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.890098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.890260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.890405 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.890549 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.890700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.890845 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.891003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.891162 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.891306 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.891450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.891594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.891750 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.891930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.892076 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.892220 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.892365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.892516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.892669 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.892823 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.892980 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.893138 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.893294 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.893449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.893602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.893818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.893966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.894120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.894265 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.894965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.895141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.895301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.895454 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.895746 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.895936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.896107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.896259 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.896424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.896588 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.896739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.896897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.897148 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.897384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.897556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.897716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.897874 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.898026 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.898183 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.898353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.898524 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.898676 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.898827 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.898990 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.899142 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.899302 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.899467 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.899628 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.password = **** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.899804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.899970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.900131 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.900300 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.900465 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.900628 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.900780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.900943 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.901095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.901254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.901418 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.password = **** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.901571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.901720 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.901878 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.902030 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.902194 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.902346 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.902508 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.902660 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.902828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.902987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.903151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.903318 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.903475 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.903475 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.903817 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.904062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.904224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.904392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.904543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.904695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.904846 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.905006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.905169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.905320 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.905470 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.905470 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.905772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.905938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.906090 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.906249 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.906400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.906557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.906708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.906708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.907023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.907186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.907343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.907505 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.907656 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.907836 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.907995 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.908146 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.908307 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.908459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.908610 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.908769 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.908931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.909089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.909251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.909419 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.909570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.909730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.909895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.910112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.910885 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.911050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.911201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.911370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.911529 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.911687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.911947 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.912119 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.912291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.912646 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.912820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.912987 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.913140 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.913298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.913457 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.913627 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.913787 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.913939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] policy.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.914101 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.914254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.914412 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.914610 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.914780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.914940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.915091 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.915253 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] receipt.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.915404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.915575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.915728 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.915904 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.916057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] policy.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.916207 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.916360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.916523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.916676 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.916847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.917000 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.917150 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] resource.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.917311 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] receipt.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.917476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.917639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.917791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] resource.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.917941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.918099 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.918269 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.918432 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.918585 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.918735 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.918898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.919062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] revoke.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.919213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] resource.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.919382 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.919536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.919688 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.919890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] resource.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.920045 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] role.cache_time = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.920207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.920368 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] role.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.920531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.920690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] role.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.920842 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.921000 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] role.list_limit = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.921161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] revoke.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.921332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.921494 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.921646 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.921797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.921956 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.922123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] role.cache_time = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.922275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.922426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] role.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.922737 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] role.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.922895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.923056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] role.list_limit = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.923208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.923378 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.923530 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.923691 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.923892 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.924055 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.924211 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.924376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.924529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.924694 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.924847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.925017 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.925172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.925324 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.925488 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.925651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.925942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.926131 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.926287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.926457 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.926650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.926883 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.927056 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.927223 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.927390 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.927563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.927718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.927912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.928066 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.928239 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.928393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.928544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.928697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.928857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.929029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.929194 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.929347 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.929498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.929657 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.929821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.930000 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.930152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.930304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.930455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.930605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.930769 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.930947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.931099 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.931250 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.931411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.931564 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] token.cache_time = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.931910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] token.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.932072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.932235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.932386 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.932536 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] token.provider = fernet {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.932536 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.932838 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.932838 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.933138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.933303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.933455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.933618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] token.cache_time = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.933789 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.933941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] token.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.934093 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.934255 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.934407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.934573 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] token.provider = fernet {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.934735 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] trust.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.934886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.935036 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.935036 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.935340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.935492 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.935651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.935875 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.936042 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.936195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.936353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.936514 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.936680 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.936845 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.936997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] trust.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.936997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.937312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.937463 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.937637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.connection = **** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.937791 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.937955 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.938114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.938276 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.938428 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.938585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.938755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.938906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.939064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.939225 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.939225 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.939514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.939664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.939847 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.connection = **** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.940022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.940243 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.940416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.940583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.940818 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.940985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.941149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.941309 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.941642 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.941877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.941877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.942249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.942416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.942569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.942720 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.942870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.943033 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.943198 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.943351 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.943514 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.943514 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.943882 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.944053 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:14:40.944207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.944207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.944207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.944207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.944207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.944207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.944207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:14:40.944207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:14:40.945330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.945330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.945330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.945780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.952727 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.953780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.983425 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.983425 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.985231 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:40.985231 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.039717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.040891 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.091573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.091896 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.093950 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.094181 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.156739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.157047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.157226 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.157409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.157583 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.157782 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.157953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.158175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.158409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.158632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.158851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.159069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.181998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.182248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.182435 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.182599 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.182768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.182933 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.183093 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.183252 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.183423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.183586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.183754 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.183949 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.184121 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.184285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.195380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.195652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.210098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.210378 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.210560 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.210731 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.210904 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.211069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.211224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.211389 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.211547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.211712 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.211951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.211951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.211951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.212527 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:14:41.229050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.229269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:14:41.229561 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.229730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.229897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:14:41.230061 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:14:41.230230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.230381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.230541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.230693 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:14:41.230851 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.231015 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.231177 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.231340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.231340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.231340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.242459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.242717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.242981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.243259 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.243420 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.243644 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.243945 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.244228 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.251361 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.252347 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.254725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.254993 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.255267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.255653 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.255953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.256125 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.256285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.256456 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.256608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.256758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.256913 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.257096 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.257261 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.257412 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.257575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.257727 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.257876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.258036 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.258036 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.258331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.258486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.258696 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.287257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.288934 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.289221 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.293132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.294565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.294792 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.294978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.295143 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.295296 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.300437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.301300 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.301583 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.303531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.303840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.308467 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.308757 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.308967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.309137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.309296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.309456 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.309618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.309826 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.310095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.310362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.313940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.314180 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.314424 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.314704 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.314975 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.315243 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.315507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.315792 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.330100 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.330380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.335339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.335545 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.335727 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.339109 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.339406 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.340143 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.344232 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.344423 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.344608 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.348938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.349783 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.352752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.353050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.353334 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.353529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.353697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.353883 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.354165 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.357096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.357394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.357677 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.357957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.358230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.358502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.374359 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.374717 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.374989 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.375255 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.378397 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.378858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.379131 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.379447 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.383650 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.385398 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.385677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.387311 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.388750 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.389037 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.389219 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.389389 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.389554 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.389762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.389929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.392359 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.392638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.392912 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.393194 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.393467 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.403903 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.404184 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.404464 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.404751 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.405045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.405369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.405662 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.407059 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.407335 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.407608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.407915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.408191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.408475 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.408740 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.424935 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.427998 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.429211 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.431252 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.432519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.434132 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.434613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.435755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.436063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.436235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.436409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.437870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.438154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.438439 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.444956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.446520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.446686 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.448417 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.450045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.450340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.450625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.450900 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.451657 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.451965 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.452245 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.452518 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.461193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.461481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.461760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.462374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.462666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.462944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.471804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=143187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.471804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.471804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.471804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.471804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=143188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:14:41.472382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472504 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472598 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472692 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.472961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.473353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.473353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.473616 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=143187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.475908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.476250 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.476545 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.476856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.477137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.477418 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.477710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.477999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.478271 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.478536 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=143188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:14:41.513925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5564428cf9c0 pid: 143187 (default app) May 09 15:14:41.517396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfdef-80d1-4773-96f1-7135c992bc32 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:41.517699 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfdef-80d1-4773-96f1-7135c992bc32 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:41.517985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfdef-80d1-4773-96f1-7135c992bc32 None None] PATH_INFO: `/v3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:41.518525 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5564428cf9c0 pid: 143188 (default app) May 09 15:14:41.523030 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Mon May 9 15:14:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:14:49.660645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d6a1-0f29-49d2-8581-9183c1bf77bd None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:49.661209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d6a1-0f29-49d2-8581-9183c1bf77bd None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:49.661209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d6a1-0f29-49d2-8581-9183c1bf77bd None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:49.665507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:14:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:14:49.670897 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:49.671310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:49.671455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:49.702786 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG oslo_db.sqlalchemy.engines [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:14:49.886096 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG passlib.handlers.bcrypt [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=143187) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:14:49.886429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG passlib.handlers.bcrypt [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=143187) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:14:49.941659 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:14:49.943288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:14:50.064473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:14:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:14:50.087977 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d6a1-0f29-49d2-8581-9183c1bf77bd None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:50.121860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG oslo_db.sqlalchemy.engines [None req-45a8d6a1-0f29-49d2-8581-9183c1bf77bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:14:50.249435 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d6a1-0f29-49d2-8581-9183c1bf77bd None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:50.254289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2e002-d7e9-4876-8f31-e230f5d835ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6755b8fadb0f418da6fcc341947da499', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:50.254966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e002-d7e9-4876-8f31-e230f5d835ed admin admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:50.255247 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e002-d7e9-4876-8f31-e230f5d835ed admin admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:50.255523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e002-d7e9-4876-8f31-e230f5d835ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:50.263421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2e002-d7e9-4876-8f31-e230f5d835ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:50.315476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c5a2e002-d7e9-4876-8f31-e230f5d835ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:14:50.315828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2e002-d7e9-4876-8f31-e230f5d835ed admin admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:50.326158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 9 15:14:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:14:50.332772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:50.346899 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc420a-a881-426b-a40c-c441669113ac None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:50.351964 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbfcfb-aec5-496d-8ca0-2ba4ddcad83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6755b8fadb0f418da6fcc341947da499', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:50.353089 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfcfb-aec5-496d-8ca0-2ba4ddcad83a admin admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:50.353377 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfcfb-aec5-496d-8ca0-2ba4ddcad83a admin admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:50.353655 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbfcfb-aec5-496d-8ca0-2ba4ddcad83a admin admin] PATH_INFO: `/v3/projects/6755b8fadb0f418da6fcc341947da499` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:50.355238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbfcfb-aec5-496d-8ca0-2ba4ddcad83a admin admin] RBAC: Authorizing `identity:get_project(project_id=6755b8fadb0f418da6fcc341947da499)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:50.405865 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bfdbfcfb-aec5-496d-8ca0-2ba4ddcad83a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:14:50.406210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbfcfb-aec5-496d-8ca0-2ba4ddcad83a admin admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:50.410805 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Mon May 9 15:14:50 2022] GET /identity/v3/projects/6755b8fadb0f418da6fcc341947da499 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:14:52.673615 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36494f-8b43-4f5b-9419-c46d5fe2d629 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:52.674143 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36494f-8b43-4f5b-9419-c46d5fe2d629 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:52.674238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36494f-8b43-4f5b-9419-c46d5fe2d629 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:52.680452 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:14:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:14:52.684813 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da30b5-3cde-48e1-b41e-bb030e0861c5 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:52.685282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da30b5-3cde-48e1-b41e-bb030e0861c5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:52.685399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da30b5-3cde-48e1-b41e-bb030e0861c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:52.706123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-01da30b5-3cde-48e1-b41e-bb030e0861c5 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:14:52.708280 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-01da30b5-3cde-48e1-b41e-bb030e0861c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:14:52.716113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:14:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:14:52.738319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36494f-8b43-4f5b-9419-c46d5fe2d629 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:52.750568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36494f-8b43-4f5b-9419-c46d5fe2d629 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:52.755526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828af7f1-8538-4893-ab42-7fe4c7b66a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6755b8fadb0f418da6fcc341947da499', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:52.756195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af7f1-8538-4893-ab42-7fe4c7b66a84 admin admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:52.756480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af7f1-8538-4893-ab42-7fe4c7b66a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:52.756757 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828af7f1-8538-4893-ab42-7fe4c7b66a84 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:52.764328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828af7f1-8538-4893-ab42-7fe4c7b66a84 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:52.766096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828af7f1-8538-4893-ab42-7fe4c7b66a84 admin admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:52.775400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 9 15:14:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:14:52.780690 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da30b5-3cde-48e1-b41e-bb030e0861c5 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:52.789574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da30b5-3cde-48e1-b41e-bb030e0861c5 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:52.793961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372525e8-a3d2-49b5-9258-cb9ad16a103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6755b8fadb0f418da6fcc341947da499', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:52.794804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372525e8-a3d2-49b5-9258-cb9ad16a103f admin admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:52.795086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372525e8-a3d2-49b5-9258-cb9ad16a103f admin admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:52.795359 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372525e8-a3d2-49b5-9258-cb9ad16a103f admin admin] PATH_INFO: `/v3/users/51d9969637e5400cad1f18de76cb1fd3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:52.796785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372525e8-a3d2-49b5-9258-cb9ad16a103f admin admin] RBAC: Authorizing `identity:get_user(user_id=51d9969637e5400cad1f18de76cb1fd3)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:52.798587 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372525e8-a3d2-49b5-9258-cb9ad16a103f admin admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:52.800889 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Mon May 9 15:14:52 2022] GET /identity/v3/users/51d9969637e5400cad1f18de76cb1fd3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:14:55.095364 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aae59-5ccf-4f80-aecf-b65e7a5da832 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.095971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aae59-5ccf-4f80-aecf-b65e7a5da832 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.095971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aae59-5ccf-4f80-aecf-b65e7a5da832 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.097491 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:14:55.102792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfe1b-18f4-4627-bbd6-62070d9004cb None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.103212 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfe1b-18f4-4627-bbd6-62070d9004cb None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.103349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfe1b-18f4-4627-bbd6-62070d9004cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.136722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9cb4-198e-4992-a540-1a697ff96f16 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9cb4-198e-4992-a540-1a697ff96f16 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.137291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb9cb4-198e-4992-a540-1a697ff96f16 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.138683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:14:55.145221 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.145511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.145793 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.187745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG passlib.handlers.bcrypt [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=143188) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:14:55.188210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG passlib.handlers.bcrypt [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=143188) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:14:55.235445 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:14:55.237122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:14:55.247079 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-0f5bfe1b-18f4-4627-bbd6-62070d9004cb None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:14:55.248802 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-0f5bfe1b-18f4-4627-bbd6-62070d9004cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:14:55.336252 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:14:55.347426 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:14:55.360653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bfe1b-18f4-4627-bbd6-62070d9004cb None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:55.369946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:55.460189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bfe1b-18f4-4627-bbd6-62070d9004cb None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:55.468497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878c69-a22e-4f18-a132-1c409401a15d None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:55.495477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332536cb-bb12-4a9d-8b30-a1fa049f018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:55.496748 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332536cb-bb12-4a9d-8b30-a1fa049f018d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.497204 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332536cb-bb12-4a9d-8b30-a1fa049f018d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.497642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332536cb-bb12-4a9d-8b30-a1fa049f018d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.508041 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a131ec8-a12b-4bff-a344-400c82b4c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:55.509494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a131ec8-a12b-4bff-a344-400c82b4c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.509963 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a131ec8-a12b-4bff-a344-400c82b4c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.510440 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a131ec8-a12b-4bff-a344-400c82b4c3d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.514515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332536cb-bb12-4a9d-8b30-a1fa049f018d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-332536cb-bb12-4a9d-8b30-a1fa049f018d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:14:55.533593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:14:55.535213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:14:55.536857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 7/14] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:14:55.545305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332536cb-bb12-4a9d-8b30-a1fa049f018d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:55.615626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a131ec8-a12b-4bff-a344-400c82b4c3d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:55.617762 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a131ec8-a12b-4bff-a344-400c82b4c3d8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:55.651227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332536cb-bb12-4a9d-8b30-a1fa049f018d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:55.684420 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:55.685080 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.685367 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.685650 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.686410 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:14:55.686718 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:55.688129 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:55.700036 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 8/15] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:14:55.705553 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:55.714499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:14:55.720043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a131ec8-a12b-4bff-a344-400c82b4c3d8 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:55.808165 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455a590-d3f1-4204-82ee-756038821e53 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:55.844840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ce30-fb68-49c7-9a75-da11d9b3106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:55.845713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ce30-fb68-49c7-9a75-da11d9b3106e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.845999 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ce30-fb68-49c7-9a75-da11d9b3106e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.846279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32ce30-fb68-49c7-9a75-da11d9b3106e None admin] PATH_INFO: `/v3/users/51d9969637e5400cad1f18de76cb1fd3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.848094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32ce30-fb68-49c7-9a75-da11d9b3106e None admin] RBAC: Authorizing `identity:get_user(user_id=51d9969637e5400cad1f18de76cb1fd3)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:55.849554 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32ce30-fb68-49c7-9a75-da11d9b3106e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:55.851200 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 9/17] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:14:55 2022] GET /identity/v3/users/51d9969637e5400cad1f18de76cb1fd3 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:14:55.856617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ce30-fb68-49c7-9a75-da11d9b3106e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:55.924507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a131ec8-a12b-4bff-a344-400c82b4c3d8 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:55.952928 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32ce30-fb68-49c7-9a75-da11d9b3106e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:55.957231 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:55.958027 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.958314 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.958592 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.977175 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:55.978655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:55.985375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37f24e-41fd-4a6c-a703-121ac601b4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:55.986153 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f24e-41fd-4a6c-a703-121ac601b4be None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:55.986438 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f24e-41fd-4a6c-a703-121ac601b4be None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:55.986710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37f24e-41fd-4a6c-a703-121ac601b4be None admin] PATH_INFO: `/v3/domains/default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:55.988143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37f24e-41fd-4a6c-a703-121ac601b4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:55.989547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37f24e-41fd-4a6c-a703-121ac601b4be None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:55.991149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:14:55.996776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37f24e-41fd-4a6c-a703-121ac601b4be None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:14:55.998689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:14:55.999697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:14:56.000710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:14:56.000710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:14:56.000710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:14:56.000710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:14:56.000710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:14:56.005862 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:56.093181 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37f24e-41fd-4a6c-a703-121ac601b4be None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:56.100760 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef908e-e664-4fac-808d-3257912ed499 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:56.125887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1aa63-5a39-4184-b428-111515690ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:56.126537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1aa63-5a39-4184-b428-111515690ee7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:56.126888 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1aa63-5a39-4184-b428-111515690ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:56.127172 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1aa63-5a39-4184-b428-111515690ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:56.128037 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1aa63-5a39-4184-b428-111515690ee7 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.domain.id=default, user.id=51d9969637e5400cad1f18de76cb1fd3) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:14:56.128426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1aa63-5a39-4184-b428-111515690ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:56.129865 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1aa63-5a39-4184-b428-111515690ee7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:56.133316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410793d-0c1e-4d0e-a7a6-ef5a02df5e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:56.133984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410793d-0c1e-4d0e-a7a6-ef5a02df5e99 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:56.134269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410793d-0c1e-4d0e-a7a6-ef5a02df5e99 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:56.134550 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410793d-0c1e-4d0e-a7a6-ef5a02df5e99 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:56.135287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410793d-0c1e-4d0e-a7a6-ef5a02df5e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:14:56.135596 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410793d-0c1e-4d0e-a7a6-ef5a02df5e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:56.136490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 9 15:14:55 2022] GET /identity/v3/role_assignments?user.id=51d9969637e5400cad1f18de76cb1fd3&scope.domain.id=default&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:14:56.137019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410793d-0c1e-4d0e-a7a6-ef5a02df5e99 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:56.156808 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:14:58.906407 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de44c6-c986-4f06-9ee4-88b103562f36 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:58.907414 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de44c6-c986-4f06-9ee4-88b103562f36 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:58.907956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de44c6-c986-4f06-9ee4-88b103562f36 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:58.910844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:14:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:14:58.916037 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a58f-49c6-40a1-8399-4ad3b8b189c0 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:58.916902 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a58f-49c6-40a1-8399-4ad3b8b189c0 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:58.917403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a58f-49c6-40a1-8399-4ad3b8b189c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:58.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-f8b4a58f-49c6-40a1-8399-4ad3b8b189c0 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:14:58.938945 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-f8b4a58f-49c6-40a1-8399-4ad3b8b189c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:14:59.010581 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1d4d-2767-4c06-916a-ecbca2d2ed02 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.011239 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1d4d-2767-4c06-916a-ecbca2d2ed02 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.011753 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1d4d-2767-4c06-916a-ecbca2d2ed02 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.013671 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 13/23] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:14:59.020053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee499-7bd6-4d93-8251-5f3331ed9ab6 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.020616 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee499-7bd6-4d93-8251-5f3331ed9ab6 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.021109 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee499-7bd6-4d93-8251-5f3331ed9ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.025033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 11/24] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:14:59.047916 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-ef0ee499-7bd6-4d93-8251-5f3331ed9ab6 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:14:59.049528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-ef0ee499-7bd6-4d93-8251-5f3331ed9ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:14:59.062326 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87726ab-1cfb-40f4-9ecf-7bd127dc90a6 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.062607 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87726ab-1cfb-40f4-9ecf-7bd127dc90a6 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.062894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87726ab-1cfb-40f4-9ecf-7bd127dc90a6 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.064290 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 12/25] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:14:59.071203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87726ab-1cfb-40f4-9ecf-7bd127dc90a6 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:59.177120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 14/26] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:14:59.179711 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8962da-0017-4d41-8dde-24e917ecaf84 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.180029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8962da-0017-4d41-8dde-24e917ecaf84 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.180314 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8962da-0017-4d41-8dde-24e917ecaf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.215133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-8b8962da-0017-4d41-8dde-24e917ecaf84 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:14:59.224812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-8b8962da-0017-4d41-8dde-24e917ecaf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:14:59.269213 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87726ab-1cfb-40f4-9ecf-7bd127dc90a6 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:59.320652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:59.321479 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.321762 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.326849 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 15/27] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:14:59.327725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8962da-0017-4d41-8dde-24e917ecaf84 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:59.352984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:59.354944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:14:59.393430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:14:59.395193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:14:59.396178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:14:59.396178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:14:59.396178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:14:59.396178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:14:59.401000 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 13/28] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:14:59.405695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:59.530992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8962da-0017-4d41-8dde-24e917ecaf84 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:59.612831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0f910-9631-495d-9cc6-dfa1b0c88058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:59.613743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0f910-9631-495d-9cc6-dfa1b0c88058 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.615795 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0f910-9631-495d-9cc6-dfa1b0c88058 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.615795 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0f910-9631-495d-9cc6-dfa1b0c88058 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.615795 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0f910-9631-495d-9cc6-dfa1b0c88058 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:59.616428 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0f910-9631-495d-9cc6-dfa1b0c88058 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:59.620370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d55dbe-4fee-4da3-ab72-0c82c9cb3ae5 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:59.684631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a848bc-566b-4596-b18b-29f6a70d67e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:59.685431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a848bc-566b-4596-b18b-29f6a70d67e0 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.686135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a848bc-566b-4596-b18b-29f6a70d67e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.686135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a848bc-566b-4596-b18b-29f6a70d67e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.712118 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a848bc-566b-4596-b18b-29f6a70d67e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b2a848bc-566b-4596-b18b-29f6a70d67e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:14:59.721054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:14:59.724430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 14/29] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:14:59.726749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a848bc-566b-4596-b18b-29f6a70d67e0 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:59.825021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 16/30] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:14:59 2022] POST /identity/v3/roles => generated 219 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:14:59.831796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0f910-9631-495d-9cc6-dfa1b0c88058 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:14:59.876772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a848bc-566b-4596-b18b-29f6a70d67e0 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:14:59.952721 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466083b8-b082-4bdc-822f-31735ae6bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:14:59.953548 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466083b8-b082-4bdc-822f-31735ae6bf9d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.953700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466083b8-b082-4bdc-822f-31735ae6bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.953950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466083b8-b082-4bdc-822f-31735ae6bf9d None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.954699 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466083b8-b082-4bdc-822f-31735ae6bf9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:14:59.955008 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466083b8-b082-4bdc-822f-31735ae6bf9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:14:59.956574 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466083b8-b082-4bdc-822f-31735ae6bf9d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:14:59.976939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 15/31] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:14:59.978129 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1fd5-39f3-487a-ba86-614376abe84c None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:14:59.978416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1fd5-39f3-487a-ba86-614376abe84c None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:14:59.978689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1fd5-39f3-487a-ba86-614376abe84c None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:14:59.985126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 16/32] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:14:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:14:59.988328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1fd5-39f3-487a-ba86-614376abe84c None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:00.023424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0f910-9631-495d-9cc6-dfa1b0c88058 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:00.060988 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a404-1652-44d0-b879-617fa6e83e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:00.061666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a404-1652-44d0-b879-617fa6e83e55 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.061992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a404-1652-44d0-b879-617fa6e83e55 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.062274 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a404-1652-44d0-b879-617fa6e83e55 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.063111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a404-1652-44d0-b879-617fa6e83e55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:00.063396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a404-1652-44d0-b879-617fa6e83e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:00.065035 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a404-1652-44d0-b879-617fa6e83e55 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:00.076346 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 17/33] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:00.077655 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904f46-f6a8-4e84-8a86-5378f84ddc93 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.077951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904f46-f6a8-4e84-8a86-5378f84ddc93 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.078277 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904f46-f6a8-4e84-8a86-5378f84ddc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.097348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-9e904f46-f6a8-4e84-8a86-5378f84ddc93 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:00.099289 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-9e904f46-f6a8-4e84-8a86-5378f84ddc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:00.101067 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1fd5-39f3-487a-ba86-614376abe84c None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:00.140362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f8fa4-e2db-4c75-8510-3365bf2c8faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:00.141033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8fa4-e2db-4c75-8510-3365bf2c8faa None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.141312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8fa4-e2db-4c75-8510-3365bf2c8faa None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.141583 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8fa4-e2db-4c75-8510-3365bf2c8faa None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.142543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f8fa4-e2db-4c75-8510-3365bf2c8faa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:00.144653 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f8fa4-e2db-4c75-8510-3365bf2c8faa None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:00.176954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 18/34] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:00.178731 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ddb0-19d2-48e4-bbd2-b42b5bf6f435 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.179201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ddb0-19d2-48e4-bbd2-b42b5bf6f435 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.179720 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ddb0-19d2-48e4-bbd2-b42b5bf6f435 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.181217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 19/35] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:00.182098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552ddb0-19d2-48e4-bbd2-b42b5bf6f435 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:00.279063 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 17/36] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:14:59 2022] POST /identity/v3/projects => generated 301 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:00.280587 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb737-780b-4ad7-9bd0-19d04d3bd439 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.280882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb737-780b-4ad7-9bd0-19d04d3bd439 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.281214 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0eb737-780b-4ad7-9bd0-19d04d3bd439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.302294 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552ddb0-19d2-48e4-bbd2-b42b5bf6f435 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:00.309891 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-2e0eb737-780b-4ad7-9bd0-19d04d3bd439 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:00.312752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-2e0eb737-780b-4ad7-9bd0-19d04d3bd439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:00.356511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9acc67-d421-49df-9bbc-5f47597c3994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:00.357312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9acc67-d421-49df-9bbc-5f47597c3994 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.357594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9acc67-d421-49df-9bbc-5f47597c3994 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.357870 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9acc67-d421-49df-9bbc-5f47597c3994 None admin] PATH_INFO: `/v3/users/51d9969637e5400cad1f18de76cb1fd3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.359285 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9acc67-d421-49df-9bbc-5f47597c3994 None admin] RBAC: Authorizing `identity:get_user(user_id=51d9969637e5400cad1f18de76cb1fd3)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:00.361192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9acc67-d421-49df-9bbc-5f47597c3994 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:00.363874 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 20/37] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:00 2022] GET /identity/v3/users/51d9969637e5400cad1f18de76cb1fd3 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:00.365771 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9acc67-d421-49df-9bbc-5f47597c3994 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:00.399865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 18/38] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:00.399865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eb737-780b-4ad7-9bd0-19d04d3bd439 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:00.514464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0eb737-780b-4ad7-9bd0-19d04d3bd439 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:00.519324 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9acc67-d421-49df-9bbc-5f47597c3994 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:00.557555 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed93bc8-7903-484e-a0f2-dd308b8435c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:00.559544 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed93bc8-7903-484e-a0f2-dd308b8435c6 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.560097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed93bc8-7903-484e-a0f2-dd308b8435c6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.560656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed93bc8-7903-484e-a0f2-dd308b8435c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.562347 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed93bc8-7903-484e-a0f2-dd308b8435c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:00.562536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04020-1208-4f09-ae18-23e812819586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:00.563331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04020-1208-4f09-ae18-23e812819586 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.563625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04020-1208-4f09-ae18-23e812819586 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.563951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04020-1208-4f09-ae18-23e812819586 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.564714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa04020-1208-4f09-ae18-23e812819586 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:00.564998 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed93bc8-7903-484e-a0f2-dd308b8435c6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:00.566209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa04020-1208-4f09-ae18-23e812819586 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:00.567212 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 19/39] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:00.568253 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed93bc8-7903-484e-a0f2-dd308b8435c6 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:00.590553 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 21/40] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:15:00 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:00.591463 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04020-1208-4f09-ae18-23e812819586 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:00.688526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed93bc8-7903-484e-a0f2-dd308b8435c6 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:00.720844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04020-1208-4f09-ae18-23e812819586 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:00.728326 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d71e55-c2f5-400a-83eb-cb11234c35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:00.730121 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71e55-c2f5-400a-83eb-cb11234c35c3 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.730638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71e55-c2f5-400a-83eb-cb11234c35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.731563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71e55-c2f5-400a-83eb-cb11234c35c3 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.732961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71e55-c2f5-400a-83eb-cb11234c35c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:00.735292 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71e55-c2f5-400a-83eb-cb11234c35c3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:00.754236 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 20/41] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:15:00 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:00.755649 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5135e2-8a16-474e-a14b-dc713f828599 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.755978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5135e2-8a16-474e-a14b-dc713f828599 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.756267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5135e2-8a16-474e-a14b-dc713f828599 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.757731 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 21/42] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:00.758642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bd5bb-0d44-4afa-bb4a-58c0c5e7ea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:00.759622 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd5bb-0d44-4afa-bb4a-58c0c5e7ea75 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.759939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd5bb-0d44-4afa-bb4a-58c0c5e7ea75 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.760233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bd5bb-0d44-4afa-bb4a-58c0c5e7ea75 None admin] PATH_INFO: `/v3/domains/default/users/51d9969637e5400cad1f18de76cb1fd3/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.762840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd5bb-0d44-4afa-bb4a-58c0c5e7ea75 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=51d9969637e5400cad1f18de76cb1fd3, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:00.763378 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cec51e-151c-4c7e-9cd1-ca542059546c None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:00.763678 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cec51e-151c-4c7e-9cd1-ca542059546c None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:00.763995 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cec51e-151c-4c7e-9cd1-ca542059546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:00.764374 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bd5bb-0d44-4afa-bb4a-58c0c5e7ea75 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:00.783678 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-46cec51e-151c-4c7e-9cd1-ca542059546c None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:00.785495 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-46cec51e-151c-4c7e-9cd1-ca542059546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:00.788421 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 22/43] 10.222.0.32 () {58 vars in 1361 bytes} [Mon May 9 15:15:00 2022] PUT /identity/v3/domains/default/users/51d9969637e5400cad1f18de76cb1fd3/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:00.873062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 22/44] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:00.898480 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bd5bb-0d44-4afa-bb4a-58c0c5e7ea75 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:01.020263 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bd5bb-0d44-4afa-bb4a-58c0c5e7ea75 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:01.054787 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5217f5-31df-4823-8616-164c219440b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:01.055587 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5217f5-31df-4823-8616-164c219440b2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:01.055917 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5217f5-31df-4823-8616-164c219440b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:01.056205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5217f5-31df-4823-8616-164c219440b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:01.057390 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5217f5-31df-4823-8616-164c219440b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:01.058849 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5217f5-31df-4823-8616-164c219440b2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:01.060525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 23/45] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:01.066131 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cec51e-151c-4c7e-9cd1-ca542059546c None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:01.165355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cec51e-151c-4c7e-9cd1-ca542059546c None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:01.200359 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d0012-9af8-45c2-b9ab-6ab619d56917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:01.201032 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d0012-9af8-45c2-b9ab-6ab619d56917 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:01.201322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d0012-9af8-45c2-b9ab-6ab619d56917 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:01.201629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d0012-9af8-45c2-b9ab-6ab619d56917 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:01.202348 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d0012-9af8-45c2-b9ab-6ab619d56917 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:01.203844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d0012-9af8-45c2-b9ab-6ab619d56917 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:01.228137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:15:01 2022] POST /identity/v3/projects => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:03.085047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbff8b-d447-4d3b-ba40-18804eeccaa1 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.085631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbff8b-d447-4d3b-ba40-18804eeccaa1 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.085631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbff8b-d447-4d3b-ba40-18804eeccaa1 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.086994 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 24/47] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:03.092392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc726b28-0317-41cd-b0f9-6c5ea3a5bd2b None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.092827 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc726b28-0317-41cd-b0f9-6c5ea3a5bd2b None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.092943 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc726b28-0317-41cd-b0f9-6c5ea3a5bd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.109964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-cc726b28-0317-41cd-b0f9-6c5ea3a5bd2b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:03.111147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-cc726b28-0317-41cd-b0f9-6c5ea3a5bd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:03.176552 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:03.200343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbff8b-d447-4d3b-ba40-18804eeccaa1 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:03.300265 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbff8b-d447-4d3b-ba40-18804eeccaa1 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:03.333943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8179d3-ff37-49c6-9321-a221cb4b1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:03.334726 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8179d3-ff37-49c6-9321-a221cb4b1f4f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.335040 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8179d3-ff37-49c6-9321-a221cb4b1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.335368 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8179d3-ff37-49c6-9321-a221cb4b1f4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.345045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8179d3-ff37-49c6-9321-a221cb4b1f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-cd8179d3-ff37-49c6-9321-a221cb4b1f4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:03.353266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:03.354259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:03.355167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 25/49] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:03.360217 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc726b28-0317-41cd-b0f9-6c5ea3a5bd2b None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:03.458258 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc726b28-0317-41cd-b0f9-6c5ea3a5bd2b None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:03.478596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e98ae-64f9-4544-8a23-e60051cca9ca None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.478881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e98ae-64f9-4544-8a23-e60051cca9ca None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.479158 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e98ae-64f9-4544-8a23-e60051cca9ca None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.481331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 26/50] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:03.486126 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e24b-09b6-4c5b-b10a-f49a5f3d677b None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.486412 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e24b-09b6-4c5b-b10a-f49a5f3d677b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.486694 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344e24b-09b6-4c5b-b10a-f49a5f3d677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.490823 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:03.491493 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.491804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.492085 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.492846 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:03.493158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:03.494540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:03.502811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-0344e24b-09b6-4c5b-b10a-f49a5f3d677b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:03.505381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-0344e24b-09b6-4c5b-b10a-f49a5f3d677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:03.506476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 25/51] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:03.512042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:03.571070 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 27/52] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:03.594950 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344e24b-09b6-4c5b-b10a-f49a5f3d677b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:03.610274 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727aebb-f2db-4bee-a6d4-156cddbba521 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:03.641998 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69a5cb-3e12-4b2c-9401-e0a42703e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:03.642878 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69a5cb-3e12-4b2c-9401-e0a42703e162 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.643169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69a5cb-3e12-4b2c-9401-e0a42703e162 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.643468 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69a5cb-3e12-4b2c-9401-e0a42703e162 None admin] PATH_INFO: `/v3/users/51d9969637e5400cad1f18de76cb1fd3` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.645669 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69a5cb-3e12-4b2c-9401-e0a42703e162 None admin] RBAC: Authorizing `identity:get_user(user_id=51d9969637e5400cad1f18de76cb1fd3)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:03.647142 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69a5cb-3e12-4b2c-9401-e0a42703e162 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:03.648843 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:03 2022] GET /identity/v3/users/51d9969637e5400cad1f18de76cb1fd3 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:03.654141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69a5cb-3e12-4b2c-9401-e0a42703e162 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:03.689475 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344e24b-09b6-4c5b-b10a-f49a5f3d677b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:03.723004 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea014431-3c02-490a-acd2-c001ad1ae825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:03.723817 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014431-3c02-490a-acd2-c001ad1ae825 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.724111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014431-3c02-490a-acd2-c001ad1ae825 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.724393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014431-3c02-490a-acd2-c001ad1ae825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.725594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea014431-3c02-490a-acd2-c001ad1ae825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:03.727060 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea014431-3c02-490a-acd2-c001ad1ae825 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:03.728733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 28/54] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:03.734191 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea014431-3c02-490a-acd2-c001ad1ae825 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:03.749071 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69a5cb-3e12-4b2c-9401-e0a42703e162 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:03.781880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b73f7-04fe-4625-bae5-61c49a743202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:03.782667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b73f7-04fe-4625-bae5-61c49a743202 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.782956 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b73f7-04fe-4625-bae5-61c49a743202 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.783242 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b73f7-04fe-4625-bae5-61c49a743202 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.785251 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b73f7-04fe-4625-bae5-61c49a743202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:03.786731 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b73f7-04fe-4625-bae5-61c49a743202 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:03.788387 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:03.794119 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b73f7-04fe-4625-bae5-61c49a743202 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:03.830424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea014431-3c02-490a-acd2-c001ad1ae825 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:03.863240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987687ce-a7a7-4483-9fe8-4c3938eebba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:03.863841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987687ce-a7a7-4483-9fe8-4c3938eebba4 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.864127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987687ce-a7a7-4483-9fe8-4c3938eebba4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.864402 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987687ce-a7a7-4483-9fe8-4c3938eebba4 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.865133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987687ce-a7a7-4483-9fe8-4c3938eebba4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:03.866572 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987687ce-a7a7-4483-9fe8-4c3938eebba4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:03.890666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b73f7-04fe-4625-bae5-61c49a743202 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:03.892200 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 29/56] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 9 15:15:03 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:15:03.926171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a58d6-7a35-4c26-b4cd-27bd9c66dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:03.926853 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a58d6-7a35-4c26-b4cd-27bd9c66dc97 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:03.927136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a58d6-7a35-4c26-b4cd-27bd9c66dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:03.927412 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a58d6-7a35-4c26-b4cd-27bd9c66dc97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:03.928305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a58d6-7a35-4c26-b4cd-27bd9c66dc97 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.domain.id=default, user.id=51d9969637e5400cad1f18de76cb1fd3) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:03.928617 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a58d6-7a35-4c26-b4cd-27bd9c66dc97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:03.930104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a58d6-7a35-4c26-b4cd-27bd9c66dc97 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:03.940197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 28/57] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 9 15:15:03 2022] GET /identity/v3/role_assignments?user.id=51d9969637e5400cad1f18de76cb1fd3&scope.domain.id=default&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:06.156499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c9f7-7e74-4dd3-af39-39683faf418b None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:06.157051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c9f7-7e74-4dd3-af39-39683faf418b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:06.157051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c9f7-7e74-4dd3-af39-39683faf418b None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:06.158436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 30/58] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:06.164457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a28eb-98ca-4347-892c-25d3eece1d95 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:06.164878 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a28eb-98ca-4347-892c-25d3eece1d95 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:06.165027 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a28eb-98ca-4347-892c-25d3eece1d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:06.182332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ab9a28eb-98ca-4347-892c-25d3eece1d95 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:06.183529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ab9a28eb-98ca-4347-892c-25d3eece1d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:06.246947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 29/59] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:06.271088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249c9f7-7e74-4dd3-af39-39683faf418b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:06.367684 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249c9f7-7e74-4dd3-af39-39683faf418b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:06.400623 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed5189-5221-4730-8cc1-ee0e97f98c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:06.401406 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5189-5221-4730-8cc1-ee0e97f98c52 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:06.401696 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5189-5221-4730-8cc1-ee0e97f98c52 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:06.401979 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed5189-5221-4730-8cc1-ee0e97f98c52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:06.403164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5189-5221-4730-8cc1-ee0e97f98c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:06.404639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed5189-5221-4730-8cc1-ee0e97f98c52 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:06.406269 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 31/60] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:06.411805 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a28eb-98ca-4347-892c-25d3eece1d95 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:06.505145 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a28eb-98ca-4347-892c-25d3eece1d95 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:06.537124 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17d8a4-6b24-440b-b877-2112dd0471fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:06.537798 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d8a4-6b24-440b-b877-2112dd0471fe None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:06.538087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d8a4-6b24-440b-b877-2112dd0471fe None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:06.538369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17d8a4-6b24-440b-b877-2112dd0471fe None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:06.539080 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17d8a4-6b24-440b-b877-2112dd0471fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:06.540589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17d8a4-6b24-440b-b877-2112dd0471fe None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:06.564732 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 30/61] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:15:06 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:09.788571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4fd2-e78c-4816-bcbb-5bac3d7e3b59 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:09.789633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4fd2-e78c-4816-bcbb-5bac3d7e3b59 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:09.790139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4fd2-e78c-4816-bcbb-5bac3d7e3b59 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:09.791731 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 32/62] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:09.797395 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89bc9-3bfe-4ddf-826a-667c9dd39838 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:09.797812 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89bc9-3bfe-4ddf-826a-667c9dd39838 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:09.798050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d89bc9-3bfe-4ddf-826a-667c9dd39838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:09.824323 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-04d89bc9-3bfe-4ddf-826a-667c9dd39838 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:09.825540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-04d89bc9-3bfe-4ddf-826a-667c9dd39838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:09.896728 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2712c-60f5-423b-8af4-672440b24a2e None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:09.897335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2712c-60f5-423b-8af4-672440b24a2e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:09.897852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2712c-60f5-423b-8af4-672440b24a2e None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:09.899501 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 33/63] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:09.904741 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216d24-06d1-492e-9002-031cb7468afa None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:09.905273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216d24-06d1-492e-9002-031cb7468afa None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:09.905784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216d24-06d1-492e-9002-031cb7468afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:09.914401 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 31/64] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:09.925677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-15216d24-06d1-492e-9002-031cb7468afa None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:09.927175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-15216d24-06d1-492e-9002-031cb7468afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:09.954414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d89bc9-3bfe-4ddf-826a-667c9dd39838 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.041134 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 34/65] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:10.061059 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d89bc9-3bfe-4ddf-826a-667c9dd39838 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:10.078852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15216d24-06d1-492e-9002-031cb7468afa None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.100785 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f4c1-11e3-4da4-b2e2-e12ec905caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:10.101606 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f4c1-11e3-4da4-b2e2-e12ec905caa3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.101894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f4c1-11e3-4da4-b2e2-e12ec905caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.102176 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f4c1-11e3-4da4-b2e2-e12ec905caa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.125637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96f4c1-11e3-4da4-b2e2-e12ec905caa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-af96f4c1-11e3-4da4-b2e2-e12ec905caa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:10.135679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:10.136717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:10.138034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 32/66] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:10.152920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f4c1-11e3-4da4-b2e2-e12ec905caa3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.223350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15216d24-06d1-492e-9002-031cb7468afa None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:10.276660 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f694c-d048-4193-8581-dbc67cd08f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:10.277822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f694c-d048-4193-8581-dbc67cd08f59 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.278308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f694c-d048-4193-8581-dbc67cd08f59 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.278819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f694c-d048-4193-8581-dbc67cd08f59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.297838 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f694c-d048-4193-8581-dbc67cd08f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-8c0f694c-d048-4193-8581-dbc67cd08f59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:10.306760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:10.307890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:10.308785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:10.311316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 35/67] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:10.318317 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f694c-d048-4193-8581-dbc67cd08f59 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.329600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f4c1-11e3-4da4-b2e2-e12ec905caa3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:10.366831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:10.367793 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.368238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.368696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.369632 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:10.370088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:10.371641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:10.385141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 33/68] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:10.393418 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.508590 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbc899-56a2-4ea2-8391-682ef93a4270 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:10.514805 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f694c-d048-4193-8581-dbc67cd08f59 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:10.544742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeff7cc-d0cf-4955-a836-315d91236657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:10.545921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff7cc-d0cf-4955-a836-315d91236657 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.546388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff7cc-d0cf-4955-a836-315d91236657 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.546826 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeff7cc-d0cf-4955-a836-315d91236657 None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.551471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148fa49-72e1-4c04-9d1e-b83efa97d27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:10.551959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fa49-72e1-4c04-9d1e-b83efa97d27b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.552254 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fa49-72e1-4c04-9d1e-b83efa97d27b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.552544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fa49-72e1-4c04-9d1e-b83efa97d27b None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.553471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fa49-72e1-4c04-9d1e-b83efa97d27b None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:10.553789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fa49-72e1-4c04-9d1e-b83efa97d27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:10.555201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fa49-72e1-4c04-9d1e-b83efa97d27b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:10.565360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 36/69] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:10.565788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeff7cc-d0cf-4955-a836-315d91236657 None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:10.566595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138302-f8ce-42ba-ac63-f2997c5d629b None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.566894 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138302-f8ce-42ba-ac63-f2997c5d629b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.567176 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138302-f8ce-42ba-ac63-f2997c5d629b None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.568217 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeff7cc-d0cf-4955-a836-315d91236657 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:10.568461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 37/70] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:10.570814 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 34/71] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:10 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:10.575603 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88138302-f8ce-42ba-ac63-f2997c5d629b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.577184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1707-e55d-49d4-81f2-8767f6b3dc92 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.577678 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1707-e55d-49d4-81f2-8767f6b3dc92 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.578152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d1707-e55d-49d4-81f2-8767f6b3dc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.597206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-774d1707-e55d-49d4-81f2-8767f6b3dc92 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:10.598823 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-774d1707-e55d-49d4-81f2-8767f6b3dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:10.671650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 35/72] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:10.672944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d1707-e55d-49d4-81f2-8767f6b3dc92 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.696185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88138302-f8ce-42ba-ac63-f2997c5d629b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:10.732996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060641c9-0188-4c8d-bd55-bc555c2a248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:10.733897 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060641c9-0188-4c8d-bd55-bc555c2a248a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.734188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060641c9-0188-4c8d-bd55-bc555c2a248a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.734490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060641c9-0188-4c8d-bd55-bc555c2a248a None admin] PATH_INFO: `/v3/users/51d9969637e5400cad1f18de76cb1fd3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.735855 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060641c9-0188-4c8d-bd55-bc555c2a248a None admin] RBAC: Authorizing `identity:get_user(user_id=51d9969637e5400cad1f18de76cb1fd3)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:10.737403 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060641c9-0188-4c8d-bd55-bc555c2a248a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:10.739144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 38/73] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:10 2022] GET /identity/v3/users/51d9969637e5400cad1f18de76cb1fd3 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:10.740594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415812e3-39ec-46a9-8cf1-6340cd939005 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.740892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415812e3-39ec-46a9-8cf1-6340cd939005 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.741176 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415812e3-39ec-46a9-8cf1-6340cd939005 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.744327 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 39/74] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:10.744327 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415812e3-39ec-46a9-8cf1-6340cd939005 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.794574 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d1707-e55d-49d4-81f2-8767f6b3dc92 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:10.831939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a199d-2d8c-4584-93b8-a5ee98348889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:10.832797 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a199d-2d8c-4584-93b8-a5ee98348889 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.832895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a199d-2d8c-4584-93b8-a5ee98348889 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.833147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a199d-2d8c-4584-93b8-a5ee98348889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.853579 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415812e3-39ec-46a9-8cf1-6340cd939005 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:10.888617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a6ae0-7fb5-4d9f-bfb5-3c3c474c3431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:10.889441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a6ae0-7fb5-4d9f-bfb5-3c3c474c3431 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:10.889733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a6ae0-7fb5-4d9f-bfb5-3c3c474c3431 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:10.890016 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a6ae0-7fb5-4d9f-bfb5-3c3c474c3431 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:10.900865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a199d-2d8c-4584-93b8-a5ee98348889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:10.901936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a6ae0-7fb5-4d9f-bfb5-3c3c474c3431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:10.902358 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a199d-2d8c-4584-93b8-a5ee98348889 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-7c6a6ae0-7fb5-4d9f-bfb5-3c3c474c3431 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:10.910651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:10.911959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:10.913197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 40/75] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:10.914220 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a6ae0-7fb5-4d9f-bfb5-3c3c474c3431 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:10.999796 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 36/76] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:11.001006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867314d2-97e6-44bc-a211-1a75b6cf2964 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.001299 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867314d2-97e6-44bc-a211-1a75b6cf2964 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.001581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867314d2-97e6-44bc-a211-1a75b6cf2964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.012521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a6ae0-7fb5-4d9f-bfb5-3c3c474c3431 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.019477 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-867314d2-97e6-44bc-a211-1a75b6cf2964 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:11.020715 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-867314d2-97e6-44bc-a211-1a75b6cf2964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:11.044843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b936-722d-4112-b741-7bd5624fa8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.045424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b936-722d-4112-b741-7bd5624fa8a1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.045708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b936-722d-4112-b741-7bd5624fa8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.045993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b936-722d-4112-b741-7bd5624fa8a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.085065 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 37/77] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:11.086385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d766-d5ac-490b-abe6-3ff5d7d9647d None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.086675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d766-d5ac-490b-abe6-3ff5d7d9647d None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.086950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d766-d5ac-490b-abe6-3ff5d7d9647d None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.088245 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 38/78] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:11.092921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d766-d5ac-490b-abe6-3ff5d7d9647d None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.119337 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b936-722d-4112-b741-7bd5624fa8a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.120915 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b936-722d-4112-b741-7bd5624fa8a1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.202179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d766-d5ac-490b-abe6-3ff5d7d9647d None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.224167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 41/79] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:11.225674 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b936-722d-4112-b741-7bd5624fa8a1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.237009 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2079d8-64d3-4093-8f5b-4b069ea7b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.237771 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2079d8-64d3-4093-8f5b-4b069ea7b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.238050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2079d8-64d3-4093-8f5b-4b069ea7b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.238339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2079d8-64d3-4093-8f5b-4b069ea7b6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.239088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2079d8-64d3-4093-8f5b-4b069ea7b6e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:11.239398 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2079d8-64d3-4093-8f5b-4b069ea7b6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.240821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2079d8-64d3-4093-8f5b-4b069ea7b6e5 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.248498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 39/80] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:11.249683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28232d-70fc-43f6-9a41-25f4451a560d None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.249975 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28232d-70fc-43f6-9a41-25f4451a560d None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.250255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28232d-70fc-43f6-9a41-25f4451a560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.265754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ae28232d-70fc-43f6-9a41-25f4451a560d None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:11.266941 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ae28232d-70fc-43f6-9a41-25f4451a560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:11.321760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b936-722d-4112-b741-7bd5624fa8a1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.329770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 40/81] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:11.332086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28232d-70fc-43f6-9a41-25f4451a560d None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.356066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49912-9b09-4bb1-9c3c-3cbb5a2249cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.356919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49912-9b09-4bb1-9c3c-3cbb5a2249cc None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.357199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49912-9b09-4bb1-9c3c-3cbb5a2249cc None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.357476 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f49912-9b09-4bb1-9c3c-3cbb5a2249cc None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.358664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49912-9b09-4bb1-9c3c-3cbb5a2249cc None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.360136 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f49912-9b09-4bb1-9c3c-3cbb5a2249cc None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.361829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 42/82] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:11.361829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49912-9b09-4bb1-9c3c-3cbb5a2249cc None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.427256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28232d-70fc-43f6-9a41-25f4451a560d None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.456659 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f49912-9b09-4bb1-9c3c-3cbb5a2249cc None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.460180 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e455fb-7722-409b-a60e-e17099773cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.460979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e455fb-7722-409b-a60e-e17099773cde None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.461270 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e455fb-7722-409b-a60e-e17099773cde None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.461551 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e455fb-7722-409b-a60e-e17099773cde None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.471384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e455fb-7722-409b-a60e-e17099773cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b5e455fb-7722-409b-a60e-e17099773cde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:11.479307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:11.480449 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 41/83] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:11.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e455fb-7722-409b-a60e-e17099773cde None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.490571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3aaaf4-de16-427a-844a-f6b161b9c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.491426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aaaf4-de16-427a-844a-f6b161b9c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.491716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aaaf4-de16-427a-844a-f6b161b9c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.492028 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3aaaf4-de16-427a-844a-f6b161b9c5a6 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.493235 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3aaaf4-de16-427a-844a-f6b161b9c5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.494691 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3aaaf4-de16-427a-844a-f6b161b9c5a6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.496430 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 43/84] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:11.501246 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3aaaf4-de16-427a-844a-f6b161b9c5a6 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.591744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e455fb-7722-409b-a60e-e17099773cde None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.597504 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3aaaf4-de16-427a-844a-f6b161b9c5a6 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.625263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8005b9-4b5b-4af4-ab74-e0c8612b03c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.626136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8005b9-4b5b-4af4-ab74-e0c8612b03c4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.626422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8005b9-4b5b-4af4-ab74-e0c8612b03c4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.626696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8005b9-4b5b-4af4-ab74-e0c8612b03c4 None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.628507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8005b9-4b5b-4af4-ab74-e0c8612b03c4 None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.630016 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8005b9-4b5b-4af4-ab74-e0c8612b03c4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.630214 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e110d4-083c-4888-961b-1884ff424f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.631019 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e110d4-083c-4888-961b-1884ff424f1b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.631314 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e110d4-083c-4888-961b-1884ff424f1b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.631594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e110d4-083c-4888-961b-1884ff424f1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.631684 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 42/85] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:11.632439 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8005b9-4b5b-4af4-ab74-e0c8612b03c4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.632926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e110d4-083c-4888-961b-1884ff424f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.634399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e110d4-083c-4888-961b-1884ff424f1b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.640442 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 44/86] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:11.640442 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e110d4-083c-4888-961b-1884ff424f1b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.733360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e110d4-083c-4888-961b-1884ff424f1b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.738670 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8005b9-4b5b-4af4-ab74-e0c8612b03c4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.765770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.766438 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.766729 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.767012 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.767783 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] RBAC: Adding query filter params (name=member) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:11.768122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.769550 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.770961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.771626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.771946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.772231 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.773073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] RBAC: Adding query filter params (role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=8ffbe1e0bdf144498702098bd867a307, user.id=2f8289df6b1c456881b14587b19133f7) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:11.773392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.774822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.777552 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 45/87] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:11.778467 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.780636 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 43/88] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/role_assignments?user.id=2f8289df6b1c456881b14587b19133f7&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:11.792950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.886621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c36252-13d7-4b57-adc2-92a8f2e30446 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.905828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfec360-066a-43bd-aa78-6a42bb573c8d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:11.922935 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.923666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.923993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.924276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:11.925741 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=8ffbe1e0bdf144498702098bd867a307, user.id=51d9969637e5400cad1f18de76cb1fd3) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:11.926060 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:11.927540 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:11.933668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 46/89] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/role_assignments?user.id=51d9969637e5400cad1f18de76cb1fd3&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:11.934274 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:11.954251 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62977e6-17d1-4d3f-bf8c-3c90e68f91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:11.955837 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62977e6-17d1-4d3f-bf8c-3c90e68f91d5 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:11.957405 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62977e6-17d1-4d3f-bf8c-3c90e68f91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:11.957999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62977e6-17d1-4d3f-bf8c-3c90e68f91d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:12.035088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62977e6-17d1-4d3f-bf8c-3c90e68f91d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:12.037049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62977e6-17d1-4d3f-bf8c-3c90e68f91d5 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:12.047566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ce7eb-1254-4ea9-a125-1db25ac2b0bb None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:12.086126 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7118-81e9-40b7-9c81-6b5d83ac8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:12.086926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7118-81e9-40b7-9c81-6b5d83ac8795 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:12.087314 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7118-81e9-40b7-9c81-6b5d83ac8795 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:12.087717 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7118-81e9-40b7-9c81-6b5d83ac8795 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:12.088590 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd7118-81e9-40b7-9c81-6b5d83ac8795 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:12.090165 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd7118-81e9-40b7-9c81-6b5d83ac8795 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:12.126284 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 47/90] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:15:11 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:12.128620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7118-81e9-40b7-9c81-6b5d83ac8795 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:12.158961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 44/91] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:12.163954 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62977e6-17d1-4d3f-bf8c-3c90e68f91d5 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:12.270651 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62977e6-17d1-4d3f-bf8c-3c90e68f91d5 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:12.288834 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7118-81e9-40b7-9c81-6b5d83ac8795 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:12.317113 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1c61-080b-41d4-8416-436c7c5e6dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:12.318057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1c61-080b-41d4-8416-436c7c5e6dfa None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:12.318343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1c61-080b-41d4-8416-436c7c5e6dfa None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:12.318618 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1c61-080b-41d4-8416-436c7c5e6dfa None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:12.320399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1c61-080b-41d4-8416-436c7c5e6dfa None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:12.322130 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1c61-080b-41d4-8416-436c7c5e6dfa None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:12.324125 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 45/92] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:12 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:12.333091 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1c61-080b-41d4-8416-436c7c5e6dfa None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:12.375072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21331647-1314-4325-8fab-7baa9a269be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:12.376003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21331647-1314-4325-8fab-7baa9a269be7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:12.376294 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21331647-1314-4325-8fab-7baa9a269be7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:12.376575 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21331647-1314-4325-8fab-7baa9a269be7 None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:12.379796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21331647-1314-4325-8fab-7baa9a269be7 None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:12.381336 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21331647-1314-4325-8fab-7baa9a269be7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:12.383093 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 48/93] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:12 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:12.392996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21331647-1314-4325-8fab-7baa9a269be7 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:12.495706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1c61-080b-41d4-8416-436c7c5e6dfa None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:12.521470 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21331647-1314-4325-8fab-7baa9a269be7 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:12.532965 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:12.534847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:12.534847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:12.534847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:12.536089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] RBAC: Adding query filter params (role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=8ffbe1e0bdf144498702098bd867a307, user.id=2f8289df6b1c456881b14587b19133f7) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:12.536572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:12.538069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:12.544262 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 46/94] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:12 2022] GET /identity/v3/role_assignments?user.id=2f8289df6b1c456881b14587b19133f7&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:12.562456 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889e035-063d-4f17-9007-45426bd73154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:12.563472 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e035-063d-4f17-9007-45426bd73154 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:12.564024 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e035-063d-4f17-9007-45426bd73154 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:12.564468 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889e035-063d-4f17-9007-45426bd73154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:12.648290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889e035-063d-4f17-9007-45426bd73154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:12.649805 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889e035-063d-4f17-9007-45426bd73154 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:12.762336 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 49/95] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:12.767928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:12.874354 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ed26-5de2-4f01-9c29-a3ec38817ed8 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:12.911850 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1efeaf-03fa-49a9-b21f-0988663056bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:12.913488 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1efeaf-03fa-49a9-b21f-0988663056bb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:12.913997 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1efeaf-03fa-49a9-b21f-0988663056bb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:12.914476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1efeaf-03fa-49a9-b21f-0988663056bb None admin] PATH_INFO: `/v3/projects/b0af45ca745342f186fdecaefdab7473` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:12.918155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1efeaf-03fa-49a9-b21f-0988663056bb None admin] RBAC: Authorizing `identity:get_project(project_id=b0af45ca745342f186fdecaefdab7473)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:12.919859 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1efeaf-03fa-49a9-b21f-0988663056bb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:12.922123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 47/96] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:12 2022] GET /identity/v3/projects/b0af45ca745342f186fdecaefdab7473 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:12.928899 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889e035-063d-4f17-9007-45426bd73154 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:13.040330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889e035-063d-4f17-9007-45426bd73154 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:13.083349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66228c-5289-4dbd-ab4c-ef42f768c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:13.084048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66228c-5289-4dbd-ab4c-ef42f768c886 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:13.084342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66228c-5289-4dbd-ab4c-ef42f768c886 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:13.084627 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66228c-5289-4dbd-ab4c-ef42f768c886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:13.085486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66228c-5289-4dbd-ab4c-ef42f768c886 None admin] RBAC: Adding query filter params (role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=b0af45ca745342f186fdecaefdab7473, user.id=2f8289df6b1c456881b14587b19133f7) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:13.085808 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66228c-5289-4dbd-ab4c-ef42f768c886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:13.087261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66228c-5289-4dbd-ab4c-ef42f768c886 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:13.093501 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 50/97] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:12 2022] GET /identity/v3/role_assignments?user.id=2f8289df6b1c456881b14587b19133f7&scope.project.id=b0af45ca745342f186fdecaefdab7473&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:14.683866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90f1d-da14-4e5f-ba60-04ceadb3072a None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:14.684898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90f1d-da14-4e5f-ba60-04ceadb3072a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:14.685482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90f1d-da14-4e5f-ba60-04ceadb3072a None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:14.687097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 48/98] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:14.693441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83c69-5206-4f8d-bff6-aac0fc23bdcd None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:14.694311 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83c69-5206-4f8d-bff6-aac0fc23bdcd None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:14.694827 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a83c69-5206-4f8d-bff6-aac0fc23bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:14.713327 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-09a83c69-5206-4f8d-bff6-aac0fc23bdcd None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:14.714874 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-09a83c69-5206-4f8d-bff6-aac0fc23bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:14.738236 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c814cc-311d-42fc-8518-62d7551e7398 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:14.738996 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c814cc-311d-42fc-8518-62d7551e7398 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:14.739510 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c814cc-311d-42fc-8518-62d7551e7398 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:14.741940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 49/99] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:14.748241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cb0c-44cb-4716-9998-ddac472ae4ed None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:14.749087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cb0c-44cb-4716-9998-ddac472ae4ed None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:14.749865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cb0c-44cb-4716-9998-ddac472ae4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:14.769687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-e265cb0c-44cb-4716-9998-ddac472ae4ed None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:14.771261 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-e265cb0c-44cb-4716-9998-ddac472ae4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:14.826457 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 51/100] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:14.856146 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 50/101] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:14.872569 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a83c69-5206-4f8d-bff6-aac0fc23bdcd None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:14.888006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cb0c-44cb-4716-9998-ddac472ae4ed None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:14.988960 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a83c69-5206-4f8d-bff6-aac0fc23bdcd None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.028487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0b0f4-f740-478c-8a02-0e1cf22ad977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:15.029712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b0f4-f740-478c-8a02-0e1cf22ad977 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:15.030225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b0f4-f740-478c-8a02-0e1cf22ad977 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:15.030755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b0f4-f740-478c-8a02-0e1cf22ad977 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:15.043133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0b0f4-f740-478c-8a02-0e1cf22ad977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-21e0b0f4-f740-478c-8a02-0e1cf22ad977 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:15.052450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:15.053537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:15.054516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:15.057325 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 52/102] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:15.063379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0b0f4-f740-478c-8a02-0e1cf22ad977 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:15.165843 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cb0c-44cb-4716-9998-ddac472ae4ed None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.184659 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0b0f4-f740-478c-8a02-0e1cf22ad977 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.225288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:15.226376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:15.226953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:15.227446 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:15.228623 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:15.229319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:15.230953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:15.241235 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 53/103] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:15.247316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:15.256524 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a06b-9cde-4db3-a0e4-32a0b239ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:15.257356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a06b-9cde-4db3-a0e4-32a0b239ff14 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:15.257647 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a06b-9cde-4db3-a0e4-32a0b239ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:15.257933 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a06b-9cde-4db3-a0e4-32a0b239ff14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:15.292401 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428a06b-9cde-4db3-a0e4-32a0b239ff14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-9428a06b-9cde-4db3-a0e4-32a0b239ff14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:15.300786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:15.301821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:15.302724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 51/104] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:15.312802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a06b-9cde-4db3-a0e4-32a0b239ff14 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:15.364887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f69d26-3cbe-418c-a9d7-e1a13afed760 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.404401 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35305b-212c-4c76-96be-4b009e14ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:15.411597 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35305b-212c-4c76-96be-4b009e14ba8d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:15.412414 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35305b-212c-4c76-96be-4b009e14ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:15.412943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35305b-212c-4c76-96be-4b009e14ba8d None admin] PATH_INFO: `/v3/users/51d9969637e5400cad1f18de76cb1fd3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:15.414573 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35305b-212c-4c76-96be-4b009e14ba8d None admin] RBAC: Authorizing `identity:get_user(user_id=51d9969637e5400cad1f18de76cb1fd3)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:15.416582 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35305b-212c-4c76-96be-4b009e14ba8d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:15.418519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 54/105] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:15 2022] GET /identity/v3/users/51d9969637e5400cad1f18de76cb1fd3 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:15.425369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35305b-212c-4c76-96be-4b009e14ba8d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:15.541984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a06b-9cde-4db3-a0e4-32a0b239ff14 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.599319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35305b-212c-4c76-96be-4b009e14ba8d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.631578 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:15.632476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:15.632770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:15.633053 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:15.633836 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:15.634160 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:15.635572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:15.641905 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82b792-3c5f-4ff6-bc8e-38c0d34a5cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:15.642791 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b792-3c5f-4ff6-bc8e-38c0d34a5cd0 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:15.644209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b792-3c5f-4ff6-bc8e-38c0d34a5cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:15.644209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b792-3c5f-4ff6-bc8e-38c0d34a5cd0 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:15.645915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 52/106] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:15.648583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82b792-3c5f-4ff6-bc8e-38c0d34a5cd0 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:15.650270 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82b792-3c5f-4ff6-bc8e-38c0d34a5cd0 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:15.653068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:15.655844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 55/107] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:15 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:15.670070 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82b792-3c5f-4ff6-bc8e-38c0d34a5cd0 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:15.793745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947060-883c-4b06-9a5c-1c915aea084c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.831267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b78d3-30ef-4366-994b-82914c791fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:15.832194 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b78d3-30ef-4366-994b-82914c791fce None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:15.832485 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b78d3-30ef-4366-994b-82914c791fce None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:15.832774 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b78d3-30ef-4366-994b-82914c791fce None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:15.834035 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b78d3-30ef-4366-994b-82914c791fce None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:15.835568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b78d3-30ef-4366-994b-82914c791fce None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:15.837302 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 53/108] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:15 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:15.842761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b78d3-30ef-4366-994b-82914c791fce None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:15.887481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82b792-3c5f-4ff6-bc8e-38c0d34a5cd0 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.967627 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b78d3-30ef-4366-994b-82914c791fce None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:15.996353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f55ea-74ba-4074-ba17-8902c3bdd5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:15.997549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f55ea-74ba-4074-ba17-8902c3bdd5d8 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:15.998004 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f55ea-74ba-4074-ba17-8902c3bdd5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:15.998441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f55ea-74ba-4074-ba17-8902c3bdd5d8 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307/users/51d9969637e5400cad1f18de76cb1fd3/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.005249 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f55ea-74ba-4074-ba17-8902c3bdd5d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ffbe1e0bdf144498702098bd867a307, user_id=51d9969637e5400cad1f18de76cb1fd3, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:16.006992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f55ea-74ba-4074-ba17-8902c3bdd5d8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:16.011787 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e595329-e540-47fa-9127-2b30859aee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:16.012127 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e595329-e540-47fa-9127-2b30859aee3b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.012517 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e595329-e540-47fa-9127-2b30859aee3b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.012897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e595329-e540-47fa-9127-2b30859aee3b None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.014246 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e595329-e540-47fa-9127-2b30859aee3b None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:16.015911 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e595329-e540-47fa-9127-2b30859aee3b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:16.018167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 54/109] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:15 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:16.023816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917041-c308-4436-9fb7-b5e87ea4dd96 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.023816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917041-c308-4436-9fb7-b5e87ea4dd96 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.023816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917041-c308-4436-9fb7-b5e87ea4dd96 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.023816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 55/110] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:16.024186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1323ef-e10e-4317-9b6a-eeaa622898d3 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.024558 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1323ef-e10e-4317-9b6a-eeaa622898d3 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.024739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1323ef-e10e-4317-9b6a-eeaa622898d3 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.026284 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 56/111] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:16.027085 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1323ef-e10e-4317-9b6a-eeaa622898d3 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:16.038728 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 56/112] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:15 2022] PUT /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307/users/51d9969637e5400cad1f18de76cb1fd3/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:15:16.039338 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d43cc-dbef-4528-839a-94af1491f0f7 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.039633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d43cc-dbef-4528-839a-94af1491f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.039945 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d43cc-dbef-4528-839a-94af1491f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.061451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-ab1d43cc-dbef-4528-839a-94af1491f0f7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:16.062702 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-ab1d43cc-dbef-4528-839a-94af1491f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:16.204787 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1323ef-e10e-4317-9b6a-eeaa622898d3 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:16.237565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 57/113] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:16.238577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6aff-c64c-4559-b4bb-0d04e0ff2eeb None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.238893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6aff-c64c-4559-b4bb-0d04e0ff2eeb None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.239404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e6aff-c64c-4559-b4bb-0d04e0ff2eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.247992 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55075f02-1f6f-415c-8977-14419b2af2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:16.249463 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55075f02-1f6f-415c-8977-14419b2af2b2 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.250052 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55075f02-1f6f-415c-8977-14419b2af2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.250787 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55075f02-1f6f-415c-8977-14419b2af2b2 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307/users/2f8289df6b1c456881b14587b19133f7/roles/d93601b75fd74dcf89b2cee3d7541f90` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.253751 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55075f02-1f6f-415c-8977-14419b2af2b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ffbe1e0bdf144498702098bd867a307, user_id=2f8289df6b1c456881b14587b19133f7, role_id=d93601b75fd74dcf89b2cee3d7541f90)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:16.255650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55075f02-1f6f-415c-8977-14419b2af2b2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:16.273904 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-335e6aff-c64c-4559-b4bb-0d04e0ff2eeb None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:16.279845 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-335e6aff-c64c-4559-b4bb-0d04e0ff2eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:16.287538 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 57/114] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:16 2022] PUT /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307/users/2f8289df6b1c456881b14587b19133f7/roles/d93601b75fd74dcf89b2cee3d7541f90 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:16.288988 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55075f02-1f6f-415c-8977-14419b2af2b2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:16.421010 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 58/115] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:16.422917 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77e53-1a31-4221-866b-34bc966be561 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.423245 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77e53-1a31-4221-866b-34bc966be561 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.423501 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77e53-1a31-4221-866b-34bc966be561 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.429240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 59/116] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:16.436951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bea4f-f1cc-47ca-b67e-0e0650c30f3d None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.438462 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bea4f-f1cc-47ca-b67e-0e0650c30f3d None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.438982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bea4f-f1cc-47ca-b67e-0e0650c30f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.482938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-586bea4f-f1cc-47ca-b67e-0e0650c30f3d None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:16.485346 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-586bea4f-f1cc-47ca-b67e-0e0650c30f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:16.490490 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55075f02-1f6f-415c-8977-14419b2af2b2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:16.570189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97e867-76c2-44d4-ab26-29319730ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:16.571471 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e867-76c2-44d4-ab26-29319730ea64 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.572421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e867-76c2-44d4-ab26-29319730ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.572926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e867-76c2-44d4-ab26-29319730ea64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.588758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97e867-76c2-44d4-ab26-29319730ea64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:16.591063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 60/117] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:16.593842 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bea4f-f1cc-47ca-b67e-0e0650c30f3d None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-be97e867-76c2-44d4-ab26-29319730ea64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:16.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:16.600546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:16.601427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:16.603845 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 58/118] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:16.607118 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97e867-76c2-44d4-ab26-29319730ea64 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:16.732521 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97e867-76c2-44d4-ab26-29319730ea64 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:16.758705 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bea4f-f1cc-47ca-b67e-0e0650c30f3d None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:16.769979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:16.770674 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.770958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.771240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.772268 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:16.772813 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:16.775203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:16.785363 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 59/119] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:16.789940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:16.810781 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d8f97-3f40-408d-bb8c-31d94ba4a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:16.811592 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8f97-3f40-408d-bb8c-31d94ba4a778 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.811914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8f97-3f40-408d-bb8c-31d94ba4a778 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.812193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8f97-3f40-408d-bb8c-31d94ba4a778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.813392 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8f97-3f40-408d-bb8c-31d94ba4a778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:16.815628 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8f97-3f40-408d-bb8c-31d94ba4a778 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:16.817632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 61/120] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:16.818436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d8f97-3f40-408d-bb8c-31d94ba4a778 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:16.902533 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21258b5f-a4f5-47da-b826-a061888c1751 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:16.928240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d8f97-3f40-408d-bb8c-31d94ba4a778 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:16.940708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c08f6-c6fb-4966-bf7a-9e668b98d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:16.942048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c08f6-c6fb-4966-bf7a-9e668b98d931 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.942340 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c08f6-c6fb-4966-bf7a-9e668b98d931 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.942622 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c08f6-c6fb-4966-bf7a-9e668b98d931 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.953660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c08f6-c6fb-4966-bf7a-9e668b98d931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-2f7c08f6-c6fb-4966-bf7a-9e668b98d931 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:16.963188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:16.965499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:16.967655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:16.969561 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baa14b-de24-4e4a-a441-37795d1a54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:16.969752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 60/121] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:16.969752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c08f6-c6fb-4966-bf7a-9e668b98d931 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:16.970057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa14b-de24-4e4a-a441-37795d1a54a8 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.970057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa14b-de24-4e4a-a441-37795d1a54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.970057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baa14b-de24-4e4a-a441-37795d1a54a8 None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.970057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baa14b-de24-4e4a-a441-37795d1a54a8 None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:16.970057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baa14b-de24-4e4a-a441-37795d1a54a8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:16.970796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 62/122] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:16 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:16.976058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ba0f-726e-4c8a-9a4e-7710b5ce0283 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:16.976058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ba0f-726e-4c8a-9a4e-7710b5ce0283 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:16.976058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725ba0f-726e-4c8a-9a4e-7710b5ce0283 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:16.976058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 63/123] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:16.976058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725ba0f-726e-4c8a-9a4e-7710b5ce0283 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:17.080153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c08f6-c6fb-4966-bf7a-9e668b98d931 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:17.080760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725ba0f-726e-4c8a-9a4e-7710b5ce0283 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:17.116823 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f0359-e099-4823-b3c7-a53f08fd980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:17.117171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0112b8-8d44-4744-bc98-240218ea9b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:17.117501 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f0359-e099-4823-b3c7-a53f08fd980c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.117681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0112b8-8d44-4744-bc98-240218ea9b00 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.117851 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0112b8-8d44-4744-bc98-240218ea9b00 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.118003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f0359-e099-4823-b3c7-a53f08fd980c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.118153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0112b8-8d44-4744-bc98-240218ea9b00 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.118319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f0359-e099-4823-b3c7-a53f08fd980c None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.118772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0112b8-8d44-4744-bc98-240218ea9b00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:17.118941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f0359-e099-4823-b3c7-a53f08fd980c None admin] RBAC: Adding query filter params (name=reader) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:17.119107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f0359-e099-4823-b3c7-a53f08fd980c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:17.120360 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0112b8-8d44-4744-bc98-240218ea9b00 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:17.120560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f0359-e099-4823-b3c7-a53f08fd980c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:17.130359 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 64/124] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:17.131491 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e940f-9168-4a0a-86f1-87bdfc859a0b None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.131813 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e940f-9168-4a0a-86f1-87bdfc859a0b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.132104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e940f-9168-4a0a-86f1-87bdfc859a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.150137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-022e940f-9168-4a0a-86f1-87bdfc859a0b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:17.151362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-022e940f-9168-4a0a-86f1-87bdfc859a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:17.155803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 61/125] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:15:16 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:17.156631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0112b8-8d44-4744-bc98-240218ea9b00 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:17.285488 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0112b8-8d44-4744-bc98-240218ea9b00 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:17.322822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 65/126] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:17.323720 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e940f-9168-4a0a-86f1-87bdfc859a0b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:17.326758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e782a-3573-4847-b629-1e68ad028700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:17.327637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e782a-3573-4847-b629-1e68ad028700 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.328031 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e782a-3573-4847-b629-1e68ad028700 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.328334 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e782a-3573-4847-b629-1e68ad028700 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.329553 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e782a-3573-4847-b629-1e68ad028700 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:17.332675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e782a-3573-4847-b629-1e68ad028700 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:17.340219 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 62/127] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:17 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:17.341922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e782a-3573-4847-b629-1e68ad028700 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:17.464768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e782a-3573-4847-b629-1e68ad028700 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:17.493634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e940f-9168-4a0a-86f1-87bdfc859a0b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:17.508924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5cdc-cfb2-413b-9094-257c822552dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:17.510393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5cdc-cfb2-413b-9094-257c822552dc None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.510679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5cdc-cfb2-413b-9094-257c822552dc None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.510955 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5cdc-cfb2-413b-9094-257c822552dc None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307/users/2f8289df6b1c456881b14587b19133f7/roles/db0e2f86b328428ba0dbfe6383deffce` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.513938 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5cdc-cfb2-413b-9094-257c822552dc None admin] RBAC: Authorizing `identity:create_grant(project_id=8ffbe1e0bdf144498702098bd867a307, user_id=2f8289df6b1c456881b14587b19133f7, role_id=db0e2f86b328428ba0dbfe6383deffce)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:17.515400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5cdc-cfb2-413b-9094-257c822552dc None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:17.532510 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeb41e-92be-4afe-b114-247ed5ae4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:17.533387 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb41e-92be-4afe-b114-247ed5ae4236 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.534413 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb41e-92be-4afe-b114-247ed5ae4236 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.534833 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb41e-92be-4afe-b114-247ed5ae4236 None admin] PATH_INFO: `/v3/users/791bc4c18ffe4a1e90b28b9ddeb4db93` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.535851 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 63/128] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:17 2022] PUT /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307/users/2f8289df6b1c456881b14587b19133f7/roles/db0e2f86b328428ba0dbfe6383deffce => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:17.536754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5cdc-cfb2-413b-9094-257c822552dc None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:17.563713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeb41e-92be-4afe-b114-247ed5ae4236 None admin] RBAC: Authorizing `identity:get_user(user_id=791bc4c18ffe4a1e90b28b9ddeb4db93)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:17.566315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeb41e-92be-4afe-b114-247ed5ae4236 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:17.573781 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 66/129] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:17 2022] GET /identity/v3/users/791bc4c18ffe4a1e90b28b9ddeb4db93 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:17.584283 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeb41e-92be-4afe-b114-247ed5ae4236 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:17.692157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5cdc-cfb2-413b-9094-257c822552dc None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:17.702290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeb41e-92be-4afe-b114-247ed5ae4236 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:17.727977 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf4e76-c15b-44c0-8aa9-e456880b2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:17.728790 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf4e76-c15b-44c0-8aa9-e456880b2b1a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.729072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf4e76-c15b-44c0-8aa9-e456880b2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.729349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf4e76-c15b-44c0-8aa9-e456880b2b1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.739974 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3e4d2-64c0-44a3-873c-f2dfc40f6beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:17.740639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3e4d2-64c0-44a3-873c-f2dfc40f6beb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.740923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3e4d2-64c0-44a3-873c-f2dfc40f6beb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.741201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3e4d2-64c0-44a3-873c-f2dfc40f6beb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.741388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf4e76-c15b-44c0-8aa9-e456880b2b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-76cf4e76-c15b-44c0-8aa9-e456880b2b1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:17.749137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:17.751024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:17.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 64/130] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:17.759891 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf4e76-c15b-44c0-8aa9-e456880b2b1a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:17.816833 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3e4d2-64c0-44a3-873c-f2dfc40f6beb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:17.818323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3e4d2-64c0-44a3-873c-f2dfc40f6beb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:17.930131 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 67/131] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:17.931195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf4e76-c15b-44c0-8aa9-e456880b2b1a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:17.931632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3e4d2-64c0-44a3-873c-f2dfc40f6beb None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:17.970788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:17.972097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:17.972519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:17.972915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:17.973726 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:17.974052 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:17.975477 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:17.985066 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 65/132] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:17.990609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:18.034117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3e4d2-64c0-44a3-873c-f2dfc40f6beb None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:18.069286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49710f-2380-461b-89f7-c6d5e0f0e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:18.070207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49710f-2380-461b-89f7-c6d5e0f0e19c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:18.070494 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49710f-2380-461b-89f7-c6d5e0f0e19c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:18.070770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49710f-2380-461b-89f7-c6d5e0f0e19c None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:18.072269 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49710f-2380-461b-89f7-c6d5e0f0e19c None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:18.073721 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49710f-2380-461b-89f7-c6d5e0f0e19c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:18.075603 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 68/133] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:17 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:18.081786 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49710f-2380-461b-89f7-c6d5e0f0e19c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:18.095410 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b105ca-1478-466c-bb26-732e09c32d7e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:18.131295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718a532-f4f2-474e-9f28-1aa29499a6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:18.132267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718a532-f4f2-474e-9f28-1aa29499a6fb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:18.132557 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718a532-f4f2-474e-9f28-1aa29499a6fb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:18.132840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718a532-f4f2-474e-9f28-1aa29499a6fb None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:18.134142 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718a532-f4f2-474e-9f28-1aa29499a6fb None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:18.135626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718a532-f4f2-474e-9f28-1aa29499a6fb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:18.137403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 66/134] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:17 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:18.143010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718a532-f4f2-474e-9f28-1aa29499a6fb None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:18.187205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49710f-2380-461b-89f7-c6d5e0f0e19c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:18.223676 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:18.224399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:18.224687 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:18.224971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:18.225814 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] RBAC: Adding query filter params (role.id=7588576bc19e4dd18fb26d25c2a166aa, scope.project.id=8ffbe1e0bdf144498702098bd867a307, user.id=791bc4c18ffe4a1e90b28b9ddeb4db93) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:18.226125 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:18.227557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:18.233553 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 69/135] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:18 2022] GET /identity/v3/role_assignments?user.id=791bc4c18ffe4a1e90b28b9ddeb4db93&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=7588576bc19e4dd18fb26d25c2a166aa => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:18.244531 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718a532-f4f2-474e-9f28-1aa29499a6fb None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:18.283173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d906f6-6de3-4dc1-be44-6d099c8acd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:18.284677 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d906f6-6de3-4dc1-be44-6d099c8acd0c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:18.284966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d906f6-6de3-4dc1-be44-6d099c8acd0c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:18.285235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d906f6-6de3-4dc1-be44-6d099c8acd0c None admin] PATH_INFO: `/v3/projects/b0af45ca745342f186fdecaefdab7473` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:18.286565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d906f6-6de3-4dc1-be44-6d099c8acd0c None admin] RBAC: Authorizing `identity:get_project(project_id=b0af45ca745342f186fdecaefdab7473)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:18.288077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d906f6-6de3-4dc1-be44-6d099c8acd0c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:18.290042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 67/136] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:18 2022] GET /identity/v3/projects/b0af45ca745342f186fdecaefdab7473 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:18.295934 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:18.427915 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09002e-0dfa-44b4-a657-1bd3dc1ac8cb None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:18.468458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126f510-36f2-400b-88d8-65387449e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:18.469327 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126f510-36f2-400b-88d8-65387449e625 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:18.469678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126f510-36f2-400b-88d8-65387449e625 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:18.469951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126f510-36f2-400b-88d8-65387449e625 None admin] PATH_INFO: `/v3/projects/b0af45ca745342f186fdecaefdab7473/users/2f8289df6b1c456881b14587b19133f7/roles/d93601b75fd74dcf89b2cee3d7541f90` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:18.472798 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126f510-36f2-400b-88d8-65387449e625 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0af45ca745342f186fdecaefdab7473, user_id=2f8289df6b1c456881b14587b19133f7, role_id=d93601b75fd74dcf89b2cee3d7541f90)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:18.474265 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126f510-36f2-400b-88d8-65387449e625 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:18.491898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 70/137] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:18 2022] PUT /identity/v3/projects/b0af45ca745342f186fdecaefdab7473/users/2f8289df6b1c456881b14587b19133f7/roles/d93601b75fd74dcf89b2cee3d7541f90 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:19.691892 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9410-24ec-4ac2-a5fb-2e40a04a8b2c None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:19.692603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9410-24ec-4ac2-a5fb-2e40a04a8b2c None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:19.692603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9410-24ec-4ac2-a5fb-2e40a04a8b2c None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:19.693843 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 68/138] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:19.699712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d2af2-68ba-4f2e-aa91-eec955b327d7 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:19.700304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d2af2-68ba-4f2e-aa91-eec955b327d7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:19.700304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d2af2-68ba-4f2e-aa91-eec955b327d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:19.713327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1c3f-620e-43cb-843b-a094be55f2cf None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:19.713614 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1c3f-620e-43cb-843b-a094be55f2cf None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:19.713887 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a1c3f-620e-43cb-843b-a094be55f2cf None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:19.715255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 69/139] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:19.723100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823375cd-fb98-41f7-a52a-09fb651d5564 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:19.723100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823375cd-fb98-41f7-a52a-09fb651d5564 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:19.723100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823375cd-fb98-41f7-a52a-09fb651d5564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:19.733742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-318d2af2-68ba-4f2e-aa91-eec955b327d7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:19.735026 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-318d2af2-68ba-4f2e-aa91-eec955b327d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:19.753038 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-823375cd-fb98-41f7-a52a-09fb651d5564 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:19.754582 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-823375cd-fb98-41f7-a52a-09fb651d5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:19.850503 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 71/140] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:19.882712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d2af2-68ba-4f2e-aa91-eec955b327d7 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:19.918313 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 70/141] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:19.950197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823375cd-fb98-41f7-a52a-09fb651d5564 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:20.147704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d2af2-68ba-4f2e-aa91-eec955b327d7 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:20.170926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823375cd-fb98-41f7-a52a-09fb651d5564 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:20.233710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e91e-fd19-4bde-8f2c-1fc32dee9d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:20.234533 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e91e-fd19-4bde-8f2c-1fc32dee9d69 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:20.234820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e91e-fd19-4bde-8f2c-1fc32dee9d69 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:20.235099 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e91e-fd19-4bde-8f2c-1fc32dee9d69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:20.249603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1d175-01b3-4ec8-b31c-6c4945185097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:20.250423 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d175-01b3-4ec8-b31c-6c4945185097 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:20.250707 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d175-01b3-4ec8-b31c-6c4945185097 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:20.250982 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1d175-01b3-4ec8-b31c-6c4945185097 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:20.264867 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77e91e-fd19-4bde-8f2c-1fc32dee9d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-8e77e91e-fd19-4bde-8f2c-1fc32dee9d69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:20.273411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:20.274506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:20.275416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 72/142] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:20.276184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1d175-01b3-4ec8-b31c-6c4945185097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:20.280663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e91e-fd19-4bde-8f2c-1fc32dee9d69 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-24f1d175-01b3-4ec8-b31c-6c4945185097 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:20.292210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:20.293308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:20.294241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 71/143] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:20.299393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1d175-01b3-4ec8-b31c-6c4945185097 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:20.462266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e91e-fd19-4bde-8f2c-1fc32dee9d69 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:20.498249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1d175-01b3-4ec8-b31c-6c4945185097 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:20.551353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:20.552073 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:20.552364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:20.552648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:20.553420 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] RBAC: Adding query filter params (name=member) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:20.553732 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:20.555132 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:20.573717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:20.574408 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:20.574691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:20.574967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:20.575730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:20.576098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:20.577499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:20.586079 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 73/144] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:20.591477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:20.594056 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 72/145] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:20.600648 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:20.758055 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316cabc-7418-4a05-8255-8c6447675692 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:20.810652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e09301-2dae-40f9-8c5f-4d57352aa383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:20.811921 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e09301-2dae-40f9-8c5f-4d57352aa383 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:20.812393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e09301-2dae-40f9-8c5f-4d57352aa383 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:20.812928 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e09301-2dae-40f9-8c5f-4d57352aa383 None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:20.816146 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e09301-2dae-40f9-8c5f-4d57352aa383 None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:20.817895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e09301-2dae-40f9-8c5f-4d57352aa383 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:20.822311 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 74/146] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:20 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:20.826316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dd340-fc69-4718-a7bf-9543a97f432b None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:20.831846 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dd340-fc69-4718-a7bf-9543a97f432b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:20.832288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dd340-fc69-4718-a7bf-9543a97f432b None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:20.833999 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 75/147] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:20.835076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dd340-fc69-4718-a7bf-9543a97f432b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:20.841052 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca37ac8-db31-42fc-9b88-92a4135fe528 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:20.887611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36749f33-a011-4b06-b096-0d3146344fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:20.888825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36749f33-a011-4b06-b096-0d3146344fd1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:20.889273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36749f33-a011-4b06-b096-0d3146344fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:20.889719 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36749f33-a011-4b06-b096-0d3146344fd1 None admin] PATH_INFO: `/v3/users/51d9969637e5400cad1f18de76cb1fd3` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:20.891283 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36749f33-a011-4b06-b096-0d3146344fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=51d9969637e5400cad1f18de76cb1fd3)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:20.894924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36749f33-a011-4b06-b096-0d3146344fd1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:20.901464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 73/148] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:20 2022] GET /identity/v3/users/51d9969637e5400cad1f18de76cb1fd3 => generated 247 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:20.902965 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d119-8b5f-413f-beb2-966ea4d47777 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:20.905560 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d119-8b5f-413f-beb2-966ea4d47777 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:20.906028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d119-8b5f-413f-beb2-966ea4d47777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:20.940513 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-08a2d119-8b5f-413f-beb2-966ea4d47777 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:20.944326 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-08a2d119-8b5f-413f-beb2-966ea4d47777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:21.039629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 74/149] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:21.040816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d119-8b5f-413f-beb2-966ea4d47777 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:21.046233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dd340-fc69-4718-a7bf-9543a97f432b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:21.096732 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b9303-fe50-426f-9713-7e1e4813d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:21.097390 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b9303-fe50-426f-9713-7e1e4813d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.097678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b9303-fe50-426f-9713-7e1e4813d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.097959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b9303-fe50-426f-9713-7e1e4813d0c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.170767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b9303-fe50-426f-9713-7e1e4813d0c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:21.171915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d119-8b5f-413f-beb2-966ea4d47777 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:21.172594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b9303-fe50-426f-9713-7e1e4813d0c4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:21.208954 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e88c83-730b-4601-b951-3ff318943417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:21.209983 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e88c83-730b-4601-b951-3ff318943417 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.210484 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e88c83-730b-4601-b951-3ff318943417 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.211007 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e88c83-730b-4601-b951-3ff318943417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.279532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 76/150] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:21.281164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871809-d0d9-440a-8475-61ad93ded18b None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.281659 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871809-d0d9-440a-8475-61ad93ded18b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.282187 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871809-d0d9-440a-8475-61ad93ded18b None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.284272 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e88c83-730b-4601-b951-3ff318943417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:21.284636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 77/151] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:21.286179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e88c83-730b-4601-b951-3ff318943417 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:21.289934 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871809-d0d9-440a-8475-61ad93ded18b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:21.392432 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 75/152] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:21.393714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e88c83-730b-4601-b951-3ff318943417 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:21.398031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871809-d0d9-440a-8475-61ad93ded18b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:21.436314 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cf6e9-a6e3-42e8-a1a5-c22bcb2cde8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:21.437502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf6e9-a6e3-42e8-a1a5-c22bcb2cde8d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.438016 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf6e9-a6e3-42e8-a1a5-c22bcb2cde8d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.438538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cf6e9-a6e3-42e8-a1a5-c22bcb2cde8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.440715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cf6e9-a6e3-42e8-a1a5-c22bcb2cde8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:21.442390 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cf6e9-a6e3-42e8-a1a5-c22bcb2cde8d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:21.444309 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 78/153] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:21.445777 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb563f1-1de5-4d0e-9b8f-29bc69433510 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.446294 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb563f1-1de5-4d0e-9b8f-29bc69433510 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.447072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb563f1-1de5-4d0e-9b8f-29bc69433510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.465688 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-ebb563f1-1de5-4d0e-9b8f-29bc69433510 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:21.467249 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-ebb563f1-1de5-4d0e-9b8f-29bc69433510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:21.500076 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e88c83-730b-4601-b951-3ff318943417 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:21.535186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58f32-6b54-44f9-b2dd-7d72de23bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:21.535453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 79/154] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:21.536395 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb563f1-1de5-4d0e-9b8f-29bc69433510 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:21.551856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58f32-6b54-44f9-b2dd-7d72de23bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.551856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58f32-6b54-44f9-b2dd-7d72de23bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.551856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58f32-6b54-44f9-b2dd-7d72de23bbb3 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.553240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58f32-6b54-44f9-b2dd-7d72de23bbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:21.555023 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58f32-6b54-44f9-b2dd-7d72de23bbb3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:21.557264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 76/155] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:21 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:21.558041 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58f32-6b54-44f9-b2dd-7d72de23bbb3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:21.637529 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb563f1-1de5-4d0e-9b8f-29bc69433510 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:21.655879 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58f32-6b54-44f9-b2dd-7d72de23bbb3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:21.672113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4412456-fa71-4d7b-a4c2-95ee24c85b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:21.672973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4412456-fa71-4d7b-a4c2-95ee24c85b60 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.673257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4412456-fa71-4d7b-a4c2-95ee24c85b60 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.673538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4412456-fa71-4d7b-a4c2-95ee24c85b60 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.675401 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4412456-fa71-4d7b-a4c2-95ee24c85b60 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:21.676883 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4412456-fa71-4d7b-a4c2-95ee24c85b60 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:21.678595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 80/156] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:21 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:21.679785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216884-c064-4329-81b7-deac6e0f01e5 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.680073 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216884-c064-4329-81b7-deac6e0f01e5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.680349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216884-c064-4329-81b7-deac6e0f01e5 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.682069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 81/157] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:21.683910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b216884-c064-4329-81b7-deac6e0f01e5 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:21.697358 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c06f14-4ff9-4475-9d13-94b126d43d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:21.698040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c06f14-4ff9-4475-9d13-94b126d43d29 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.698333 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c06f14-4ff9-4475-9d13-94b126d43d29 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.698612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c06f14-4ff9-4475-9d13-94b126d43d29 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.699336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c06f14-4ff9-4475-9d13-94b126d43d29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:21.700864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c06f14-4ff9-4475-9d13-94b126d43d29 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:21.720702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 77/158] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:15:21 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:21.722295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c06f14-4ff9-4475-9d13-94b126d43d29 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:21.794818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b216884-c064-4329-81b7-deac6e0f01e5 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:21.829646 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c06f14-4ff9-4475-9d13-94b126d43d29 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:21.833745 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45933f43-752f-4b37-87ff-bd2f770d6d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:21.834907 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933f43-752f-4b37-87ff-bd2f770d6d48 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.835191 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933f43-752f-4b37-87ff-bd2f770d6d48 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.835468 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933f43-752f-4b37-87ff-bd2f770d6d48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.847369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45933f43-752f-4b37-87ff-bd2f770d6d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-45933f43-752f-4b37-87ff-bd2f770d6d48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:21.855653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:21.856773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:21.857840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 82/159] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:21.858717 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd7400-0cb4-4b3e-82d9-5badd87e118e None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.858717 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd7400-0cb4-4b3e-82d9-5badd87e118e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.858853 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd7400-0cb4-4b3e-82d9-5badd87e118e None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.863810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 83/160] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:21.863810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd7400-0cb4-4b3e-82d9-5badd87e118e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:21.875058 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec02a69-aa65-4073-b982-18122acd5418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:21.875825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02a69-aa65-4073-b982-18122acd5418 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.876093 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02a69-aa65-4073-b982-18122acd5418 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.876376 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec02a69-aa65-4073-b982-18122acd5418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.877783 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec02a69-aa65-4073-b982-18122acd5418 None admin] RBAC: Adding query filter params (role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=8ffbe1e0bdf144498702098bd867a307, user.id=2f8289df6b1c456881b14587b19133f7) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:21.878102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec02a69-aa65-4073-b982-18122acd5418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:21.879828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec02a69-aa65-4073-b982-18122acd5418 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:21.886273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 78/161] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:21 2022] GET /identity/v3/role_assignments?user.id=2f8289df6b1c456881b14587b19133f7&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:21.887566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec1b4c-8df1-4fe2-b9a9-571486d266d5 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:21.892459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec1b4c-8df1-4fe2-b9a9-571486d266d5 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:21.892459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec1b4c-8df1-4fe2-b9a9-571486d266d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:21.913939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-deec1b4c-8df1-4fe2-b9a9-571486d266d5 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:21.916278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-deec1b4c-8df1-4fe2-b9a9-571486d266d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:22.006437 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd7400-0cb4-4b3e-82d9-5badd87e118e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:22.026481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 79/162] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:22.027371 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec1b4c-8df1-4fe2-b9a9-571486d266d5 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:22.063698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13eb3b-7820-4a89-ad0e-624aecdd5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:22.064589 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13eb3b-7820-4a89-ad0e-624aecdd5076 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.066005 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13eb3b-7820-4a89-ad0e-624aecdd5076 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.066005 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13eb3b-7820-4a89-ad0e-624aecdd5076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.066950 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13eb3b-7820-4a89-ad0e-624aecdd5076 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=8ffbe1e0bdf144498702098bd867a307, user.id=51d9969637e5400cad1f18de76cb1fd3) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:22.067066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13eb3b-7820-4a89-ad0e-624aecdd5076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:22.069441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13eb3b-7820-4a89-ad0e-624aecdd5076 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:22.076266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 84/163] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:21 2022] GET /identity/v3/role_assignments?user.id=51d9969637e5400cad1f18de76cb1fd3&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:22.077632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9d15f-e62a-4d1b-92b0-0f6d9fce701b None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.077923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9d15f-e62a-4d1b-92b0-0f6d9fce701b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.078203 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9d15f-e62a-4d1b-92b0-0f6d9fce701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.100623 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-afc9d15f-e62a-4d1b-92b0-0f6d9fce701b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:22.101769 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-afc9d15f-e62a-4d1b-92b0-0f6d9fce701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:22.168134 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec1b4c-8df1-4fe2-b9a9-571486d266d5 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:22.217203 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 85/164] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:22.223801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9d15f-e62a-4d1b-92b0-0f6d9fce701b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:22.234614 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:22.235629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.236141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.236600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.239094 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:22.240116 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:22.241568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:22.258711 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 80/165] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:22.260086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:22.395727 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9d15f-e62a-4d1b-92b0-0f6d9fce701b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:22.431059 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc28c-8577-4acc-a46f-da11c600b9fa None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:22.438316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a107724-80cf-47e1-90b6-f7accbb888fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:22.439112 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a107724-80cf-47e1-90b6-f7accbb888fa None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.439394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a107724-80cf-47e1-90b6-f7accbb888fa None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.440300 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a107724-80cf-47e1-90b6-f7accbb888fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.464702 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a107724-80cf-47e1-90b6-f7accbb888fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-9a107724-80cf-47e1-90b6-f7accbb888fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:22.473914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:22.474929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:22.476238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:22.476927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801e06d-e70c-4a24-b467-e74177dc1ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:22.477021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 86/166] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:22.477104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801e06d-e70c-4a24-b467-e74177dc1ef3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.477104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801e06d-e70c-4a24-b467-e74177dc1ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.477104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801e06d-e70c-4a24-b467-e74177dc1ef3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.477290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a107724-80cf-47e1-90b6-f7accbb888fa None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:22.490633 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801e06d-e70c-4a24-b467-e74177dc1ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-a801e06d-e70c-4a24-b467-e74177dc1ef3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:22.500961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:22.501971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:22.503411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 81/167] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:22.505663 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801e06d-e70c-4a24-b467-e74177dc1ef3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:22.605828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a107724-80cf-47e1-90b6-f7accbb888fa None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:22.651235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801e06d-e70c-4a24-b467-e74177dc1ef3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:22.671360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d203a85-dc4b-4c5e-a043-5d9679c4760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:22.672268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203a85-dc4b-4c5e-a043-5d9679c4760c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.672554 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203a85-dc4b-4c5e-a043-5d9679c4760c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.672832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203a85-dc4b-4c5e-a043-5d9679c4760c None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.675617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d203a85-dc4b-4c5e-a043-5d9679c4760c None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:22.677157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d203a85-dc4b-4c5e-a043-5d9679c4760c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:22.678857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 87/168] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:22 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:22.680969 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d203a85-dc4b-4c5e-a043-5d9679c4760c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:22.720153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:22.721421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.721791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.722111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.722883 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:22.723195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:22.725751 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:22.740685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 82/169] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:22.742895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:22.861119 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d203a85-dc4b-4c5e-a043-5d9679c4760c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:22.916659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da67403-0686-40a7-ae4e-7037bca30087 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:22.953622 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9905475-ec06-485f-ab66-a66d5f6398c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:22.954280 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9905475-ec06-485f-ab66-a66d5f6398c9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.954564 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9905475-ec06-485f-ab66-a66d5f6398c9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.954841 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9905475-ec06-485f-ab66-a66d5f6398c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.957471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:22.958145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:22.958435 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:22.958713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:22.959479 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] RBAC: Adding query filter params (name=member) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:22.959815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:22.961204 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:22.980035 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 88/170] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:22.982109 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:23.085427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9905475-ec06-485f-ab66-a66d5f6398c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:23.087348 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9905475-ec06-485f-ab66-a66d5f6398c9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:23.168100 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c6e7-c75d-41d3-981b-dbb1de09b3fb None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:23.213508 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a61dce-6d9f-4329-88ab-cb34ecbb20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:23.214379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61dce-6d9f-4329-88ab-cb34ecbb20de None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:23.214659 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61dce-6d9f-4329-88ab-cb34ecbb20de None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:23.214931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a61dce-6d9f-4329-88ab-cb34ecbb20de None admin] PATH_INFO: `/v3/users/791bc4c18ffe4a1e90b28b9ddeb4db93` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:23.216818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a61dce-6d9f-4329-88ab-cb34ecbb20de None admin] RBAC: Authorizing `identity:get_user(user_id=791bc4c18ffe4a1e90b28b9ddeb4db93)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:23.218263 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a61dce-6d9f-4329-88ab-cb34ecbb20de None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:23.219912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 89/171] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:22 2022] GET /identity/v3/users/791bc4c18ffe4a1e90b28b9ddeb4db93 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:23.220675 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a61dce-6d9f-4329-88ab-cb34ecbb20de None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:23.297746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 83/172] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:23.298613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9905475-ec06-485f-ab66-a66d5f6398c9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:23.398541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a61dce-6d9f-4329-88ab-cb34ecbb20de None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:23.448494 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879be43c-95da-42a7-b50a-9fb5f3f18f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:23.449381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879be43c-95da-42a7-b50a-9fb5f3f18f12 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:23.449669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879be43c-95da-42a7-b50a-9fb5f3f18f12 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:23.449947 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879be43c-95da-42a7-b50a-9fb5f3f18f12 None admin] PATH_INFO: `/v3/users/2f8289df6b1c456881b14587b19133f7` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:23.451205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879be43c-95da-42a7-b50a-9fb5f3f18f12 None admin] RBAC: Authorizing `identity:get_user(user_id=2f8289df6b1c456881b14587b19133f7)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:23.452777 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879be43c-95da-42a7-b50a-9fb5f3f18f12 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:23.454580 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 90/173] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:23 2022] GET /identity/v3/users/2f8289df6b1c456881b14587b19133f7 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:23.459787 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879be43c-95da-42a7-b50a-9fb5f3f18f12 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:23.485935 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9905475-ec06-485f-ab66-a66d5f6398c9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:23.552033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc006bb-d7c7-4c52-89d4-96cb69237d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:23.554763 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc006bb-d7c7-4c52-89d4-96cb69237d45 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:23.556244 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc006bb-d7c7-4c52-89d4-96cb69237d45 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:23.556706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc006bb-d7c7-4c52-89d4-96cb69237d45 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:23.558990 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc006bb-d7c7-4c52-89d4-96cb69237d45 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:23.562176 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc006bb-d7c7-4c52-89d4-96cb69237d45 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:23.565154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 84/174] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:23 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:23.570254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc006bb-d7c7-4c52-89d4-96cb69237d45 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:23.628996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879be43c-95da-42a7-b50a-9fb5f3f18f12 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:23.664451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945ca2-5668-4648-8b66-3b51c90f56bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:23.665417 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945ca2-5668-4648-8b66-3b51c90f56bd None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:23.665622 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945ca2-5668-4648-8b66-3b51c90f56bd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:23.665879 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c945ca2-5668-4648-8b66-3b51c90f56bd None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:23.667095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c945ca2-5668-4648-8b66-3b51c90f56bd None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:23.668601 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c945ca2-5668-4648-8b66-3b51c90f56bd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:23.671400 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 91/175] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:23 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:23.671543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945ca2-5668-4648-8b66-3b51c90f56bd None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:23.754114 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc006bb-d7c7-4c52-89d4-96cb69237d45 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:23.777175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c945ca2-5668-4648-8b66-3b51c90f56bd None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:23.811917 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681cb2-f816-4bd4-a396-4faa4d0777cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:23.812819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681cb2-f816-4bd4-a396-4faa4d0777cd None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:23.813111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681cb2-f816-4bd4-a396-4faa4d0777cd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:23.813374 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681cb2-f816-4bd4-a396-4faa4d0777cd None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307/users/791bc4c18ffe4a1e90b28b9ddeb4db93/roles/7588576bc19e4dd18fb26d25c2a166aa` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:23.815992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3681cb2-f816-4bd4-a396-4faa4d0777cd None admin] RBAC: Authorizing `identity:create_grant(project_id=8ffbe1e0bdf144498702098bd867a307, user_id=791bc4c18ffe4a1e90b28b9ddeb4db93, role_id=7588576bc19e4dd18fb26d25c2a166aa)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:23.817458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3681cb2-f816-4bd4-a396-4faa4d0777cd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:23.832727 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040457-f92f-460c-8bb8-5c143cf7c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:23.839350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 92/176] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:23 2022] PUT /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307/users/791bc4c18ffe4a1e90b28b9ddeb4db93/roles/7588576bc19e4dd18fb26d25c2a166aa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:23.839927 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681cb2-f816-4bd4-a396-4faa4d0777cd None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:23.844659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040457-f92f-460c-8bb8-5c143cf7c4b1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:23.844994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040457-f92f-460c-8bb8-5c143cf7c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:23.845228 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040457-f92f-460c-8bb8-5c143cf7c4b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:23.967375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3681cb2-f816-4bd4-a396-4faa4d0777cd None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:24.003961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:24.004701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:24.004938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:24.005202 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:24.005312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b040457-f92f-460c-8bb8-5c143cf7c4b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:24.006066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] RBAC: Adding query filter params (role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=8ffbe1e0bdf144498702098bd867a307, user.id=2f8289df6b1c456881b14587b19133f7) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:24.006384 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:24.006748 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b040457-f92f-460c-8bb8-5c143cf7c4b1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:24.007906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:24.014461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 93/177] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:23 2022] GET /identity/v3/role_assignments?user.id=2f8289df6b1c456881b14587b19133f7&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:24.160499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 85/178] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:24.165872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:24.316337 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21e562-2c59-4051-af37-2155cb33f7fb None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:24.352325 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19337e-d9e1-47ae-b5d2-a515a13f88c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:24.353194 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19337e-d9e1-47ae-b5d2-a515a13f88c5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:24.353486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19337e-d9e1-47ae-b5d2-a515a13f88c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:24.353767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19337e-d9e1-47ae-b5d2-a515a13f88c5 None admin] PATH_INFO: `/v3/projects/b0af45ca745342f186fdecaefdab7473` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:24.355018 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19337e-d9e1-47ae-b5d2-a515a13f88c5 None admin] RBAC: Authorizing `identity:get_project(project_id=b0af45ca745342f186fdecaefdab7473)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:24.356515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19337e-d9e1-47ae-b5d2-a515a13f88c5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:24.358499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 94/179] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:24 2022] GET /identity/v3/projects/b0af45ca745342f186fdecaefdab7473 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:24.364893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040457-f92f-460c-8bb8-5c143cf7c4b1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:24.474367 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040457-f92f-460c-8bb8-5c143cf7c4b1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:24.510547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f8fc4-8ae8-4cf7-9a9d-a40f92bf170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:24.511228 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f8fc4-8ae8-4cf7-9a9d-a40f92bf170f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:24.511516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f8fc4-8ae8-4cf7-9a9d-a40f92bf170f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:24.511822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f8fc4-8ae8-4cf7-9a9d-a40f92bf170f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:24.512681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f8fc4-8ae8-4cf7-9a9d-a40f92bf170f None admin] RBAC: Adding query filter params (role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=b0af45ca745342f186fdecaefdab7473, user.id=2f8289df6b1c456881b14587b19133f7) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:24.512994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f8fc4-8ae8-4cf7-9a9d-a40f92bf170f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:24.514465 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f8fc4-8ae8-4cf7-9a9d-a40f92bf170f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:24.521856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 86/180] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:24 2022] GET /identity/v3/role_assignments?user.id=2f8289df6b1c456881b14587b19133f7&scope.project.id=b0af45ca745342f186fdecaefdab7473&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:24.843504 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b416f-adf3-4efc-9410-de549016fc14 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:24.843709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b416f-adf3-4efc-9410-de549016fc14 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:24.844008 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b416f-adf3-4efc-9410-de549016fc14 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:24.846284 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 95/181] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:24.853235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80160c9-c5e4-4dce-849b-fd329d1bb36c None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:24.853580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80160c9-c5e4-4dce-849b-fd329d1bb36c None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:24.853802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80160c9-c5e4-4dce-849b-fd329d1bb36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:24.875503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-e80160c9-c5e4-4dce-849b-fd329d1bb36c None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:24.876748 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-e80160c9-c5e4-4dce-849b-fd329d1bb36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:24.954016 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 87/182] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:24.983447 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b416f-adf3-4efc-9410-de549016fc14 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.050865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d5194-2143-484e-b694-36cfc758bc39 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.051882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d5194-2143-484e-b694-36cfc758bc39 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.052375 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d5194-2143-484e-b694-36cfc758bc39 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.054010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 88/183] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:25.064060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95de01-5cc5-456a-bc4f-302821dc3dd7 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.065714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95de01-5cc5-456a-bc4f-302821dc3dd7 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.066293 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95de01-5cc5-456a-bc4f-302821dc3dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.091728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-8b95de01-5cc5-456a-bc4f-302821dc3dd7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:25.092942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-8b95de01-5cc5-456a-bc4f-302821dc3dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:25.115467 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b416f-adf3-4efc-9410-de549016fc14 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.162639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9b654-0ab9-4906-b9ed-9c5dd61ce905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.164319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b654-0ab9-4906-b9ed-9c5dd61ce905 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.165072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b654-0ab9-4906-b9ed-9c5dd61ce905 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.165542 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9b654-0ab9-4906-b9ed-9c5dd61ce905 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.168658 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 89/184] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:25.177051 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8cb5-f98b-4ce4-b307-0b4387c86b1e None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.177364 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8cb5-f98b-4ce4-b307-0b4387c86b1e None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.177623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed8cb5-f98b-4ce4-b307-0b4387c86b1e None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.178308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9b654-0ab9-4906-b9ed-9c5dd61ce905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:25.179282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 90/185] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:25.184914 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817196d4-7dbe-4f09-99f2-dbee6a5b2d8e None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.185202 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817196d4-7dbe-4f09-99f2-dbee6a5b2d8e None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.185481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817196d4-7dbe-4f09-99f2-dbee6a5b2d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-d4d9b654-0ab9-4906-b9ed-9c5dd61ce905 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:25.187171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:25.188370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:25.190225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:25.192756 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 96/186] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:25.198971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9b654-0ab9-4906-b9ed-9c5dd61ce905 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.204925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-817196d4-7dbe-4f09-99f2-dbee6a5b2d8e None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:25.206854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-817196d4-7dbe-4f09-99f2-dbee6a5b2d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:25.274454 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 91/187] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:25.275207 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817196d4-7dbe-4f09-99f2-dbee6a5b2d8e None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.305320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9b654-0ab9-4906-b9ed-9c5dd61ce905 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.339706 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.340394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.340681 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.340963 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.341715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:25.342027 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:25.343400 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:25.356009 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 97/188] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:25.356009 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.385410 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817196d4-7dbe-4f09-99f2-dbee6a5b2d8e None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.417966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43f3b9-b7ee-4aa1-9867-f089ff63e5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.418768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43f3b9-b7ee-4aa1-9867-f089ff63e5f6 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.419062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43f3b9-b7ee-4aa1-9867-f089ff63e5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.419330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43f3b9-b7ee-4aa1-9867-f089ff63e5f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.420541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43f3b9-b7ee-4aa1-9867-f089ff63e5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:25.422008 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43f3b9-b7ee-4aa1-9867-f089ff63e5f6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:25.424331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 92/189] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:25.425433 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43f3b9-b7ee-4aa1-9867-f089ff63e5f6 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.459362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f8add-efad-47bf-b0f9-992eba199321 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.493237 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306caf-11f4-43b5-a945-da10f79d1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.494067 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306caf-11f4-43b5-a945-da10f79d1082 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.494354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306caf-11f4-43b5-a945-da10f79d1082 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.494627 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306caf-11f4-43b5-a945-da10f79d1082 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.507140 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd306caf-11f4-43b5-a945-da10f79d1082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-dd306caf-11f4-43b5-a945-da10f79d1082 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:25.515385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:25.516424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:25.517333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 98/190] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:25.519358 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306caf-11f4-43b5-a945-da10f79d1082 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.535135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43f3b9-b7ee-4aa1-9867-f089ff63e5f6 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.577478 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8d618-80f6-48b0-8609-ded03f51c087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.578351 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d618-80f6-48b0-8609-ded03f51c087 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.578640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d618-80f6-48b0-8609-ded03f51c087 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.578917 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d618-80f6-48b0-8609-ded03f51c087 None admin] PATH_INFO: `/v3/users/84ee02b39cf44773a2639ae6bc4511cb` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.594167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8d618-80f6-48b0-8609-ded03f51c087 None admin] RBAC: Authorizing `identity:get_user(user_id=84ee02b39cf44773a2639ae6bc4511cb)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:25.595650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8d618-80f6-48b0-8609-ded03f51c087 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:25.597918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 93/191] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:25 2022] GET /identity/v3/users/84ee02b39cf44773a2639ae6bc4511cb => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:25.602452 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8d618-80f6-48b0-8609-ded03f51c087 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.629184 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306caf-11f4-43b5-a945-da10f79d1082 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.662761 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bd4ee-5df7-481e-8867-96bb86b15e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.663351 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bd4ee-5df7-481e-8867-96bb86b15e36 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.663645 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bd4ee-5df7-481e-8867-96bb86b15e36 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.663927 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bd4ee-5df7-481e-8867-96bb86b15e36 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.664633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bd4ee-5df7-481e-8867-96bb86b15e36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:25.666130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bd4ee-5df7-481e-8867-96bb86b15e36 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:25.695792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 99/192] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:15:25 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:25.695792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bd4ee-5df7-481e-8867-96bb86b15e36 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.697359 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8d618-80f6-48b0-8609-ded03f51c087 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.741033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.741716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.741994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.742265 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.743033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:25.743336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:25.744767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:25.753992 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 94/193] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:25.760101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.819845 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bd4ee-5df7-481e-8867-96bb86b15e36 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.856149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d076cc-062a-4e96-b410-5d066d82c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.856938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d076cc-062a-4e96-b410-5d066d82c2ef None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.857289 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d076cc-062a-4e96-b410-5d066d82c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.857636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d076cc-062a-4e96-b410-5d066d82c2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.876024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0c541-7ac2-4dae-9f56-71188cc10138 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:25.913972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3207e4-8235-4b5e-87ca-13706c9a394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:25.915228 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3207e4-8235-4b5e-87ca-13706c9a394d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:25.915683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3207e4-8235-4b5e-87ca-13706c9a394d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:25.916176 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3207e4-8235-4b5e-87ca-13706c9a394d None admin] PATH_INFO: `/v3/users/84ee02b39cf44773a2639ae6bc4511cb` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:25.917611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3207e4-8235-4b5e-87ca-13706c9a394d None admin] RBAC: Authorizing `identity:get_user(user_id=84ee02b39cf44773a2639ae6bc4511cb)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:25.919246 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3207e4-8235-4b5e-87ca-13706c9a394d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:25.921655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 95/194] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:25 2022] GET /identity/v3/users/84ee02b39cf44773a2639ae6bc4511cb => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:25.927545 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3207e4-8235-4b5e-87ca-13706c9a394d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:25.935857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d076cc-062a-4e96-b410-5d066d82c2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:25.937641 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d076cc-062a-4e96-b410-5d066d82c2ef None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:26.035235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3207e4-8235-4b5e-87ca-13706c9a394d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:26.046513 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 100/195] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:26.053138 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d076cc-062a-4e96-b410-5d066d82c2ef None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:26.072981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f45b1-30c2-4c8f-a39e-1cf21286cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:26.074360 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f45b1-30c2-4c8f-a39e-1cf21286cae9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:26.074859 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f45b1-30c2-4c8f-a39e-1cf21286cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:26.075363 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f45b1-30c2-4c8f-a39e-1cf21286cae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:26.157690 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d076cc-062a-4e96-b410-5d066d82c2ef None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:26.161987 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f45b1-30c2-4c8f-a39e-1cf21286cae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:26.163488 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f45b1-30c2-4c8f-a39e-1cf21286cae9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:26.196953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5839d-8014-4fca-94fb-034700c87ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:26.199751 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5839d-8014-4fca-94fb-034700c87ffe None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:26.201451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5839d-8014-4fca-94fb-034700c87ffe None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:26.201966 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5839d-8014-4fca-94fb-034700c87ffe None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:26.204547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5839d-8014-4fca-94fb-034700c87ffe None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:26.208191 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5839d-8014-4fca-94fb-034700c87ffe None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:26.211219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 101/196] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:26 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:26.217166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5839d-8014-4fca-94fb-034700c87ffe None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:26.341163 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5839d-8014-4fca-94fb-034700c87ffe None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:26.384358 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 96/197] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:26.389840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f45b1-30c2-4c8f-a39e-1cf21286cae9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:26.448642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:26.449239 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:26.449528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:26.449810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:26.450668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=c4cc0a347718443997a25150c537ff79, user.id=84ee02b39cf44773a2639ae6bc4511cb) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:26.450983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:26.452822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:26.467960 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 102/198] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:26 2022] GET /identity/v3/role_assignments?user.id=84ee02b39cf44773a2639ae6bc4511cb&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:26.509280 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f45b1-30c2-4c8f-a39e-1cf21286cae9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:26.551671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcb8e5-4581-4168-b934-f3590fd4ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:26.553051 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcb8e5-4581-4168-b934-f3590fd4ea37 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:26.553600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcb8e5-4581-4168-b934-f3590fd4ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:26.554102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcb8e5-4581-4168-b934-f3590fd4ea37 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:26.555847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcb8e5-4581-4168-b934-f3590fd4ea37 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:26.557658 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcb8e5-4581-4168-b934-f3590fd4ea37 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:26.560350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 97/199] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:26 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:26.567811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:26.735047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3359a-d253-4f4c-a04f-9e442169f556 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:26.772331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d072068-5cf8-4649-8376-bfc03232bdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:26.772988 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072068-5cf8-4649-8376-bfc03232bdfb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:26.773271 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072068-5cf8-4649-8376-bfc03232bdfb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:26.773548 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072068-5cf8-4649-8376-bfc03232bdfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:26.774388 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072068-5cf8-4649-8376-bfc03232bdfb None admin] RBAC: Adding query filter params (role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=c4cc0a347718443997a25150c537ff79, user.id=84ee02b39cf44773a2639ae6bc4511cb) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:26.774700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072068-5cf8-4649-8376-bfc03232bdfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:26.776167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072068-5cf8-4649-8376-bfc03232bdfb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:26.781763 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 103/200] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:26 2022] GET /identity/v3/role_assignments?user.id=84ee02b39cf44773a2639ae6bc4511cb&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:26.795326 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c800-11b5-4385-b1cb-a616d45718cc None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:26.795700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c800-11b5-4385-b1cb-a616d45718cc None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:26.795917 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c800-11b5-4385-b1cb-a616d45718cc None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:26.797650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 98/201] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:26.804136 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665503-a7c7-49d3-aea6-8845c78c54eb None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:26.804443 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665503-a7c7-49d3-aea6-8845c78c54eb None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:26.804702 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0665503-a7c7-49d3-aea6-8845c78c54eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:26.834461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-e0665503-a7c7-49d3-aea6-8845c78c54eb None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:26.835703 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-e0665503-a7c7-49d3-aea6-8845c78c54eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:26.921029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 104/202] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:26.958470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c800-11b5-4385-b1cb-a616d45718cc None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:27.077535 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c800-11b5-4385-b1cb-a616d45718cc None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:27.126665 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38483ee-902e-49ea-820e-2298b900621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:27.128390 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38483ee-902e-49ea-820e-2298b900621b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:27.128676 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38483ee-902e-49ea-820e-2298b900621b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:27.128953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38483ee-902e-49ea-820e-2298b900621b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:27.145706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38483ee-902e-49ea-820e-2298b900621b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f38483ee-902e-49ea-820e-2298b900621b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:27.153497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:27.154496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:27.155404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:27.157600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 99/203] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:27.162648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0665503-a7c7-49d3-aea6-8845c78c54eb None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:27.336239 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0665503-a7c7-49d3-aea6-8845c78c54eb None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:27.383534 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:27.384629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:27.385117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:27.385619 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:27.386590 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] RBAC: Adding query filter params (name=reader) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:27.387117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:27.388722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:27.404851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 105/204] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:27.410666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38483ee-902e-49ea-820e-2298b900621b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:27.555435 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38483ee-902e-49ea-820e-2298b900621b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:27.612542 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849964ce-81e5-4eab-925c-daa768e62043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:27.613354 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849964ce-81e5-4eab-925c-daa768e62043 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:27.613636 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849964ce-81e5-4eab-925c-daa768e62043 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:27.613911 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849964ce-81e5-4eab-925c-daa768e62043 None admin] PATH_INFO: `/v3/users/791bc4c18ffe4a1e90b28b9ddeb4db93` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:27.615159 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849964ce-81e5-4eab-925c-daa768e62043 None admin] RBAC: Authorizing `identity:get_user(user_id=791bc4c18ffe4a1e90b28b9ddeb4db93)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:27.616657 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849964ce-81e5-4eab-925c-daa768e62043 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:27.618603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 100/205] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:27 2022] GET /identity/v3/users/791bc4c18ffe4a1e90b28b9ddeb4db93 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:27.623927 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:27.760755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a49bb-6660-4bad-9625-28f9bc63832c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:27.795419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960916ae-049c-434d-b324-b18631f22f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:27.796104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960916ae-049c-434d-b324-b18631f22f0f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:27.796391 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960916ae-049c-434d-b324-b18631f22f0f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:27.796669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960916ae-049c-434d-b324-b18631f22f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:27.865626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960916ae-049c-434d-b324-b18631f22f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:27.867083 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960916ae-049c-434d-b324-b18631f22f0f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:27.969229 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 106/206] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:27.976868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849964ce-81e5-4eab-925c-daa768e62043 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:28.109503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849964ce-81e5-4eab-925c-daa768e62043 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:28.151109 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f4060-11fe-4996-9d6e-a11d9289c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:28.151976 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f4060-11fe-4996-9d6e-a11d9289c5bd None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:28.152259 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f4060-11fe-4996-9d6e-a11d9289c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:28.152538 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f4060-11fe-4996-9d6e-a11d9289c5bd None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:28.153771 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f4060-11fe-4996-9d6e-a11d9289c5bd None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:28.155236 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f4060-11fe-4996-9d6e-a11d9289c5bd None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:28.157218 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 101/207] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:27 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:28.164971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960916ae-049c-434d-b324-b18631f22f0f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:28.283651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960916ae-049c-434d-b324-b18631f22f0f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:28.319015 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc71ed-1226-46c9-bf70-f273251f1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:28.319679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc71ed-1226-46c9-bf70-f273251f1377 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:28.320001 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc71ed-1226-46c9-bf70-f273251f1377 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:28.320280 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc71ed-1226-46c9-bf70-f273251f1377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:28.321257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc71ed-1226-46c9-bf70-f273251f1377 None admin] RBAC: Adding query filter params (role.id=7588576bc19e4dd18fb26d25c2a166aa, scope.project.id=8ffbe1e0bdf144498702098bd867a307, user.id=791bc4c18ffe4a1e90b28b9ddeb4db93) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:28.321439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc71ed-1226-46c9-bf70-f273251f1377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:28.323164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc71ed-1226-46c9-bf70-f273251f1377 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:28.331953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 107/208] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:28 2022] GET /identity/v3/role_assignments?user.id=791bc4c18ffe4a1e90b28b9ddeb4db93&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=7588576bc19e4dd18fb26d25c2a166aa => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:28.904369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d52892-e988-49ed-9ba2-03905bd4f580 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:28.904573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d52892-e988-49ed-9ba2-03905bd4f580 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:28.904840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d52892-e988-49ed-9ba2-03905bd4f580 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:28.906512 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 102/209] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:28.912985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4bc75-72f4-410f-908c-89673b221ee7 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:28.913281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4bc75-72f4-410f-908c-89673b221ee7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:28.913565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4bc75-72f4-410f-908c-89673b221ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:28.931663 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca678-3f50-491f-8bf7-ddb0c040ec15 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:28.932076 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca678-3f50-491f-8bf7-ddb0c040ec15 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:28.932358 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca678-3f50-491f-8bf7-ddb0c040ec15 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:28.933872 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 103/210] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:28.937809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-c7e4bc75-72f4-410f-908c-89673b221ee7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:28.942279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-c7e4bc75-72f4-410f-908c-89673b221ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:28.942458 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49655b4a-ea01-49a2-80e5-0a9cd014e0d9 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:28.942458 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49655b4a-ea01-49a2-80e5-0a9cd014e0d9 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:28.942458 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49655b4a-ea01-49a2-80e5-0a9cd014e0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:28.966979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-49655b4a-ea01-49a2-80e5-0a9cd014e0d9 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:28.968361 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-49655b4a-ea01-49a2-80e5-0a9cd014e0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:29.035074 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 108/211] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:29.061353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 104/212] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:29.062353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4bc75-72f4-410f-908c-89673b221ee7 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:29.093809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49655b4a-ea01-49a2-80e5-0a9cd014e0d9 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:29.191089 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4bc75-72f4-410f-908c-89673b221ee7 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:29.208552 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49655b4a-ea01-49a2-80e5-0a9cd014e0d9 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:29.238112 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6eb5-aabc-4347-ad1d-94c6480eae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:29.239232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6eb5-aabc-4347-ad1d-94c6480eae7a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.239618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6eb5-aabc-4347-ad1d-94c6480eae7a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.240347 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6eb5-aabc-4347-ad1d-94c6480eae7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.244821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c774e2-4a8b-43b1-8401-756bd8c4e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:29.245879 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c774e2-4a8b-43b1-8401-756bd8c4e81a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.246373 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c774e2-4a8b-43b1-8401-756bd8c4e81a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.246799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c774e2-4a8b-43b1-8401-756bd8c4e81a None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.248162 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c774e2-4a8b-43b1-8401-756bd8c4e81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:29.249751 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c774e2-4a8b-43b1-8401-756bd8c4e81a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:29.252251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6eb5-aabc-4347-ad1d-94c6480eae7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:29.256244 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 105/213] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:29.257241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c774e2-4a8b-43b1-8401-756bd8c4e81a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-1a3b6eb5-aabc-4347-ad1d-94c6480eae7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:29.261734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:29.262799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:29.263723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 109/214] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:29.273571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6eb5-aabc-4347-ad1d-94c6480eae7a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:29.382642 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c774e2-4a8b-43b1-8401-756bd8c4e81a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:29.385772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6eb5-aabc-4347-ad1d-94c6480eae7a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:29.417646 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eadcef-be85-4971-b3c6-d06b04814b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:29.418320 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eadcef-be85-4971-b3c6-d06b04814b2e None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.418608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eadcef-be85-4971-b3c6-d06b04814b2e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.418885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eadcef-be85-4971-b3c6-d06b04814b2e None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.419251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc512a-5ee6-470d-b871-cb221cea6b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:29.419594 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eadcef-be85-4971-b3c6-d06b04814b2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:29.419948 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc512a-5ee6-470d-b871-cb221cea6b29 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.420238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc512a-5ee6-470d-b871-cb221cea6b29 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.420518 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc512a-5ee6-470d-b871-cb221cea6b29 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.421069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eadcef-be85-4971-b3c6-d06b04814b2e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:29.421273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc512a-5ee6-470d-b871-cb221cea6b29 None admin] RBAC: Adding query filter params (name=member) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:29.421584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc512a-5ee6-470d-b871-cb221cea6b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:29.422968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc512a-5ee6-470d-b871-cb221cea6b29 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:29.431713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 110/215] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:29.432859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d66a1e-b780-4324-b273-53c25524fbe5 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.433169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d66a1e-b780-4324-b273-53c25524fbe5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.433429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d66a1e-b780-4324-b273-53c25524fbe5 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.435050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 111/216] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:29.437066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d66a1e-b780-4324-b273-53c25524fbe5 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:29.445997 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 106/217] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:15:29 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:29.453465 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2fdb-4514-4811-9222-2f33b5427e65 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.454239 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2fdb-4514-4811-9222-2f33b5427e65 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.454527 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe2fdb-4514-4811-9222-2f33b5427e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.479049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-7cbe2fdb-4514-4811-9222-2f33b5427e65 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:29.480923 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-7cbe2fdb-4514-4811-9222-2f33b5427e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:29.557147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 107/218] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:29.569355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110c33-a528-43fd-983c-6897f4e4137a None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.569725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110c33-a528-43fd-983c-6897f4e4137a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.569927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110c33-a528-43fd-983c-6897f4e4137a None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.571562 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 108/219] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:29.577388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11607049-695a-41ac-8901-cbab2275cf82 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.578013 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11607049-695a-41ac-8901-cbab2275cf82 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.578144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d66a1e-b780-4324-b273-53c25524fbe5 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:29.578629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11607049-695a-41ac-8901-cbab2275cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.599498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-11607049-695a-41ac-8901-cbab2275cf82 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:29.600785 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-11607049-695a-41ac-8901-cbab2275cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:29.620711 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b38b74-eeae-4a9f-8a9a-2f413fa60766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:29.621594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b38b74-eeae-4a9f-8a9a-2f413fa60766 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.621880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b38b74-eeae-4a9f-8a9a-2f413fa60766 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.622156 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b38b74-eeae-4a9f-8a9a-2f413fa60766 None admin] PATH_INFO: `/v3/users/30d6207ad4074b6e98aa3f9ce6d385ac` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.649953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b38b74-eeae-4a9f-8a9a-2f413fa60766 None admin] RBAC: Authorizing `identity:get_user(user_id=30d6207ad4074b6e98aa3f9ce6d385ac)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:29.651717 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b38b74-eeae-4a9f-8a9a-2f413fa60766 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:29.653958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 112/220] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:29 2022] GET /identity/v3/users/30d6207ad4074b6e98aa3f9ce6d385ac => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:29.655806 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b38b74-eeae-4a9f-8a9a-2f413fa60766 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:29.685040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 109/221] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:29.685934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11607049-695a-41ac-8901-cbab2275cf82 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:29.787065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b38b74-eeae-4a9f-8a9a-2f413fa60766 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:29.830915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11607049-695a-41ac-8901-cbab2275cf82 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:29.832587 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f0fc4-0bec-4247-9d92-7d15e7da46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:29.833383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f0fc4-0bec-4247-9d92-7d15e7da46de None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.833790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f0fc4-0bec-4247-9d92-7d15e7da46de None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.834071 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f0fc4-0bec-4247-9d92-7d15e7da46de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.849093 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f0fc4-0bec-4247-9d92-7d15e7da46de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-b54f0fc4-0bec-4247-9d92-7d15e7da46de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:29.855815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:29.856854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 113/222] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:29.857801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f0fc4-0bec-4247-9d92-7d15e7da46de None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:29.879138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b211b9d-0546-4909-bf2c-82131fe51bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:29.880042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211b9d-0546-4909-bf2c-82131fe51bdd None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:29.880325 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211b9d-0546-4909-bf2c-82131fe51bdd None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:29.880597 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b211b9d-0546-4909-bf2c-82131fe51bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:29.956421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b211b9d-0546-4909-bf2c-82131fe51bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:29.957889 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b211b9d-0546-4909-bf2c-82131fe51bdd None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:29.968386 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f0fc4-0bec-4247-9d92-7d15e7da46de None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.004825 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5472f4e-de00-40a3-8e46-324af8ff6650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.005935 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472f4e-de00-40a3-8e46-324af8ff6650 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.006393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472f4e-de00-40a3-8e46-324af8ff6650 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.006828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472f4e-de00-40a3-8e46-324af8ff6650 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.018907 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5472f4e-de00-40a3-8e46-324af8ff6650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e5472f4e-de00-40a3-8e46-324af8ff6650 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:30.028111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:30.029502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:30.030625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:30.032772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 114/223] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:30.033777 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5472f4e-de00-40a3-8e46-324af8ff6650 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.086209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 110/224] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:30.088527 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b211b9d-0546-4909-bf2c-82131fe51bdd None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.176474 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5472f4e-de00-40a3-8e46-324af8ff6650 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.194022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b211b9d-0546-4909-bf2c-82131fe51bdd None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.221081 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.222991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.223604 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.224126 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.225547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:30.226360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.228023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.229908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.230577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.230859 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.231134 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.231946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:30.232253 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.233617 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.242655 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 115/225] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:30.243623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 111/226] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:30.244062 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.253454 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.356118 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323419-b0c7-4ac0-8bb0-cc7b09ae815d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.385690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334ffe2-af8a-45ba-8460-64336a12750b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.393968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1f98c-b125-4eda-8ab7-49ac8b87d09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.394890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1f98c-b125-4eda-8ab7-49ac8b87d09d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.395171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1f98c-b125-4eda-8ab7-49ac8b87d09d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.395447 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1f98c-b125-4eda-8ab7-49ac8b87d09d None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.396813 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1f98c-b125-4eda-8ab7-49ac8b87d09d None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.398213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1f98c-b125-4eda-8ab7-49ac8b87d09d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.399979 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 116/227] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:30 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:30.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1f98c-b125-4eda-8ab7-49ac8b87d09d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.431073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2794b-970d-4760-a03c-c6043ede28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.432053 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2794b-970d-4760-a03c-c6043ede28ca None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.432613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2794b-970d-4760-a03c-c6043ede28ca None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.432751 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2794b-970d-4760-a03c-c6043ede28ca None admin] PATH_INFO: `/v3/users/84ee02b39cf44773a2639ae6bc4511cb` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.433946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2794b-970d-4760-a03c-c6043ede28ca None admin] RBAC: Authorizing `identity:get_user(user_id=84ee02b39cf44773a2639ae6bc4511cb)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.435355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2794b-970d-4760-a03c-c6043ede28ca None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.442597 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 112/228] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:30 2022] GET /identity/v3/users/84ee02b39cf44773a2639ae6bc4511cb => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:30.442597 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2794b-970d-4760-a03c-c6043ede28ca None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.529973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1f98c-b125-4eda-8ab7-49ac8b87d09d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.552005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2794b-970d-4760-a03c-c6043ede28ca None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.577657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bdfa5-907d-4011-a1ab-a33db416824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.582393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bdfa5-907d-4011-a1ab-a33db416824e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.582393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bdfa5-907d-4011-a1ab-a33db416824e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.582393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bdfa5-907d-4011-a1ab-a33db416824e None admin] PATH_INFO: `/v3/users/84ee02b39cf44773a2639ae6bc4511cb` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.583721 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bdfa5-907d-4011-a1ab-a33db416824e None admin] RBAC: Authorizing `identity:get_user(user_id=84ee02b39cf44773a2639ae6bc4511cb)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.585287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bdfa5-907d-4011-a1ab-a33db416824e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.587009 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 117/229] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:30 2022] GET /identity/v3/users/84ee02b39cf44773a2639ae6bc4511cb => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:30.587600 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bdfa5-907d-4011-a1ab-a33db416824e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.598942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.599606 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.599939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.600218 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.601058 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] RBAC: Adding query filter params (role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=c4cc0a347718443997a25150c537ff79, user.id=30d6207ad4074b6e98aa3f9ce6d385ac) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:30.601371 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.602898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.610111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 113/230] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:30 2022] GET /identity/v3/role_assignments?user.id=30d6207ad4074b6e98aa3f9ce6d385ac&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:30.610720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.724933 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11ce9-f3d7-45b2-b6d7-1bb829ccb39b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.729391 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bdfa5-907d-4011-a1ab-a33db416824e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.766539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf0d0d-7a1f-4208-8f15-dd226dfafc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.767603 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf0d0d-7a1f-4208-8f15-dd226dfafc67 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.768138 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf0d0d-7a1f-4208-8f15-dd226dfafc67 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.768594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf0d0d-7a1f-4208-8f15-dd226dfafc67 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.770016 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf0d0d-7a1f-4208-8f15-dd226dfafc67 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.771473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf0d0d-7a1f-4208-8f15-dd226dfafc67 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.772463 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa78f91-0909-4126-8c6c-afe5b50a4999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.773404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 118/231] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:30 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:30.774106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa78f91-0909-4126-8c6c-afe5b50a4999 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.774600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa78f91-0909-4126-8c6c-afe5b50a4999 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.775085 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa78f91-0909-4126-8c6c-afe5b50a4999 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.776538 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa78f91-0909-4126-8c6c-afe5b50a4999 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.778258 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa78f91-0909-4126-8c6c-afe5b50a4999 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.778993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf0d0d-7a1f-4208-8f15-dd226dfafc67 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.780715 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 114/232] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:30 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:30.789824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa78f91-0909-4126-8c6c-afe5b50a4999 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:30.915748 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf0d0d-7a1f-4208-8f15-dd226dfafc67 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:30.956306 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f2dce-cbe7-46cb-b189-6a38c0bb6428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:30.956306 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2dce-cbe7-46cb-b189-6a38c0bb6428 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:30.956306 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2dce-cbe7-46cb-b189-6a38c0bb6428 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:30.956306 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2dce-cbe7-46cb-b189-6a38c0bb6428 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79/users/84ee02b39cf44773a2639ae6bc4511cb/roles/db0e2f86b328428ba0dbfe6383deffce` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:30.959200 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f2dce-cbe7-46cb-b189-6a38c0bb6428 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4cc0a347718443997a25150c537ff79, user_id=84ee02b39cf44773a2639ae6bc4511cb, role_id=db0e2f86b328428ba0dbfe6383deffce)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:30.962672 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f2dce-cbe7-46cb-b189-6a38c0bb6428 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:30.990765 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 119/233] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:30 2022] PUT /identity/v3/projects/c4cc0a347718443997a25150c537ff79/users/84ee02b39cf44773a2639ae6bc4511cb/roles/db0e2f86b328428ba0dbfe6383deffce => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:15:30.998170 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa78f91-0909-4126-8c6c-afe5b50a4999 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:31.051586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a9cb0-8006-4d26-85ba-7904af689d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:31.052546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a9cb0-8006-4d26-85ba-7904af689d11 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:31.052831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a9cb0-8006-4d26-85ba-7904af689d11 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:31.053107 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a9cb0-8006-4d26-85ba-7904af689d11 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79/users/84ee02b39cf44773a2639ae6bc4511cb/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:31.055325 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a9cb0-8006-4d26-85ba-7904af689d11 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4cc0a347718443997a25150c537ff79, user_id=84ee02b39cf44773a2639ae6bc4511cb, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:31.056870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a9cb0-8006-4d26-85ba-7904af689d11 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:31.103607 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 115/234] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:30 2022] PUT /identity/v3/projects/c4cc0a347718443997a25150c537ff79/users/84ee02b39cf44773a2639ae6bc4511cb/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:32.114466 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7515e86-3b0d-4a0e-9118-d332d3f2fb97 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:32.115029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7515e86-3b0d-4a0e-9118-d332d3f2fb97 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:32.115115 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7515e86-3b0d-4a0e-9118-d332d3f2fb97 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:32.116812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 120/235] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:32.122353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528bf8-5d9e-45b7-87b5-add51136018f None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:32.122772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528bf8-5d9e-45b7-87b5-add51136018f None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:32.122947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5528bf8-5d9e-45b7-87b5-add51136018f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:32.144875 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-d5528bf8-5d9e-45b7-87b5-add51136018f None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:32.146072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-d5528bf8-5d9e-45b7-87b5-add51136018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:32.239203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 116/236] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:32.270435 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7515e86-3b0d-4a0e-9118-d332d3f2fb97 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:32.301369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2c799-cfea-46d6-96b9-ac3299d142e9 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:32.301706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2c799-cfea-46d6-96b9-ac3299d142e9 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:32.301927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2c799-cfea-46d6-96b9-ac3299d142e9 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:32.303291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 117/237] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:32.308647 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1bd5-d82b-4920-80a9-1329a6e41759 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:32.309189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1bd5-d82b-4920-80a9-1329a6e41759 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:32.309679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1bd5-d82b-4920-80a9-1329a6e41759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:32.338005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-29fe1bd5-d82b-4920-80a9-1329a6e41759 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:32.339264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-29fe1bd5-d82b-4920-80a9-1329a6e41759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:32.447104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7515e86-3b0d-4a0e-9118-d332d3f2fb97 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:32.466740 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 118/238] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:32.492809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe1bd5-d82b-4920-80a9-1329a6e41759 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:32.497311 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2661b9-7a23-450d-8a25-727060c53097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:32.498111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2661b9-7a23-450d-8a25-727060c53097 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:32.498394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2661b9-7a23-450d-8a25-727060c53097 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:32.498671 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2661b9-7a23-450d-8a25-727060c53097 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:32.523023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2661b9-7a23-450d-8a25-727060c53097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-1e2661b9-7a23-450d-8a25-727060c53097 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:32.530710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:32.531730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:32.532772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 121/239] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:32.540138 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2661b9-7a23-450d-8a25-727060c53097 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:32.660613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe1bd5-d82b-4920-80a9-1329a6e41759 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:32.697210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17e864-3b9b-44d0-a839-633f5743529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:32.698420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17e864-3b9b-44d0-a839-633f5743529c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:32.698927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17e864-3b9b-44d0-a839-633f5743529c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:32.699414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17e864-3b9b-44d0-a839-633f5743529c None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:32.700861 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17e864-3b9b-44d0-a839-633f5743529c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:32.702557 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17e864-3b9b-44d0-a839-633f5743529c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:32.704462 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 119/240] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:32.710308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17e864-3b9b-44d0-a839-633f5743529c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:32.768237 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2661b9-7a23-450d-8a25-727060c53097 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:32.808127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:32.809689 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:32.810351 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:32.810860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:32.811893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] RBAC: Adding query filter params (name=reader) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:32.812418 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:32.814041 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:32.824862 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 122/241] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:32.831721 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:32.917968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17e864-3b9b-44d0-a839-633f5743529c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:32.947536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a6dac-22ee-4fd7-b84a-c30a3ed440be None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:32.985830 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759786e-1d97-4582-96c4-140cbd2cd3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:32.987448 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759786e-1d97-4582-96c4-140cbd2cd3db None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:32.987985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759786e-1d97-4582-96c4-140cbd2cd3db None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:32.988822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759786e-1d97-4582-96c4-140cbd2cd3db None admin] PATH_INFO: `/v3/users/e368b11d74b249b69380b3bb910b69d7` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.004090 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759786e-1d97-4582-96c4-140cbd2cd3db None admin] RBAC: Authorizing `identity:get_user(user_id=e368b11d74b249b69380b3bb910b69d7)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:33.006472 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759786e-1d97-4582-96c4-140cbd2cd3db None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:33.008928 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 123/242] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:32 2022] GET /identity/v3/users/e368b11d74b249b69380b3bb910b69d7 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:33.014759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759786e-1d97-4582-96c4-140cbd2cd3db None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:33.032561 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0b90f-df73-4eac-83af-dcf4267fd8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:33.033969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0b90f-df73-4eac-83af-dcf4267fd8c2 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.034263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0b90f-df73-4eac-83af-dcf4267fd8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.034546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0b90f-df73-4eac-83af-dcf4267fd8c2 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.035278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0b90f-df73-4eac-83af-dcf4267fd8c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:33.036790 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0b90f-df73-4eac-83af-dcf4267fd8c2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:33.107588 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 120/243] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:15:32 2022] POST /identity/v3/users => generated 293 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:15:33.118003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759786e-1d97-4582-96c4-140cbd2cd3db None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:33.157280 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b09d-f924-4223-863c-b0f1938903bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:33.158202 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b09d-f924-4223-863c-b0f1938903bd None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.159107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b09d-f924-4223-863c-b0f1938903bd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.159394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b09d-f924-4223-863c-b0f1938903bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.239965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74b09d-f924-4223-863c-b0f1938903bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:33.241881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74b09d-f924-4223-863c-b0f1938903bd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:33.350029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 124/244] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:15:33.355438 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0b90f-df73-4eac-83af-dcf4267fd8c2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:33.515552 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0b90f-df73-4eac-83af-dcf4267fd8c2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:33.551999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9fe5f-666c-426d-af4a-abc09e23f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:33.552872 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9fe5f-666c-426d-af4a-abc09e23f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.553158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9fe5f-666c-426d-af4a-abc09e23f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.553433 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9fe5f-666c-426d-af4a-abc09e23f1d4 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.554648 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9fe5f-666c-426d-af4a-abc09e23f1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:33.556215 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9fe5f-666c-426d-af4a-abc09e23f1d4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:33.564155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 121/245] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:33 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:33.565600 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b09d-f924-4223-863c-b0f1938903bd None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:33.608150 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f49c9-6eaa-4ccb-8dfb-58ec09e6a6a5 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.608770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f49c9-6eaa-4ccb-8dfb-58ec09e6a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.609257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f49c9-6eaa-4ccb-8dfb-58ec09e6a6a5 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.610833 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 122/246] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:33.620067 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b92e63-088f-4dd7-a514-b200128567f0 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.620640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b92e63-088f-4dd7-a514-b200128567f0 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.621127 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b92e63-088f-4dd7-a514-b200128567f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.642920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-58b92e63-088f-4dd7-a514-b200128567f0 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:33.644240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-58b92e63-088f-4dd7-a514-b200128567f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:33.719590 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b09d-f924-4223-863c-b0f1938903bd None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:33.724259 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 123/247] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:33.725892 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098c4c-470d-4eab-b064-a2c54cda22b1 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.726374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098c4c-470d-4eab-b064-a2c54cda22b1 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.726887 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4098c4c-470d-4eab-b064-a2c54cda22b1 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.728465 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 124/248] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:33.734037 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2e51-a35c-4820-a616-bcb701dfa3df None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.734554 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2e51-a35c-4820-a616-bcb701dfa3df None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.735035 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2e51-a35c-4820-a616-bcb701dfa3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.756121 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-9dfb2e51-a35c-4820-a616-bcb701dfa3df None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:33.757327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-9dfb2e51-a35c-4820-a616-bcb701dfa3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:33.762533 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:33.763227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.763512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.763834 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.764664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] RBAC: Adding query filter params (role.id=7588576bc19e4dd18fb26d25c2a166aa, scope.project.id=c4cc0a347718443997a25150c537ff79, user.id=e368b11d74b249b69380b3bb910b69d7) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:33.764983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:33.766486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:33.773382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 125/249] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:33 2022] GET /identity/v3/role_assignments?user.id=e368b11d74b249b69380b3bb910b69d7&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=7588576bc19e4dd18fb26d25c2a166aa => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:33.774199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:33.848995 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 125/250] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:33.874183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2e51-a35c-4820-a616-bcb701dfa3df None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:33.918848 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65acf3-f0d0-4ee9-b8a2-c54239d75a71 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:33.976453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d222-7d05-432c-934c-d509141856da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:33.977267 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d222-7d05-432c-934c-d509141856da None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:33.977551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d222-7d05-432c-934c-d509141856da None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:33.977828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850d222-7d05-432c-934c-d509141856da None admin] PATH_INFO: `/v3/roles/member` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:33.995258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850d222-7d05-432c-934c-d509141856da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-2850d222-7d05-432c-934c-d509141856da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:34.006658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:34.008076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:34.009397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 126/251] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:34.013369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2e51-a35c-4820-a616-bcb701dfa3df None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:34.015610 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d222-7d05-432c-934c-d509141856da None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:34.055414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfa27a-7275-4bdd-abce-284c77ac10e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:34.056811 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa27a-7275-4bdd-abce-284c77ac10e3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.057324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa27a-7275-4bdd-abce-284c77ac10e3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.057739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa27a-7275-4bdd-abce-284c77ac10e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.073096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfa27a-7275-4bdd-abce-284c77ac10e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-41dfa27a-7275-4bdd-abce-284c77ac10e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:34.084152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:34.086459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:34.087708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 126/252] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:34.091745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfa27a-7275-4bdd-abce-284c77ac10e3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:34.152889 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850d222-7d05-432c-934c-d509141856da None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:34.196916 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:34.197998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.198285 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.198718 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.199619 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] RBAC: Adding query filter params (name=member) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:34.199958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:34.201835 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:34.213246 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 127/253] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:34.219590 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfa27a-7275-4bdd-abce-284c77ac10e3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:34.219878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:34.264109 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:34.264840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.265132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.265414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.266178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:34.266487 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:34.268897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:34.277984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 127/254] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:34.284503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:34.333612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c602042-2e08-4028-ae0d-051203a794cc None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:34.369423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4197ea3-f2bb-46e1-94b7-8b68fc1d143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:34.370396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197ea3-f2bb-46e1-94b7-8b68fc1d143d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.370754 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197ea3-f2bb-46e1-94b7-8b68fc1d143d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.371105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4197ea3-f2bb-46e1-94b7-8b68fc1d143d None admin] PATH_INFO: `/v3/users/30d6207ad4074b6e98aa3f9ce6d385ac` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.372500 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4197ea3-f2bb-46e1-94b7-8b68fc1d143d None admin] RBAC: Authorizing `identity:get_user(user_id=30d6207ad4074b6e98aa3f9ce6d385ac)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:34.374028 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4197ea3-f2bb-46e1-94b7-8b68fc1d143d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:34.376113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 128/255] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:34 2022] GET /identity/v3/users/30d6207ad4074b6e98aa3f9ce6d385ac => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:34.378006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08543-fa38-456d-b808-3f3291673f10 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.378371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08543-fa38-456d-b808-3f3291673f10 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.378724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08543-fa38-456d-b808-3f3291673f10 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.380088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 129/256] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:34.385578 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef99d4-3be9-4df2-9bb6-cee3f873761d None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.385946 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef99d4-3be9-4df2-9bb6-cee3f873761d None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.386299 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef99d4-3be9-4df2-9bb6-cee3f873761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.397805 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194d29-8ba3-4bde-8f1f-82ddef876cd9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:34.404654 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-f6ef99d4-3be9-4df2-9bb6-cee3f873761d None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:34.405996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-f6ef99d4-3be9-4df2-9bb6-cee3f873761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:34.433764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84539546-6056-449d-9469-03808c99d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:34.434650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539546-6056-449d-9469-03808c99d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.434979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539546-6056-449d-9469-03808c99d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.435264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539546-6056-449d-9469-03808c99d9f1 None admin] PATH_INFO: `/v3/users/84ee02b39cf44773a2639ae6bc4511cb` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.436540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84539546-6056-449d-9469-03808c99d9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=84ee02b39cf44773a2639ae6bc4511cb)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:34.438064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84539546-6056-449d-9469-03808c99d9f1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:34.440880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 128/257] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:34 2022] GET /identity/v3/users/84ee02b39cf44773a2639ae6bc4511cb => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:34.441357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84539546-6056-449d-9469-03808c99d9f1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:34.491485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 130/258] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:34.492407 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef99d4-3be9-4df2-9bb6-cee3f873761d None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:34.628018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84539546-6056-449d-9469-03808c99d9f1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:34.677745 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef99d4-3be9-4df2-9bb6-cee3f873761d None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:34.717115 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d0873-ae0a-4d60-85ff-a398e8272f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:34.717776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d0873-ae0a-4d60-85ff-a398e8272f25 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.718056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d0873-ae0a-4d60-85ff-a398e8272f25 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.718330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d0873-ae0a-4d60-85ff-a398e8272f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.734283 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b78df9-09dc-4742-9abc-72a13574e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:34.735149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78df9-09dc-4742-9abc-72a13574e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:34.735428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78df9-09dc-4742-9abc-72a13574e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:34.735699 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78df9-09dc-4742-9abc-72a13574e3b7 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:34.739343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b78df9-09dc-4742-9abc-72a13574e3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:34.740867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b78df9-09dc-4742-9abc-72a13574e3b7 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:34.742597 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 129/259] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:34 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:34.745790 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b78df9-09dc-4742-9abc-72a13574e3b7 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:34.810589 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d0873-ae0a-4d60-85ff-a398e8272f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:34.812218 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d0873-ae0a-4d60-85ff-a398e8272f25 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:34.921842 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 131/260] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:34.922605 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d0873-ae0a-4d60-85ff-a398e8272f25 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:34.961952 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b78df9-09dc-4742-9abc-72a13574e3b7 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:35.035033 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d0873-ae0a-4d60-85ff-a398e8272f25 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:35.056589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34f5f-1e86-4378-94cb-bdaee8d6b1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:35.057415 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34f5f-1e86-4378-94cb-bdaee8d6b1e4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:35.057712 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34f5f-1e86-4378-94cb-bdaee8d6b1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:35.057994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc34f5f-1e86-4378-94cb-bdaee8d6b1e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:35.077529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc34f5f-1e86-4378-94cb-bdaee8d6b1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:35.081868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896a686-56e7-4984-b565-6c650ebc5f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:35.082750 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896a686-56e7-4984-b565-6c650ebc5f34 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:35.083029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896a686-56e7-4984-b565-6c650ebc5f34 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:35.083302 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896a686-56e7-4984-b565-6c650ebc5f34 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79/users/30d6207ad4074b6e98aa3f9ce6d385ac/roles/d93601b75fd74dcf89b2cee3d7541f90` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:35.086492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896a686-56e7-4984-b565-6c650ebc5f34 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4cc0a347718443997a25150c537ff79, user_id=30d6207ad4074b6e98aa3f9ce6d385ac, role_id=d93601b75fd74dcf89b2cee3d7541f90)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:35.087954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896a686-56e7-4984-b565-6c650ebc5f34 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-9bc34f5f-1e86-4378-94cb-bdaee8d6b1e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:35.094784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:35.096391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 130/261] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:35.097304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34f5f-1e86-4378-94cb-bdaee8d6b1e4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:35.121564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 132/262] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:34 2022] PUT /identity/v3/projects/c4cc0a347718443997a25150c537ff79/users/30d6207ad4074b6e98aa3f9ce6d385ac/roles/d93601b75fd74dcf89b2cee3d7541f90 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:35.124200 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896a686-56e7-4984-b565-6c650ebc5f34 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:35.254422 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896a686-56e7-4984-b565-6c650ebc5f34 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:35.274249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc34f5f-1e86-4378-94cb-bdaee8d6b1e4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:35.304494 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:35.306789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:35.308194 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:35.308700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:35.310401 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:35.312291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:35.313865 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:35.328000 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dbe0b-c032-4b50-bc40-e47ba1138659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:35.329136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dbe0b-c032-4b50-bc40-e47ba1138659 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:35.329578 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dbe0b-c032-4b50-bc40-e47ba1138659 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:35.330807 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dbe0b-c032-4b50-bc40-e47ba1138659 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:35.332868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dbe0b-c032-4b50-bc40-e47ba1138659 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:35.334542 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dbe0b-c032-4b50-bc40-e47ba1138659 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:35.335243 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 133/263] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:35.337522 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 131/264] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:35 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:35.345159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:35.347180 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dbe0b-c032-4b50-bc40-e47ba1138659 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:35.508791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dbe0b-c032-4b50-bc40-e47ba1138659 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:35.544917 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:35.545964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:35.546411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:35.546859 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:35.547934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] RBAC: Adding query filter params (role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=c4cc0a347718443997a25150c537ff79, user.id=84ee02b39cf44773a2639ae6bc4511cb) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:35.548518 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:35.551196 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:35.558338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 132/265] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:35 2022] GET /identity/v3/role_assignments?user.id=84ee02b39cf44773a2639ae6bc4511cb&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:35.566781 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56d5f4-538c-49bf-b835-59306d7bea30 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:35.609365 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b9a1-81ca-4fce-bdce-0c44d941a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:35.610270 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b9a1-81ca-4fce-bdce-0c44d941a6da None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:35.610560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b9a1-81ca-4fce-bdce-0c44d941a6da None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:35.610873 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494b9a1-81ca-4fce-bdce-0c44d941a6da None admin] PATH_INFO: `/v3/users/84ee02b39cf44773a2639ae6bc4511cb` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:35.612789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b9a1-81ca-4fce-bdce-0c44d941a6da None admin] RBAC: Authorizing `identity:get_user(user_id=84ee02b39cf44773a2639ae6bc4511cb)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:35.614387 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494b9a1-81ca-4fce-bdce-0c44d941a6da None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:35.616600 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 134/266] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:35 2022] GET /identity/v3/users/84ee02b39cf44773a2639ae6bc4511cb => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:35.622060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:35.780428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008d659-3628-49a4-9334-4590abae09ac None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:35.818627 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8380962-a33a-4b0e-b81d-d8e922eb6416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:35.819293 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8380962-a33a-4b0e-b81d-d8e922eb6416 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:35.819581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8380962-a33a-4b0e-b81d-d8e922eb6416 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:35.819894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8380962-a33a-4b0e-b81d-d8e922eb6416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:35.893811 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8380962-a33a-4b0e-b81d-d8e922eb6416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:35.895363 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8380962-a33a-4b0e-b81d-d8e922eb6416 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:35.998101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 133/267] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:36.004698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b9a1-81ca-4fce-bdce-0c44d941a6da None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:36.115292 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494b9a1-81ca-4fce-bdce-0c44d941a6da None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:36.155417 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028389c-b7f3-4860-85e0-c5efa888547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:36.156322 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028389c-b7f3-4860-85e0-c5efa888547a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:36.156611 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028389c-b7f3-4860-85e0-c5efa888547a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:36.156878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028389c-b7f3-4860-85e0-c5efa888547a None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:36.158207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028389c-b7f3-4860-85e0-c5efa888547a None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:36.159797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028389c-b7f3-4860-85e0-c5efa888547a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:36.161899 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 135/268] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:36 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:36.167538 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8380962-a33a-4b0e-b81d-d8e922eb6416 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:36.291347 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8380962-a33a-4b0e-b81d-d8e922eb6416 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:36.338179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9b55-179d-4006-bcc2-d3e39032cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:36.338852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b55-179d-4006-bcc2-d3e39032cb21 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:36.339138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b55-179d-4006-bcc2-d3e39032cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:36.339419 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b55-179d-4006-bcc2-d3e39032cb21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:36.340305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b9b55-179d-4006-bcc2-d3e39032cb21 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=c4cc0a347718443997a25150c537ff79, user.id=84ee02b39cf44773a2639ae6bc4511cb) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:36.340624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b9b55-179d-4006-bcc2-d3e39032cb21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:36.342084 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b9b55-179d-4006-bcc2-d3e39032cb21 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:36.348992 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 134/269] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:36 2022] GET /identity/v3/role_assignments?user.id=84ee02b39cf44773a2639ae6bc4511cb&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:36.577584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0139-499e-4a19-9a75-8eb8028b8eb9 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:36.578214 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0139-499e-4a19-9a75-8eb8028b8eb9 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:36.578214 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee0139-499e-4a19-9a75-8eb8028b8eb9 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:36.582059 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 136/270] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:36.586384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f711cf-de5d-4151-821d-72d3019486c2 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:36.586877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f711cf-de5d-4151-821d-72d3019486c2 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:36.587069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f711cf-de5d-4151-821d-72d3019486c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:36.613374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-39f711cf-de5d-4151-821d-72d3019486c2 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:36.614572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-39f711cf-de5d-4151-821d-72d3019486c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:36.717555 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 135/271] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:36.754108 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee0139-499e-4a19-9a75-8eb8028b8eb9 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:36.873040 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee0139-499e-4a19-9a75-8eb8028b8eb9 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:36.913953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad6888-c278-415b-ba88-7c7c5950df71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:36.914771 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6888-c278-415b-ba88-7c7c5950df71 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:36.915057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6888-c278-415b-ba88-7c7c5950df71 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:36.915335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6888-c278-415b-ba88-7c7c5950df71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:36.928247 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad6888-c278-415b-ba88-7c7c5950df71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-a7ad6888-c278-415b-ba88-7c7c5950df71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:36.936169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:36.937177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:36.938076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 137/272] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:36.944005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f711cf-de5d-4151-821d-72d3019486c2 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:36.977627 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f666-15a2-44b4-9a6a-4ea99b5c383e None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:36.978283 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f666-15a2-44b4-9a6a-4ea99b5c383e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:36.978786 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f666-15a2-44b4-9a6a-4ea99b5c383e None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:36.980767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 138/273] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:36.987346 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68fab9-894f-4e9f-92c2-d1925d9a1312 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:36.987639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68fab9-894f-4e9f-92c2-d1925d9a1312 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:36.987941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68fab9-894f-4e9f-92c2-d1925d9a1312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.011138 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-da68fab9-894f-4e9f-92c2-d1925d9a1312 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:37.012382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-da68fab9-894f-4e9f-92c2-d1925d9a1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:37.080303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f711cf-de5d-4151-821d-72d3019486c2 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.107878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 139/274] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:37.109198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36efa8b-71b8-4bec-964e-34dcfd14307d None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.109491 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36efa8b-71b8-4bec-964e-34dcfd14307d None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.109772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36efa8b-71b8-4bec-964e-34dcfd14307d None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.112157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 140/275] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:37.118349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6323b-a75c-4f05-a48d-53f51d9deab3 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.118635 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6323b-a75c-4f05-a48d-53f51d9deab3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.118910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6323b-a75c-4f05-a48d-53f51d9deab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.125628 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.127216 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.127756 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.128277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.129253 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:37.129908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:37.131496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:37.137702 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-61d6323b-a75c-4f05-a48d-53f51d9deab3 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:37.138881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-61d6323b-a75c-4f05-a48d-53f51d9deab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:37.140191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 136/276] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:37.140816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:37.209984 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 141/277] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:37.210814 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6323b-a75c-4f05-a48d-53f51d9deab3 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:37.254533 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7a27d-825b-47da-80b0-84c5784d3132 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.288488 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a1fff-f4f9-4da9-8c6e-676d941ac4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.289295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1fff-f4f9-4da9-8c6e-676d941ac4c0 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.289580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1fff-f4f9-4da9-8c6e-676d941ac4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.289856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1fff-f4f9-4da9-8c6e-676d941ac4c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.301913 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a1fff-f4f9-4da9-8c6e-676d941ac4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-ec7a1fff-f4f9-4da9-8c6e-676d941ac4c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:37.309645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:37.310828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 137/278] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:37.311730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a1fff-f4f9-4da9-8c6e-676d941ac4c0 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:37.318532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6323b-a75c-4f05-a48d-53f51d9deab3 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.354585 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc511-3773-434f-864c-7c8b7a14fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.355889 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc511-3773-434f-864c-7c8b7a14fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.356176 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc511-3773-434f-864c-7c8b7a14fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.356452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddc511-3773-434f-864c-7c8b7a14fbe0 None admin] PATH_INFO: `/v3/users/eb8dbdf1ff2446c9b7fe8e40fe06251f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.373761 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddc511-3773-434f-864c-7c8b7a14fbe0 None admin] RBAC: Authorizing `identity:get_user(user_id=eb8dbdf1ff2446c9b7fe8e40fe06251f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:37.375229 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddc511-3773-434f-864c-7c8b7a14fbe0 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:37.377995 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 142/279] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:37 2022] GET /identity/v3/users/eb8dbdf1ff2446c9b7fe8e40fe06251f => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:37.378694 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc511-3773-434f-864c-7c8b7a14fbe0 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:37.417010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a1fff-f4f9-4da9-8c6e-676d941ac4c0 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.451935 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726c30-18a6-4233-8dbd-7e63e92acd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.452740 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726c30-18a6-4233-8dbd-7e63e92acd6a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.453026 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726c30-18a6-4233-8dbd-7e63e92acd6a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.453306 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726c30-18a6-4233-8dbd-7e63e92acd6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.454494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8726c30-18a6-4233-8dbd-7e63e92acd6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:37.456594 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8726c30-18a6-4233-8dbd-7e63e92acd6a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:37.462791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 138/280] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:37.462791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726c30-18a6-4233-8dbd-7e63e92acd6a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:37.485250 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddc511-3773-434f-864c-7c8b7a14fbe0 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.523112 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.524064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.524352 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.524633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.525386 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:37.525697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:37.527071 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:37.535637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 143/281] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:37.535637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:37.572920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726c30-18a6-4233-8dbd-7e63e92acd6a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.609304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.609976 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.610262 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.610522 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.611402 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] RBAC: Adding query filter params (role.id=d93601b75fd74dcf89b2cee3d7541f90, user.id=eb8dbdf1ff2446c9b7fe8e40fe06251f, scope.system=all) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:37.611716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:37.613190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:37.618409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 139/282] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:15:37 2022] GET /identity/v3/role_assignments?user.id=eb8dbdf1ff2446c9b7fe8e40fe06251f&scope.system=all&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:37.621488 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:37.650957 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81d22c-91c7-4eda-b677-6a3f33c58448 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.689638 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468689f-59e4-48a1-9e4c-b4b85f62d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.690878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468689f-59e4-48a1-9e4c-b4b85f62d941 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.691238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468689f-59e4-48a1-9e4c-b4b85f62d941 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.691576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468689f-59e4-48a1-9e4c-b4b85f62d941 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.692444 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468689f-59e4-48a1-9e4c-b4b85f62d941 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:37.694018 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468689f-59e4-48a1-9e4c-b4b85f62d941 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:37.720439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 144/283] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:15:37 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:37.739820 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d5ce-c924-43a6-b2cb-e083e26e0d9d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.781114 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679df8-dfc3-4844-892b-5b0c76689fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.782491 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679df8-dfc3-4844-892b-5b0c76689fec None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.783564 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679df8-dfc3-4844-892b-5b0c76689fec None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.784154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679df8-dfc3-4844-892b-5b0c76689fec None admin] PATH_INFO: `/v3/users/e368b11d74b249b69380b3bb910b69d7` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.785808 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679df8-dfc3-4844-892b-5b0c76689fec None admin] RBAC: Authorizing `identity:get_user(user_id=e368b11d74b249b69380b3bb910b69d7)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:37.787615 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679df8-dfc3-4844-892b-5b0c76689fec None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:37.789780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 140/284] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:37 2022] GET /identity/v3/users/e368b11d74b249b69380b3bb910b69d7 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:37.797376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468689f-59e4-48a1-9e4c-b4b85f62d941 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:37.920774 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468689f-59e4-48a1-9e4c-b4b85f62d941 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:37.961533 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeba92-e78e-48c5-85fb-13d062cfc080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:37.962423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeba92-e78e-48c5-85fb-13d062cfc080 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:37.962708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeba92-e78e-48c5-85fb-13d062cfc080 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:37.962984 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeba92-e78e-48c5-85fb-13d062cfc080 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:37.964306 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeba92-e78e-48c5-85fb-13d062cfc080 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:37.965809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeba92-e78e-48c5-85fb-13d062cfc080 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:37.967992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 145/285] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:37 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:37.974043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679df8-dfc3-4844-892b-5b0c76689fec None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:38.086842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679df8-dfc3-4844-892b-5b0c76689fec None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:38.124527 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5839a6-0b1f-498b-b704-40732671f247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:38.125424 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5839a6-0b1f-498b-b704-40732671f247 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:38.125702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5839a6-0b1f-498b-b704-40732671f247 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:38.125975 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5839a6-0b1f-498b-b704-40732671f247 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79/users/e368b11d74b249b69380b3bb910b69d7/roles/7588576bc19e4dd18fb26d25c2a166aa` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:38.128950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5839a6-0b1f-498b-b704-40732671f247 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4cc0a347718443997a25150c537ff79, user_id=e368b11d74b249b69380b3bb910b69d7, role_id=7588576bc19e4dd18fb26d25c2a166aa)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:38.130413 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5839a6-0b1f-498b-b704-40732671f247 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:38.146593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9dcf1-969b-475a-bc9e-9eac96e8ae2f None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:38.146793 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 141/286] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:15:37 2022] PUT /identity/v3/projects/c4cc0a347718443997a25150c537ff79/users/e368b11d74b249b69380b3bb910b69d7/roles/7588576bc19e4dd18fb26d25c2a166aa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:15:38.147341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9dcf1-969b-475a-bc9e-9eac96e8ae2f None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:38.147852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9dcf1-969b-475a-bc9e-9eac96e8ae2f None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:38.149442 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 146/287] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:38.156084 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49db8a-312b-4873-8b41-3bad86de2cdb None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:38.156406 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49db8a-312b-4873-8b41-3bad86de2cdb None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:38.156693 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49db8a-312b-4873-8b41-3bad86de2cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:38.177024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ad49db8a-312b-4873-8b41-3bad86de2cdb None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:38.178177 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ad49db8a-312b-4873-8b41-3bad86de2cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:38.257901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 142/288] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:38.283383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9dcf1-969b-475a-bc9e-9eac96e8ae2f None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:38.399456 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9dcf1-969b-475a-bc9e-9eac96e8ae2f None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:38.435383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f354c8-0111-4287-a852-4218fdb7f9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:38.436556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f354c8-0111-4287-a852-4218fdb7f9fc None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:38.437065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f354c8-0111-4287-a852-4218fdb7f9fc None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:38.437620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f354c8-0111-4287-a852-4218fdb7f9fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:38.449105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f354c8-0111-4287-a852-4218fdb7f9fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-74f354c8-0111-4287-a852-4218fdb7f9fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:38.457663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:38.458664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:38.459549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:38.462368 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 147/289] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:38.468388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49db8a-312b-4873-8b41-3bad86de2cdb None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:38.571826 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49db8a-312b-4873-8b41-3bad86de2cdb None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:38.607487 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:38.608191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:38.608471 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:38.608742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:38.609492 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:38.610025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:38.611730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:38.620142 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 143/290] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:38.625796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f354c8-0111-4287-a852-4218fdb7f9fc None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:38.735980 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f354c8-0111-4287-a852-4218fdb7f9fc None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:38.769169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078667-5118-47dd-b7ed-2c23c3e4eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:38.770035 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078667-5118-47dd-b7ed-2c23c3e4eb38 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:38.770314 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078667-5118-47dd-b7ed-2c23c3e4eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:38.770650 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078667-5118-47dd-b7ed-2c23c3e4eb38 None admin] PATH_INFO: `/v3/users/30d6207ad4074b6e98aa3f9ce6d385ac` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:38.771939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078667-5118-47dd-b7ed-2c23c3e4eb38 None admin] RBAC: Authorizing `identity:get_user(user_id=30d6207ad4074b6e98aa3f9ce6d385ac)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:38.773421 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078667-5118-47dd-b7ed-2c23c3e4eb38 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:38.775414 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 148/291] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:38 2022] GET /identity/v3/users/30d6207ad4074b6e98aa3f9ce6d385ac => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:38.781117 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:38.885554 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554171-8128-4b69-be61-c6c033d512c1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:38.920750 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1369686-fe85-498c-b4d0-d6f1462494ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:38.921476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1369686-fe85-498c-b4d0-d6f1462494ef None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:38.921757 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1369686-fe85-498c-b4d0-d6f1462494ef None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:38.922079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1369686-fe85-498c-b4d0-d6f1462494ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:38.993552 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1369686-fe85-498c-b4d0-d6f1462494ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:38.994957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1369686-fe85-498c-b4d0-d6f1462494ef None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:39.094882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 144/292] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:39.101335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078667-5118-47dd-b7ed-2c23c3e4eb38 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:39.213906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078667-5118-47dd-b7ed-2c23c3e4eb38 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:39.254972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8ae74-8d4f-4bac-8903-3ec48dc77402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:39.255745 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8ae74-8d4f-4bac-8903-3ec48dc77402 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:39.256050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8ae74-8d4f-4bac-8903-3ec48dc77402 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:39.256324 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8ae74-8d4f-4bac-8903-3ec48dc77402 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:39.257507 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8ae74-8d4f-4bac-8903-3ec48dc77402 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:39.258934 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8ae74-8d4f-4bac-8903-3ec48dc77402 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:39.260964 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 149/293] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:39 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:39.266662 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1369686-fe85-498c-b4d0-d6f1462494ef None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:39.373584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1369686-fe85-498c-b4d0-d6f1462494ef None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:39.406887 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b2b6c-0748-4d05-aacb-50d5cccdc8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:39.407540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2b6c-0748-4d05-aacb-50d5cccdc8ed None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:39.408027 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2b6c-0748-4d05-aacb-50d5cccdc8ed None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:39.408278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2b6c-0748-4d05-aacb-50d5cccdc8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:39.409110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b2b6c-0748-4d05-aacb-50d5cccdc8ed None admin] RBAC: Adding query filter params (role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=c4cc0a347718443997a25150c537ff79, user.id=30d6207ad4074b6e98aa3f9ce6d385ac) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:39.409421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b2b6c-0748-4d05-aacb-50d5cccdc8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:39.410836 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b2b6c-0748-4d05-aacb-50d5cccdc8ed None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:39.416947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 145/294] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:39 2022] GET /identity/v3/role_assignments?user.id=30d6207ad4074b6e98aa3f9ce6d385ac&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:40.264524 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cf267-a2c0-475f-947a-eed133658968 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.265062 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cf267-a2c0-475f-947a-eed133658968 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.265062 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cf267-a2c0-475f-947a-eed133658968 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.266452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 150/295] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:40.272700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7651f67-b3d6-49aa-9663-5a1405e69593 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.273332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7651f67-b3d6-49aa-9663-5a1405e69593 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.273332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7651f67-b3d6-49aa-9663-5a1405e69593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.290941 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-b7651f67-b3d6-49aa-9663-5a1405e69593 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:40.294515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-b7651f67-b3d6-49aa-9663-5a1405e69593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:40.365765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 146/296] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:40.388453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cf267-a2c0-475f-947a-eed133658968 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:40.495399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cf267-a2c0-475f-947a-eed133658968 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:40.530433 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a449ceb-478a-4691-a877-8591597c59bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:40.531152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a449ceb-478a-4691-a877-8591597c59bc None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.531439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a449ceb-478a-4691-a877-8591597c59bc None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.531716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a449ceb-478a-4691-a877-8591597c59bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.543110 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a449ceb-478a-4691-a877-8591597c59bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-3a449ceb-478a-4691-a877-8591597c59bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:40.551940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:40.554342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:40.556521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 151/297] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:40.563791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7651f67-b3d6-49aa-9663-5a1405e69593 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:40.664040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7651f67-b3d6-49aa-9663-5a1405e69593 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:40.708922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25faf845-8384-4b09-8b4c-5fcf9d992b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:40.709620 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf845-8384-4b09-8b4c-5fcf9d992b00 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.709901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf845-8384-4b09-8b4c-5fcf9d992b00 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.710177 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25faf845-8384-4b09-8b4c-5fcf9d992b00 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.710958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faf845-8384-4b09-8b4c-5fcf9d992b00 None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:40.711264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faf845-8384-4b09-8b4c-5fcf9d992b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:40.712716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25faf845-8384-4b09-8b4c-5fcf9d992b00 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:40.722713 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 147/298] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:40.728416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a449ceb-478a-4691-a877-8591597c59bc None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:40.788626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec888a-a9a2-4311-a44f-05f33f20996d None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.788956 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec888a-a9a2-4311-a44f-05f33f20996d None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.789160 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec888a-a9a2-4311-a44f-05f33f20996d None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.790657 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 148/299] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:40.795799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b3d6a-97a8-4707-88da-ce614d304342 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.796092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b3d6a-97a8-4707-88da-ce614d304342 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.796369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b3d6a-97a8-4707-88da-ce614d304342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.813467 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-501b3d6a-97a8-4707-88da-ce614d304342 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:40.815172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-501b3d6a-97a8-4707-88da-ce614d304342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:40.835158 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a449ceb-478a-4691-a877-8591597c59bc None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:40.870271 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922c896-3b7a-4f73-8139-f5159fee4248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:40.871142 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922c896-3b7a-4f73-8139-f5159fee4248 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.871427 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922c896-3b7a-4f73-8139-f5159fee4248 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.871703 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922c896-3b7a-4f73-8139-f5159fee4248 None admin] PATH_INFO: `/v3/users/eb8dbdf1ff2446c9b7fe8e40fe06251f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.872943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922c896-3b7a-4f73-8139-f5159fee4248 None admin] RBAC: Authorizing `identity:get_user(user_id=eb8dbdf1ff2446c9b7fe8e40fe06251f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:40.874382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922c896-3b7a-4f73-8139-f5159fee4248 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:40.881526 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 152/300] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:40 2022] GET /identity/v3/users/eb8dbdf1ff2446c9b7fe8e40fe06251f => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:40.882727 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348d93f-43ed-4977-b967-e3c9c3e1b078 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.883017 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348d93f-43ed-4977-b967-e3c9c3e1b078 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.883365 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348d93f-43ed-4977-b967-e3c9c3e1b078 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.884721 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 153/301] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:40.888943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348d93f-43ed-4977-b967-e3c9c3e1b078 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:40.889153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 149/302] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:40.893947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a35b63-e55f-41d7-b552-e357be8595e6 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.894257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a35b63-e55f-41d7-b552-e357be8595e6 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.896235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a35b63-e55f-41d7-b552-e357be8595e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.910979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-54a35b63-e55f-41d7-b552-e357be8595e6 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:40.912198 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-54a35b63-e55f-41d7-b552-e357be8595e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:40.977558 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 150/303] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:40.978945 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2bcc-e7a9-4eb9-a286-da209038e15f None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:40.979240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2bcc-e7a9-4eb9-a286-da209038e15f None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:40.979518 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb2bcc-e7a9-4eb9-a286-da209038e15f None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:40.980978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 151/304] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:40.986377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2bcc-e7a9-4eb9-a286-da209038e15f None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:40.991088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348d93f-43ed-4977-b967-e3c9c3e1b078 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.024901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44070921-63b2-457d-8b4d-7d9d65db7c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.025761 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44070921-63b2-457d-8b4d-7d9d65db7c0a None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.026047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44070921-63b2-457d-8b4d-7d9d65db7c0a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.026326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44070921-63b2-457d-8b4d-7d9d65db7c0a None admin] PATH_INFO: `/v3/system/users/eb8dbdf1ff2446c9b7fe8e40fe06251f/roles/d93601b75fd74dcf89b2cee3d7541f90` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.027841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44070921-63b2-457d-8b4d-7d9d65db7c0a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eb8dbdf1ff2446c9b7fe8e40fe06251f, role_id=d93601b75fd74dcf89b2cee3d7541f90)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:41.029212 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44070921-63b2-457d-8b4d-7d9d65db7c0a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:41.038463 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 154/305] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 9 15:15:40 2022] PUT /identity/v3/system/users/eb8dbdf1ff2446c9b7fe8e40fe06251f/roles/d93601b75fd74dcf89b2cee3d7541f90 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:41.039781 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c1b5-3fdc-4afe-bca2-306db49f19c0 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.040029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c1b5-3fdc-4afe-bca2-306db49f19c0 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.040309 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05c1b5-3fdc-4afe-bca2-306db49f19c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.057880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-fb05c1b5-3fdc-4afe-bca2-306db49f19c0 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:41.059141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-fb05c1b5-3fdc-4afe-bca2-306db49f19c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:41.092951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb2bcc-e7a9-4eb9-a286-da209038e15f None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.134112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce473c-86df-430e-9223-2f46dce0d5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.140007 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 155/306] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:41.140159 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce473c-86df-430e-9223-2f46dce0d5a8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.140159 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce473c-86df-430e-9223-2f46dce0d5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.140159 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce473c-86df-430e-9223-2f46dce0d5a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.140423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05c1b5-3fdc-4afe-bca2-306db49f19c0 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.148174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce473c-86df-430e-9223-2f46dce0d5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-23ce473c-86df-430e-9223-2f46dce0d5a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:41.156350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:41.157469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 152/307] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:41.164174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce473c-86df-430e-9223-2f46dce0d5a8 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.255698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05c1b5-3fdc-4afe-bca2-306db49f19c0 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.266563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce473c-86df-430e-9223-2f46dce0d5a8 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.290386 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563f12-da30-44f8-8e0e-171858dff283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.291898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563f12-da30-44f8-8e0e-171858dff283 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.292394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563f12-da30-44f8-8e0e-171858dff283 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.292874 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca563f12-da30-44f8-8e0e-171858dff283 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.299276 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41ddfa-8f01-414c-8109-eb2daac37db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.300111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ddfa-8f01-414c-8109-eb2daac37db7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.300393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ddfa-8f01-414c-8109-eb2daac37db7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.300667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41ddfa-8f01-414c-8109-eb2daac37db7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.301831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41ddfa-8f01-414c-8109-eb2daac37db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:41.303275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41ddfa-8f01-414c-8109-eb2daac37db7 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:41.304920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 153/308] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:41.305454 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca563f12-da30-44f8-8e0e-171858dff283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:41.308647 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41ddfa-8f01-414c-8109-eb2daac37db7 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-ca563f12-da30-44f8-8e0e-171858dff283 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:41.313649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:41.315499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:41.316419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:41.318358 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 156/309] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:41.318903 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563f12-da30-44f8-8e0e-171858dff283 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.407519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41ddfa-8f01-414c-8109-eb2daac37db7 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.418483 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca563f12-da30-44f8-8e0e-171858dff283 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.463788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.464124 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10539035-7dec-4036-9397-0004fb1334e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.464305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.464460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10539035-7dec-4036-9397-0004fb1334e3 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.464460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10539035-7dec-4036-9397-0004fb1334e3 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.464737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.464901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10539035-7dec-4036-9397-0004fb1334e3 None admin] PATH_INFO: `/v3/groups` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.465051 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.465199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10539035-7dec-4036-9397-0004fb1334e3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:41.465348 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:41.465348 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:41.465662 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10539035-7dec-4036-9397-0004fb1334e3 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:41.465812 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:41.481622 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 154/310] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:41.481622 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.486209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 157/311] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 9 15:15:41 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:41.487227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10539035-7dec-4036-9397-0004fb1334e3 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.605195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73122cb-f448-4f7c-a026-7f2d98853523 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.606321 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10539035-7dec-4036-9397-0004fb1334e3 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.643338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.644315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7dfef-848d-4872-80c6-7ec3574e055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.644812 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.645195 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7dfef-848d-4872-80c6-7ec3574e055e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.645482 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7dfef-848d-4872-80c6-7ec3574e055e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.645760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7dfef-848d-4872-80c6-7ec3574e055e None admin] PATH_INFO: `/v3/users/e368b11d74b249b69380b3bb910b69d7` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.646031 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.646514 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.647067 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7dfef-848d-4872-80c6-7ec3574e055e None admin] RBAC: Authorizing `identity:get_user(user_id=e368b11d74b249b69380b3bb910b69d7)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:41.647713 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:41.648259 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:41.648581 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7dfef-848d-4872-80c6-7ec3574e055e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:41.650125 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:41.650727 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 158/312] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:41 2022] GET /identity/v3/users/e368b11d74b249b69380b3bb910b69d7 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:41.656604 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7dfef-848d-4872-80c6-7ec3574e055e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.660699 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 155/313] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:41.665946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.769057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7dfef-848d-4872-80c6-7ec3574e055e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.787130 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6684c-a607-4e29-9b89-d0112be55902 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:41.809973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c74c9-afcb-447f-8c60-3af2b5a31451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.810634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c74c9-afcb-447f-8c60-3af2b5a31451 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.810922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c74c9-afcb-447f-8c60-3af2b5a31451 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.811200 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c74c9-afcb-447f-8c60-3af2b5a31451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.828941 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169fbb9-e2d8-4c09-9d4e-7c51e977283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:41.830605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fbb9-e2d8-4c09-9d4e-7c51e977283b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:41.830893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fbb9-e2d8-4c09-9d4e-7c51e977283b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:41.831172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fbb9-e2d8-4c09-9d4e-7c51e977283b None admin] PATH_INFO: `/v3/users/8047c994d2504aed8a63ef2f648b2248` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:41.850489 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169fbb9-e2d8-4c09-9d4e-7c51e977283b None admin] RBAC: Authorizing `identity:get_user(user_id=8047c994d2504aed8a63ef2f648b2248)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:41.851920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169fbb9-e2d8-4c09-9d4e-7c51e977283b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:41.853969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 156/314] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:41 2022] GET /identity/v3/users/8047c994d2504aed8a63ef2f648b2248 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:41.859612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169fbb9-e2d8-4c09-9d4e-7c51e977283b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:41.910320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c74c9-afcb-447f-8c60-3af2b5a31451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:41.912713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c74c9-afcb-447f-8c60-3af2b5a31451 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:41.986730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169fbb9-e2d8-4c09-9d4e-7c51e977283b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:42.019600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:42.020296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:42.020575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:42.020846 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:42.021682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] RBAC: Adding query filter params (role.id=7588576bc19e4dd18fb26d25c2a166aa, user.id=8047c994d2504aed8a63ef2f648b2248, scope.system=all) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:42.021991 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:42.023462 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:42.033017 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 157/315] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:15:41 2022] GET /identity/v3/role_assignments?user.id=8047c994d2504aed8a63ef2f648b2248&scope.system=all&role.id=7588576bc19e4dd18fb26d25c2a166aa => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:42.034688 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 159/316] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:42.040176 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:42.148012 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380178d-8a68-448c-a2b5-47cabbeea2fc None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:42.188634 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6759da-62ee-4191-8e3e-115b513f4303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:42.190482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6759da-62ee-4191-8e3e-115b513f4303 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:42.190981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6759da-62ee-4191-8e3e-115b513f4303 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:42.191489 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6759da-62ee-4191-8e3e-115b513f4303 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:42.193051 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6759da-62ee-4191-8e3e-115b513f4303 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:42.194784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6759da-62ee-4191-8e3e-115b513f4303 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:42.197445 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 158/317] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:42 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:42.203643 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c74c9-afcb-447f-8c60-3af2b5a31451 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:42.312981 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c74c9-afcb-447f-8c60-3af2b5a31451 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:42.349804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057be501-2f5a-40a8-bdf9-570d1e20c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:42.350879 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be501-2f5a-40a8-bdf9-570d1e20c9ba None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:42.351394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be501-2f5a-40a8-bdf9-570d1e20c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:42.351918 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057be501-2f5a-40a8-bdf9-570d1e20c9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:42.352986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057be501-2f5a-40a8-bdf9-570d1e20c9ba None admin] RBAC: Adding query filter params (role.id=7588576bc19e4dd18fb26d25c2a166aa, scope.project.id=c4cc0a347718443997a25150c537ff79, user.id=e368b11d74b249b69380b3bb910b69d7) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:42.353511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057be501-2f5a-40a8-bdf9-570d1e20c9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:42.355188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057be501-2f5a-40a8-bdf9-570d1e20c9ba None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:42.362323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 160/318] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:15:42 2022] GET /identity/v3/role_assignments?user.id=e368b11d74b249b69380b3bb910b69d7&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=7588576bc19e4dd18fb26d25c2a166aa => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:43.379400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea0c9-7813-4565-a359-28ff38d235aa None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:43.380061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea0c9-7813-4565-a359-28ff38d235aa None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:43.380061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea0c9-7813-4565-a359-28ff38d235aa None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:43.381510 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 159/319] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:43.386695 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c7334-1c59-4aca-ac01-afefda8a35ca None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:43.387139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c7334-1c59-4aca-ac01-afefda8a35ca None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:43.387324 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c7334-1c59-4aca-ac01-afefda8a35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:43.404319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-387c7334-1c59-4aca-ac01-afefda8a35ca None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:43.405520 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-387c7334-1c59-4aca-ac01-afefda8a35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:43.474581 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 161/320] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:43.497946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ea0c9-7813-4565-a359-28ff38d235aa None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:43.600981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ea0c9-7813-4565-a359-28ff38d235aa None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:43.633716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ab6c-131c-4acd-a945-614a6d6c2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:43.634428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ab6c-131c-4acd-a945-614a6d6c2bde None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:43.634705 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ab6c-131c-4acd-a945-614a6d6c2bde None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:43.634971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032ab6c-131c-4acd-a945-614a6d6c2bde None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:43.644832 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032ab6c-131c-4acd-a945-614a6d6c2bde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-5032ab6c-131c-4acd-a945-614a6d6c2bde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:43.652848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:43.653926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:43.660608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 160/321] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:43.661433 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c7334-1c59-4aca-ac01-afefda8a35ca None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:43.764133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c7334-1c59-4aca-ac01-afefda8a35ca None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:43.797547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98f67-87c8-42db-9356-a6b15779a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:43.798788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98f67-87c8-42db-9356-a6b15779a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:43.799074 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98f67-87c8-42db-9356-a6b15779a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:43.799347 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98f67-87c8-42db-9356-a6b15779a5f7 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:43.800133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a98f67-87c8-42db-9356-a6b15779a5f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:43.800441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a98f67-87c8-42db-9356-a6b15779a5f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:43.801818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a98f67-87c8-42db-9356-a6b15779a5f7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:43.810245 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 162/322] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:43.816241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ab6c-131c-4acd-a945-614a6d6c2bde None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:43.896396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98510-ab15-4059-ae87-30b31bc299b2 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:43.896614 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98510-ab15-4059-ae87-30b31bc299b2 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:43.896860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98510-ab15-4059-ae87-30b31bc299b2 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:43.898358 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 163/323] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:43.903191 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8e1ce-0767-4036-a03b-2056728442cc None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:43.903487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8e1ce-0767-4036-a03b-2056728442cc None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:43.903816 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8e1ce-0767-4036-a03b-2056728442cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:43.917922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032ab6c-131c-4acd-a945-614a6d6c2bde None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:43.921006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-15e8e1ce-0767-4036-a03b-2056728442cc None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:43.922192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-15e8e1ce-0767-4036-a03b-2056728442cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:43.959609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722a9ec-4a28-4ce1-a94a-dd83317b58f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:43.961450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722a9ec-4a28-4ce1-a94a-dd83317b58f0 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:43.961894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722a9ec-4a28-4ce1-a94a-dd83317b58f0 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:43.962329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722a9ec-4a28-4ce1-a94a-dd83317b58f0 None admin] PATH_INFO: `/v3/users/eb8dbdf1ff2446c9b7fe8e40fe06251f` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:43.964409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722a9ec-4a28-4ce1-a94a-dd83317b58f0 None admin] RBAC: Authorizing `identity:get_user(user_id=eb8dbdf1ff2446c9b7fe8e40fe06251f)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:43.967090 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722a9ec-4a28-4ce1-a94a-dd83317b58f0 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:43.976424 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 161/324] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:43 2022] GET /identity/v3/users/eb8dbdf1ff2446c9b7fe8e40fe06251f => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:43.977632 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722a9ec-4a28-4ce1-a94a-dd83317b58f0 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:44.003330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 164/325] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:44.025682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8e1ce-0767-4036-a03b-2056728442cc None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:44.076565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722a9ec-4a28-4ce1-a94a-dd83317b58f0 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:44.111608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:44.112402 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:44.112690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:44.112969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:44.113817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] RBAC: Adding query filter params (role.id=d93601b75fd74dcf89b2cee3d7541f90, user.id=eb8dbdf1ff2446c9b7fe8e40fe06251f, scope.system=all) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:44.114133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:44.115566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:44.127671 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8e1ce-0767-4036-a03b-2056728442cc None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:44.135974 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 162/326] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:15:43 2022] GET /identity/v3/role_assignments?user.id=eb8dbdf1ff2446c9b7fe8e40fe06251f&scope.system=all&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 510 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:44.177456 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50984888-3bdc-4912-9cf8-784856fe6acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:44.178187 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50984888-3bdc-4912-9cf8-784856fe6acd None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:44.178472 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50984888-3bdc-4912-9cf8-784856fe6acd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:44.178751 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50984888-3bdc-4912-9cf8-784856fe6acd None admin] PATH_INFO: `/v3/domains/default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:44.180098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50984888-3bdc-4912-9cf8-784856fe6acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:44.181616 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50984888-3bdc-4912-9cf8-784856fe6acd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:44.183707 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 165/327] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:15:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:44.190189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:44.297216 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d789e8b-8ed0-4757-9acf-f6ef9aa6e25f None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:44.334072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6599c-aa8b-4cd6-beee-5bed9d76128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:44.334755 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6599c-aa8b-4cd6-beee-5bed9d76128a None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:44.335039 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6599c-aa8b-4cd6-beee-5bed9d76128a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:44.335316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6599c-aa8b-4cd6-beee-5bed9d76128a None admin] PATH_INFO: `/v3/groups` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:44.336131 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6599c-aa8b-4cd6-beee-5bed9d76128a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:44.337603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6599c-aa8b-4cd6-beee-5bed9d76128a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:44.357420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 163/328] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 9 15:15:44 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:15:44.385161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257feae7-0ebb-4ebf-b269-969edaff2dd8 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:44.385545 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257feae7-0ebb-4ebf-b269-969edaff2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:44.385723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257feae7-0ebb-4ebf-b269-969edaff2dd8 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:44.387141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 166/329] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:44.394007 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d549-f886-4371-93f9-fd0c56c47c49 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:44.394602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d549-f886-4371-93f9-fd0c56c47c49 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:44.394602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01d549-f886-4371-93f9-fd0c56c47c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:44.413334 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-5c01d549-f886-4371-93f9-fd0c56c47c49 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:44.414568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-5c01d549-f886-4371-93f9-fd0c56c47c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:44.485944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 164/330] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:44.509611 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257feae7-0ebb-4ebf-b269-969edaff2dd8 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:44.615274 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257feae7-0ebb-4ebf-b269-969edaff2dd8 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:44.653500 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8de10b-4607-4456-954e-ed489fa98a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:44.654304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8de10b-4607-4456-954e-ed489fa98a34 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:44.654588 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8de10b-4607-4456-954e-ed489fa98a34 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:44.654867 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8de10b-4607-4456-954e-ed489fa98a34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:44.666496 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8de10b-4607-4456-954e-ed489fa98a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-7b8de10b-4607-4456-954e-ed489fa98a34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:44.674831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:44.676102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:44.677219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 167/331] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:44.682216 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01d549-f886-4371-93f9-fd0c56c47c49 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:44.789813 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01d549-f886-4371-93f9-fd0c56c47c49 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:44.830970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:44.831989 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:44.832403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:44.832803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:44.833954 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:44.834407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:44.836566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:44.850865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 165/332] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:44.856780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8de10b-4607-4456-954e-ed489fa98a34 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:44.972613 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8de10b-4607-4456-954e-ed489fa98a34 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:45.013804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaeadf8-7a5a-4fcd-93aa-50f63c64c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:45.014679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeadf8-7a5a-4fcd-93aa-50f63c64c69a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:45.014957 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeadf8-7a5a-4fcd-93aa-50f63c64c69a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:45.015233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeadf8-7a5a-4fcd-93aa-50f63c64c69a None admin] PATH_INFO: `/v3/users/8047c994d2504aed8a63ef2f648b2248` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:45.016490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaeadf8-7a5a-4fcd-93aa-50f63c64c69a None admin] RBAC: Authorizing `identity:get_user(user_id=8047c994d2504aed8a63ef2f648b2248)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:45.018669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaeadf8-7a5a-4fcd-93aa-50f63c64c69a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:45.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 168/333] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:44 2022] GET /identity/v3/users/8047c994d2504aed8a63ef2f648b2248 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:45.026011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:45.150961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01ffc4-cc5a-4f65-8cb6-d3f3e05cff4b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:45.186286 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77efc0-13a3-478b-88e6-efefdea9cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:45.187162 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77efc0-13a3-478b-88e6-efefdea9cca8 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:45.187444 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77efc0-13a3-478b-88e6-efefdea9cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:45.187722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77efc0-13a3-478b-88e6-efefdea9cca8 None admin] PATH_INFO: `/v3/system/users/8047c994d2504aed8a63ef2f648b2248/roles/7588576bc19e4dd18fb26d25c2a166aa` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:45.190171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77efc0-13a3-478b-88e6-efefdea9cca8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8047c994d2504aed8a63ef2f648b2248, role_id=7588576bc19e4dd18fb26d25c2a166aa)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:45.191558 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77efc0-13a3-478b-88e6-efefdea9cca8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:45.207018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 166/334] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 9 15:15:45 2022] PUT /identity/v3/system/users/8047c994d2504aed8a63ef2f648b2248/roles/7588576bc19e4dd18fb26d25c2a166aa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:46.994787 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58168af9-20eb-4888-8303-df5f70106fe7 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:46.996375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58168af9-20eb-4888-8303-df5f70106fe7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:46.997185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58168af9-20eb-4888-8303-df5f70106fe7 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:46.999756 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 169/335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:47.013117 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8130-8fb0-4926-8091-2ddcf138c8d6 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:47.014114 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8130-8fb0-4926-8091-2ddcf138c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:47.014599 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c8130-8fb0-4926-8091-2ddcf138c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:47.040825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-7b2c8130-8fb0-4926-8091-2ddcf138c8d6 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:47.042386 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-7b2c8130-8fb0-4926-8091-2ddcf138c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:47.129911 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 167/336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:47.173573 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58168af9-20eb-4888-8303-df5f70106fe7 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:47.312710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58168af9-20eb-4888-8303-df5f70106fe7 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:47.350813 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbb9d-47be-48a1-82c8-a24920fd370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:47.351608 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbb9d-47be-48a1-82c8-a24920fd370b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:47.351924 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbb9d-47be-48a1-82c8-a24920fd370b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:47.352201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fbb9d-47be-48a1-82c8-a24920fd370b None admin] PATH_INFO: `/v3/roles/member` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:47.369421 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fbb9d-47be-48a1-82c8-a24920fd370b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-6c2fbb9d-47be-48a1-82c8-a24920fd370b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:47.377522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:47.378609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:47.380068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 170/337] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:47.385011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c8130-8fb0-4926-8091-2ddcf138c8d6 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:47.534421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c8130-8fb0-4926-8091-2ddcf138c8d6 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:47.595373 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86b9b4-9a4b-443a-99f5-7983f7935a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:47.596247 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86b9b4-9a4b-443a-99f5-7983f7935a0c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:47.596536 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86b9b4-9a4b-443a-99f5-7983f7935a0c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:47.596810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86b9b4-9a4b-443a-99f5-7983f7935a0c None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:47.597576 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86b9b4-9a4b-443a-99f5-7983f7935a0c None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:47.597880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86b9b4-9a4b-443a-99f5-7983f7935a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:47.599261 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86b9b4-9a4b-443a-99f5-7983f7935a0c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:47.611961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 168/338] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:47.614280 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbb9d-47be-48a1-82c8-a24920fd370b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:47.716014 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ee9e-8cdb-4079-a251-02989bca2b7f None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:47.716693 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ee9e-8cdb-4079-a251-02989bca2b7f None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:47.717194 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195ee9e-8cdb-4079-a251-02989bca2b7f None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:47.719873 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 169/339] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:47.729498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec83f-2b24-4224-85fd-7b66e9b1aadc None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:47.730388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec83f-2b24-4224-85fd-7b66e9b1aadc None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:47.731157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec83f-2b24-4224-85fd-7b66e9b1aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:47.767324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-a33ec83f-2b24-4224-85fd-7b66e9b1aadc None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:47.768638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-a33ec83f-2b24-4224-85fd-7b66e9b1aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:47.819675 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fbb9d-47be-48a1-82c8-a24920fd370b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:47.880823 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc858ef-a45f-45cd-9ae0-6f0f132492ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:47.881402 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc858ef-a45f-45cd-9ae0-6f0f132492ec None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:47.881688 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc858ef-a45f-45cd-9ae0-6f0f132492ec None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:47.881965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc858ef-a45f-45cd-9ae0-6f0f132492ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:47.935907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 170/340] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:47.937269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06874e5f-e004-42ba-80b8-6f18689ffbaa None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:47.937561 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06874e5f-e004-42ba-80b8-6f18689ffbaa None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:47.937835 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06874e5f-e004-42ba-80b8-6f18689ffbaa None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:47.939670 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 171/341] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:47.947195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a367ec-39d4-4574-8bfe-fccbfe389aaa None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:47.947484 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a367ec-39d4-4574-8bfe-fccbfe389aaa None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:47.947790 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a367ec-39d4-4574-8bfe-fccbfe389aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:47.988156 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-b1a367ec-39d4-4574-8bfe-fccbfe389aaa None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:47.989842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-b1a367ec-39d4-4574-8bfe-fccbfe389aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:48.024129 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc858ef-a45f-45cd-9ae0-6f0f132492ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:48.025600 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc858ef-a45f-45cd-9ae0-6f0f132492ec None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:48.082510 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 172/342] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:48.084138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a367ec-39d4-4574-8bfe-fccbfe389aaa None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:48.136375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 171/343] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:48.137607 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc858ef-a45f-45cd-9ae0-6f0f132492ec None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:48.201335 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a367ec-39d4-4574-8bfe-fccbfe389aaa None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:48.245381 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15ebc4-d908-4666-90ec-cdde9c499719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:48.246785 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15ebc4-d908-4666-90ec-cdde9c499719 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:48.247292 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15ebc4-d908-4666-90ec-cdde9c499719 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:48.247788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15ebc4-d908-4666-90ec-cdde9c499719 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:48.269492 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15ebc4-d908-4666-90ec-cdde9c499719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:48.270256 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc858ef-a45f-45cd-9ae0-6f0f132492ec None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-9d15ebc4-d908-4666-90ec-cdde9c499719 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:48.281919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:48.283609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:48.284586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:48.286308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 173/344] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:48.287488 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15ebc4-d908-4666-90ec-cdde9c499719 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:48.320386 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ae7f-137f-4885-9cc2-c7ab7ee84f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:48.321210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ae7f-137f-4885-9cc2-c7ab7ee84f6e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:48.321751 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ae7f-137f-4885-9cc2-c7ab7ee84f6e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:48.322028 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ae7f-137f-4885-9cc2-c7ab7ee84f6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:48.344695 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ae7f-137f-4885-9cc2-c7ab7ee84f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-d1a5ae7f-137f-4885-9cc2-c7ab7ee84f6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:48.352859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:48.353850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 172/345] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:48.355348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ae7f-137f-4885-9cc2-c7ab7ee84f6e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:48.441880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15ebc4-d908-4666-90ec-cdde9c499719 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:48.492907 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ae7f-137f-4885-9cc2-c7ab7ee84f6e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:48.493823 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ef76f-3d8a-425f-a43c-ecc7eeb40db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:48.496410 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ef76f-3d8a-425f-a43c-ecc7eeb40db2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:48.496853 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ef76f-3d8a-425f-a43c-ecc7eeb40db2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:48.497287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ef76f-3d8a-425f-a43c-ecc7eeb40db2 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:48.499467 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ef76f-3d8a-425f-a43c-ecc7eeb40db2 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:48.504730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ef76f-3d8a-425f-a43c-ecc7eeb40db2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:48.506667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 174/346] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:48 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:48.508497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ef76f-3d8a-425f-a43c-ecc7eeb40db2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:48.559297 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:48.560314 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:48.560790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:48.561280 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:48.562204 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] RBAC: Adding query filter params (name=member) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:48.562683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:48.565045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:48.591570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 173/347] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:48.592677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:48.666491 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ef76f-3d8a-425f-a43c-ecc7eeb40db2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:48.708096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:48.709060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:48.709504 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:48.709940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:48.710860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:48.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:48.713001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:48.723291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 175/348] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:48.724459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:48.817722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459d14-4c9e-4999-8b50-6c4e4d7a35ae None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:48.836777 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee215ff-cd82-4c4d-8dcc-4a78592a19c9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:48.872822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc2a91-3566-4f19-8cb9-0592e1c293a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:48.873792 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2a91-3566-4f19-8cb9-0592e1c293a2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:48.874250 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2a91-3566-4f19-8cb9-0592e1c293a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:48.874692 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2a91-3566-4f19-8cb9-0592e1c293a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:48.878622 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a56d-f9e1-4471-9091-de89057d72a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:48.879601 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a56d-f9e1-4471-9091-de89057d72a8 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:48.879794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a56d-f9e1-4471-9091-de89057d72a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:48.880074 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61a56d-f9e1-4471-9091-de89057d72a8 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:48.892978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a56d-f9e1-4471-9091-de89057d72a8 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:48.897094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61a56d-f9e1-4471-9091-de89057d72a8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:48.898912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 174/349] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:48 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:48.899701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a56d-f9e1-4471-9091-de89057d72a8 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:48.956219 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc2a91-3566-4f19-8cb9-0592e1c293a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:48.957982 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc2a91-3566-4f19-8cb9-0592e1c293a2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:49.042746 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61a56d-f9e1-4471-9091-de89057d72a8 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:49.072125 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 176/350] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:49.073310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc2a91-3566-4f19-8cb9-0592e1c293a2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:49.085884 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e1143-d29e-4c6b-acf0-a3eefc617425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:49.086548 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1143-d29e-4c6b-acf0-a3eefc617425 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.086838 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1143-d29e-4c6b-acf0-a3eefc617425 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.087119 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1143-d29e-4c6b-acf0-a3eefc617425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.181311 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e1143-d29e-4c6b-acf0-a3eefc617425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:49.182768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e1143-d29e-4c6b-acf0-a3eefc617425 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:49.190973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc2a91-3566-4f19-8cb9-0592e1c293a2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:49.243553 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d6ff-f171-458a-886a-6e3e122207dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:49.244262 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d6ff-f171-458a-886a-6e3e122207dc None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.244543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d6ff-f171-458a-886a-6e3e122207dc None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.244816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d6ff-f171-458a-886a-6e3e122207dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.245656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d6ff-f171-458a-886a-6e3e122207dc None admin] RBAC: Adding query filter params (group.id=b2b5eddd41df4270bcc77a58275a8f85, role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=8ffbe1e0bdf144498702098bd867a307) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:49.245967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d6ff-f171-458a-886a-6e3e122207dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:49.247425 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d6ff-f171-458a-886a-6e3e122207dc None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:49.256601 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 177/351] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:15:49 2022] GET /identity/v3/role_assignments?group.id=b2b5eddd41df4270bcc77a58275a8f85&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:49.258012 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cd03-aa49-4d51-bb8a-000cc94cbba6 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.258298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cd03-aa49-4d51-bb8a-000cc94cbba6 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.258569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5cd03-aa49-4d51-bb8a-000cc94cbba6 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.263873 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 178/352] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:49.265205 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5cd03-aa49-4d51-bb8a-000cc94cbba6 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:49.330217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 175/353] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:49.332606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02abf-f8d1-4e1e-a774-f4be4fe52511 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.333133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02abf-f8d1-4e1e-a774-f4be4fe52511 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.333665 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02abf-f8d1-4e1e-a774-f4be4fe52511 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.335333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 176/354] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:49.336884 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea06d-c18b-4863-9123-6ef069aaf3dd None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.337436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea06d-c18b-4863-9123-6ef069aaf3dd None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.337936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea06d-c18b-4863-9123-6ef069aaf3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.357399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-ac3ea06d-c18b-4863-9123-6ef069aaf3dd None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:49.358584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-ac3ea06d-c18b-4863-9123-6ef069aaf3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:49.424737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5cd03-aa49-4d51-bb8a-000cc94cbba6 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:49.455801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 177/355] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:49.455801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ea06d-c18b-4863-9123-6ef069aaf3dd None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:49.472477 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdd4c4-7293-4564-bd37-5026f4de856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:49.473498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd4c4-7293-4564-bd37-5026f4de856f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.473880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd4c4-7293-4564-bd37-5026f4de856f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.474161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd4c4-7293-4564-bd37-5026f4de856f None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.475379 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdd4c4-7293-4564-bd37-5026f4de856f None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:49.476886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdd4c4-7293-4564-bd37-5026f4de856f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:49.479783 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 179/356] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:49 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:49.485199 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f119-68a7-4227-95d2-2fc4455d9d83 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.485812 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f119-68a7-4227-95d2-2fc4455d9d83 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.485812 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f119-68a7-4227-95d2-2fc4455d9d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.507864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ae22f119-68a7-4227-95d2-2fc4455d9d83 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:49.509291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ae22f119-68a7-4227-95d2-2fc4455d9d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:49.589007 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ea06d-c18b-4863-9123-6ef069aaf3dd None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:49.591190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 180/357] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:49.591575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a7ade-5760-4939-9b71-502a102e8abb None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.591891 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a7ade-5760-4939-9b71-502a102e8abb None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.592167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a7ade-5760-4939-9b71-502a102e8abb None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.593577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 181/358] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:49.594099 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a7ade-5760-4939-9b71-502a102e8abb None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:49.645064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dddb0-fbbb-42c4-8486-2e662ccc6ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:49.645957 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dddb0-fbbb-42c4-8486-2e662ccc6ad5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.646442 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dddb0-fbbb-42c4-8486-2e662ccc6ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.646577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dddb0-fbbb-42c4-8486-2e662ccc6ad5 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.647732 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dddb0-fbbb-42c4-8486-2e662ccc6ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:49.649223 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dddb0-fbbb-42c4-8486-2e662ccc6ad5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:49.651107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 178/359] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:49 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:49.652151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dddb0-fbbb-42c4-8486-2e662ccc6ad5 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:49.725694 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a7ade-5760-4939-9b71-502a102e8abb None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:49.784422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dfa09-52ab-4761-b194-effdfd34fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:49.784798 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dddb0-fbbb-42c4-8486-2e662ccc6ad5 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:49.785848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfa09-52ab-4761-b194-effdfd34fced None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.786511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfa09-52ab-4761-b194-effdfd34fced None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.787630 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfa09-52ab-4761-b194-effdfd34fced None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.800990 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dfa09-52ab-4761-b194-effdfd34fced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-e12dfa09-52ab-4761-b194-effdfd34fced None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:49.811681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:49.812768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 182/360] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:49.814256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b44c7-6864-4956-801c-1c3b8938eb9a None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.815081 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b44c7-6864-4956-801c-1c3b8938eb9a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.815081 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b44c7-6864-4956-801c-1c3b8938eb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.832804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-4d0b44c7-6864-4956-801c-1c3b8938eb9a None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:49.834088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-4d0b44c7-6864-4956-801c-1c3b8938eb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:49.834216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8ffb5-b35c-4b45-bee8-df29deb9d369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:49.834986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8ffb5-b35c-4b45-bee8-df29deb9d369 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:49.835272 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8ffb5-b35c-4b45-bee8-df29deb9d369 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:49.835547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8ffb5-b35c-4b45-bee8-df29deb9d369 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:49.837758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8ffb5-b35c-4b45-bee8-df29deb9d369 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:49.839102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8ffb5-b35c-4b45-bee8-df29deb9d369 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:49.840837 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 179/361] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:49 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:49.841594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8ffb5-b35c-4b45-bee8-df29deb9d369 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:49.918695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 183/362] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:49.919555 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b44c7-6864-4956-801c-1c3b8938eb9a None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:49.990681 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8ffb5-b35c-4b45-bee8-df29deb9d369 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.034232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5fb36-ec8a-45d4-b629-484f279e18da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.035222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5fb36-ec8a-45d4-b629-484f279e18da None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.035505 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5fb36-ec8a-45d4-b629-484f279e18da None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.036252 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5fb36-ec8a-45d4-b629-484f279e18da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.047972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5fb36-ec8a-45d4-b629-484f279e18da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-15a5fb36-ec8a-45d4-b629-484f279e18da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:50.056828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:50.057871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:15:50.058829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:50.059814 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b44c7-6864-4956-801c-1c3b8938eb9a None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.059903 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 180/363] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:50.059903 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5fb36-ec8a-45d4-b629-484f279e18da None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.102915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e4d2-3b82-4dd6-a2e4-01e7b83e77a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.103632 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e4d2-3b82-4dd6-a2e4-01e7b83e77a2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.103949 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e4d2-3b82-4dd6-a2e4-01e7b83e77a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.104285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4e4d2-3b82-4dd6-a2e4-01e7b83e77a2 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.105556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4e4d2-3b82-4dd6-a2e4-01e7b83e77a2 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:50.107024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4e4d2-3b82-4dd6-a2e4-01e7b83e77a2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:50.113881 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 184/364] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:49 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:50.113881 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e4d2-3b82-4dd6-a2e4-01e7b83e77a2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.179941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5fb36-ec8a-45d4-b629-484f279e18da None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.226594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.227290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.227574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.227878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.229079 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:50.229399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:50.231058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:50.241971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4e4d2-3b82-4dd6-a2e4-01e7b83e77a2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.242970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 181/365] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:50.243998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.286707 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.287376 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.287659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.287969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.288811 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] RBAC: Adding query filter params (group.id=b2b5eddd41df4270bcc77a58275a8f85, role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=c4cc0a347718443997a25150c537ff79) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:50.289125 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:50.291018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:50.299788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 185/366] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/role_assignments?group.id=b2b5eddd41df4270bcc77a58275a8f85&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:50.300554 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.379790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31ad3f-8a18-41f9-9d07-8ac80982034e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.418519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829cfbc-f4c3-486c-8da7-fdd9564c6616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.419335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829cfbc-f4c3-486c-8da7-fdd9564c6616 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.419630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829cfbc-f4c3-486c-8da7-fdd9564c6616 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.419928 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829cfbc-f4c3-486c-8da7-fdd9564c6616 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.426646 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c77cd-28e0-4153-a145-74a2927880f2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.432817 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829cfbc-f4c3-486c-8da7-fdd9564c6616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-1829cfbc-f4c3-486c-8da7-fdd9564c6616 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:50.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:50.442648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:50.443576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 182/367] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:50.444357 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829cfbc-f4c3-486c-8da7-fdd9564c6616 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.470285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.471428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.472012 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.472534 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.473591 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:50.474220 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:50.475966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:50.486900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 186/368] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:50.488239 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.581921 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829cfbc-f4c3-486c-8da7-fdd9564c6616 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.625055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde568c-5842-4346-ba25-6ccd99362bc3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.627285 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.628821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.629104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.629380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.630331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] RBAC: Adding query filter params (group.id=b2b5eddd41df4270bcc77a58275a8f85, role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=8ffbe1e0bdf144498702098bd867a307) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:50.630587 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:50.632101 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:50.640095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 183/369] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/role_assignments?group.id=b2b5eddd41df4270bcc77a58275a8f85&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:50.640946 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.674852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d075f-3719-4ebe-8d66-bde962d70cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.675524 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d075f-3719-4ebe-8d66-bde962d70cd9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.675902 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d075f-3719-4ebe-8d66-bde962d70cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.676182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d075f-3719-4ebe-8d66-bde962d70cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.751177 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d075f-3719-4ebe-8d66-bde962d70cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:50.752694 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d075f-3719-4ebe-8d66-bde962d70cd9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:50.798830 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6f97a-5029-4396-a30c-03c840cb3878 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:50.863311 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 187/370] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:50.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d075f-3719-4ebe-8d66-bde962d70cd9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.888683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:50.889776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:50.890291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:50.890785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:50.892703 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:50.893361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:50.895001 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:50.908099 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 184/371] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:50.909572 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:50.984427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d075f-3719-4ebe-8d66-bde962d70cd9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:51.022580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fef324-e9d7-46d7-b46d-2b84edb63997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:51.023472 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fef324-e9d7-46d7-b46d-2b84edb63997 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:51.023752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fef324-e9d7-46d7-b46d-2b84edb63997 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:51.024126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fef324-e9d7-46d7-b46d-2b84edb63997 None admin] PATH_INFO: `/v3/users/8047c994d2504aed8a63ef2f648b2248` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:51.025374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fef324-e9d7-46d7-b46d-2b84edb63997 None admin] RBAC: Authorizing `identity:get_user(user_id=8047c994d2504aed8a63ef2f648b2248)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:51.026825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fef324-e9d7-46d7-b46d-2b84edb63997 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:51.028673 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 188/372] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/users/8047c994d2504aed8a63ef2f648b2248 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:51.029263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fef324-e9d7-46d7-b46d-2b84edb63997 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:51.138567 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fef324-e9d7-46d7-b46d-2b84edb63997 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:51.143743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5a33e-c2fa-4a40-befe-fca2312f0286 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:51.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e041f0-95bb-4e60-9813-f6791dc0b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:51.178794 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e041f0-95bb-4e60-9813-f6791dc0b874 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:51.179076 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e041f0-95bb-4e60-9813-f6791dc0b874 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:51.179352 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e041f0-95bb-4e60-9813-f6791dc0b874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:51.238100 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19446c5-3f18-4b9b-8b79-b472c0424194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:51.238977 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19446c5-3f18-4b9b-8b79-b472c0424194 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:51.239259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19446c5-3f18-4b9b-8b79-b472c0424194 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:51.239532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19446c5-3f18-4b9b-8b79-b472c0424194 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:51.240781 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19446c5-3f18-4b9b-8b79-b472c0424194 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:51.242241 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19446c5-3f18-4b9b-8b79-b472c0424194 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:51.252258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 185/373] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:50 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:51.253473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19446c5-3f18-4b9b-8b79-b472c0424194 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:51.259242 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e041f0-95bb-4e60-9813-f6791dc0b874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:51.260787 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e041f0-95bb-4e60-9813-f6791dc0b874 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:51.389149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 189/374] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:51.390170 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e041f0-95bb-4e60-9813-f6791dc0b874 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:51.399942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19446c5-3f18-4b9b-8b79-b472c0424194 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:51.441046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:51.441714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:51.441997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:51.442272 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:51.443115 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] RBAC: Adding query filter params (role.id=7588576bc19e4dd18fb26d25c2a166aa, user.id=8047c994d2504aed8a63ef2f648b2248, scope.system=all) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:51.443423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:51.444964 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:51.458814 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 186/375] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:15:51 2022] GET /identity/v3/role_assignments?user.id=8047c994d2504aed8a63ef2f648b2248&scope.system=all&role.id=7588576bc19e4dd18fb26d25c2a166aa => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:51.459674 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:51.526269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e041f0-95bb-4e60-9813-f6791dc0b874 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:51.564866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75451b-f5b6-41ea-91d3-2995d86aaf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:51.565906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75451b-f5b6-41ea-91d3-2995d86aaf73 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:51.566189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75451b-f5b6-41ea-91d3-2995d86aaf73 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:51.566463 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75451b-f5b6-41ea-91d3-2995d86aaf73 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:51.567818 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75451b-f5b6-41ea-91d3-2995d86aaf73 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:51.571151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75451b-f5b6-41ea-91d3-2995d86aaf73 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:51.571815 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 190/376] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:51 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:51.581063 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75451b-f5b6-41ea-91d3-2995d86aaf73 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:51.614892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa735f-84d8-4bd4-8c09-dfc64fcc9be7 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:51.680619 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406ee67-82e6-421c-bdfe-658be1a2624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:51.681519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ee67-82e6-421c-bdfe-658be1a2624e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:51.681807 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ee67-82e6-421c-bdfe-658be1a2624e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:51.682088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ee67-82e6-421c-bdfe-658be1a2624e None admin] PATH_INFO: `/v3/projects/6755b8fadb0f418da6fcc341947da499` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:51.683595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406ee67-82e6-421c-bdfe-658be1a2624e None admin] RBAC: Authorizing `identity:get_project(project_id=6755b8fadb0f418da6fcc341947da499)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:51.685092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406ee67-82e6-421c-bdfe-658be1a2624e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:51.687036 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 187/377] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:51 2022] GET /identity/v3/projects/6755b8fadb0f418da6fcc341947da499 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:51.692770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75451b-f5b6-41ea-91d3-2995d86aaf73 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:51.693597 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406ee67-82e6-421c-bdfe-658be1a2624e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:51.731405 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:51.732109 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:51.732394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:51.732671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:51.733529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] RBAC: Adding query filter params (group.id=b2b5eddd41df4270bcc77a58275a8f85, role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=c4cc0a347718443997a25150c537ff79) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:51.733842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:51.735477 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:51.742166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 191/378] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:15:51 2022] GET /identity/v3/role_assignments?group.id=b2b5eddd41df4270bcc77a58275a8f85&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:51.854974 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406ee67-82e6-421c-bdfe-658be1a2624e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:51.903492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4f1a1-6b04-4e3f-bb6c-2f2c2e60de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:51.904396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f1a1-6b04-4e3f-bb6c-2f2c2e60de56 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:51.904680 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f1a1-6b04-4e3f-bb6c-2f2c2e60de56 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:51.904959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f1a1-6b04-4e3f-bb6c-2f2c2e60de56 None admin] PATH_INFO: `/v3/groups/034f575a549c49ed8896ee89258027ef` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:51.915884 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4f1a1-6b04-4e3f-bb6c-2f2c2e60de56 None admin] RBAC: Authorizing `identity:get_group(group_id=034f575a549c49ed8896ee89258027ef)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:51.917463 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4f1a1-6b04-4e3f-bb6c-2f2c2e60de56 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:51.919625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 188/379] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:51 2022] GET /identity/v3/groups/034f575a549c49ed8896ee89258027ef => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:51.925758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:52.030487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1c7f-aa85-46d3-ad2f-5674a404d97a None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:52.030791 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1c7f-aa85-46d3-ad2f-5674a404d97a None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:52.030983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1c7f-aa85-46d3-ad2f-5674a404d97a None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:52.033880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 189/380] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:52.052140 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0338d-a1d2-4394-a300-66be84c12013 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:52.052453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0338d-a1d2-4394-a300-66be84c12013 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:52.052708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0338d-a1d2-4394-a300-66be84c12013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:52.058350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72051f-cd73-4d2d-9a46-4d52e315d327 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:52.076088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-53c0338d-a1d2-4394-a300-66be84c12013 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:52.077305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-53c0338d-a1d2-4394-a300-66be84c12013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:52.095448 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:52.096214 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:52.096495 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:52.096772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:52.097613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] RBAC: Adding query filter params (group.id=034f575a549c49ed8896ee89258027ef, role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=6755b8fadb0f418da6fcc341947da499) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:52.097922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:52.099422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:52.105584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 192/381] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:15:51 2022] GET /identity/v3/role_assignments?group.id=034f575a549c49ed8896ee89258027ef&scope.project.id=6755b8fadb0f418da6fcc341947da499&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:52.197884 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 190/382] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:52.241291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:52.355829 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefa8d2-2c08-4204-9166-be5db0bf0907 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:52.395916 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d6f3-1a29-462e-8eb2-85a448eddab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:52.396718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d6f3-1a29-462e-8eb2-85a448eddab3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:52.396995 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d6f3-1a29-462e-8eb2-85a448eddab3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:52.397269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d6f3-1a29-462e-8eb2-85a448eddab3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:52.409592 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d6f3-1a29-462e-8eb2-85a448eddab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-2450d6f3-1a29-462e-8eb2-85a448eddab3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:52.417339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:52.419738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:52.421907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 193/383] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:52.429835 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0338d-a1d2-4394-a300-66be84c12013 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:52.553028 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0338d-a1d2-4394-a300-66be84c12013 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:52.597568 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:52.598261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:52.598554 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:52.598833 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:52.599599 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] RBAC: Adding query filter params (name=member) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:52.599936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:52.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:52.610928 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 191/384] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:52.616535 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d6f3-1a29-462e-8eb2-85a448eddab3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:52.724639 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d6f3-1a29-462e-8eb2-85a448eddab3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:52.759977 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d465d-95f7-4785-8c33-8b6fca421791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:52.760841 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d465d-95f7-4785-8c33-8b6fca421791 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:52.761123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d465d-95f7-4785-8c33-8b6fca421791 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:52.761402 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d465d-95f7-4785-8c33-8b6fca421791 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:52.762592 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d465d-95f7-4785-8c33-8b6fca421791 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:52.764064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d465d-95f7-4785-8c33-8b6fca421791 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:52.765902 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 194/385] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:52 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:52.772630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:52.890313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf9297-a82c-4d9c-a1d1-408f96803744 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:52.931432 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b8099-3074-4a0a-bf81-3347f0dca282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:52.932387 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8099-3074-4a0a-bf81-3347f0dca282 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:52.932677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8099-3074-4a0a-bf81-3347f0dca282 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:52.932954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8099-3074-4a0a-bf81-3347f0dca282 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:52.934200 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8099-3074-4a0a-bf81-3347f0dca282 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:52.935648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8099-3074-4a0a-bf81-3347f0dca282 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:52.937700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 192/386] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:52 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:52.943645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d465d-95f7-4785-8c33-8b6fca421791 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:53.050932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d465d-95f7-4785-8c33-8b6fca421791 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:53.088481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a90c5-43a5-4cfd-a295-385b236a6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:53.089382 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a90c5-43a5-4cfd-a295-385b236a6823 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:53.089668 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a90c5-43a5-4cfd-a295-385b236a6823 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:53.089944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a90c5-43a5-4cfd-a295-385b236a6823 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307/groups/b2b5eddd41df4270bcc77a58275a8f85/roles/d93601b75fd74dcf89b2cee3d7541f90` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:53.092013 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a90c5-43a5-4cfd-a295-385b236a6823 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ffbe1e0bdf144498702098bd867a307, group_id=b2b5eddd41df4270bcc77a58275a8f85, role_id=d93601b75fd74dcf89b2cee3d7541f90)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:53.093465 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a90c5-43a5-4cfd-a295-385b236a6823 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:53.120581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 195/387] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:15:52 2022] PUT /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307/groups/b2b5eddd41df4270bcc77a58275a8f85/roles/d93601b75fd74dcf89b2cee3d7541f90 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:53.520053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d061-cbd7-4d7b-bb4e-9362a6037b32 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:53.520624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d061-cbd7-4d7b-bb4e-9362a6037b32 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:53.520624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5d061-cbd7-4d7b-bb4e-9362a6037b32 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:53.522327 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 193/388] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:53.530631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837bf68-da3c-44d2-b819-6f220f155e69 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:53.530631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837bf68-da3c-44d2-b819-6f220f155e69 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:53.530631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837bf68-da3c-44d2-b819-6f220f155e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:53.550067 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-d837bf68-da3c-44d2-b819-6f220f155e69 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:53.551631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-d837bf68-da3c-44d2-b819-6f220f155e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:53.630792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2f7a3-e006-4235-94c4-1e940c0de00b None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:53.631085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2f7a3-e006-4235-94c4-1e940c0de00b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:53.631369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2f7a3-e006-4235-94c4-1e940c0de00b None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:53.632915 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 194/389] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:53.640906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f828-0a9c-4aba-8a6c-658de43f51a2 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:53.640906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f828-0a9c-4aba-8a6c-658de43f51a2 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:53.640906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f828-0a9c-4aba-8a6c-658de43f51a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:53.641944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 196/390] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:53.661537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-7f16f828-0a9c-4aba-8a6c-658de43f51a2 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:53.662704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-7f16f828-0a9c-4aba-8a6c-658de43f51a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:53.669744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837bf68-da3c-44d2-b819-6f220f155e69 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:53.740712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 195/391] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:53.764873 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16f828-0a9c-4aba-8a6c-658de43f51a2 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:53.869918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837bf68-da3c-44d2-b819-6f220f155e69 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:53.877653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16f828-0a9c-4aba-8a6c-658de43f51a2 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:53.943388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55a216-beec-4de4-8b5f-49c23caa0413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:53.944268 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a216-beec-4de4-8b5f-49c23caa0413 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:53.944546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a216-beec-4de4-8b5f-49c23caa0413 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:53.944867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55a216-beec-4de4-8b5f-49c23caa0413 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:53.946839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4a69-c6f6-465c-bb68-d8581491831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:53.947625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4a69-c6f6-465c-bb68-d8581491831b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:53.947926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4a69-c6f6-465c-bb68-d8581491831b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:53.948194 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4a69-c6f6-465c-bb68-d8581491831b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:53.965864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55a216-beec-4de4-8b5f-49c23caa0413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:53.975883 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4a69-c6f6-465c-bb68-d8581491831b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-6b55a216-beec-4de4-8b5f-49c23caa0413 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:53.981908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:53.982942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:53.984277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 197/392] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-902b4a69-c6f6-465c-bb68-d8581491831b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:53.985326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:53.987355 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:53.990839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 196/393] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:53.992625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55a216-beec-4de4-8b5f-49c23caa0413 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:53.997508 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4a69-c6f6-465c-bb68-d8581491831b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:54.142499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4a69-c6f6-465c-bb68-d8581491831b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:54.200828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55a216-beec-4de4-8b5f-49c23caa0413 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:54.213739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:54.214708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:54.215208 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:54.215748 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:54.216739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:54.217259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:54.218848 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:54.243873 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 197/394] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:54.254378 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:54.262269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:54.262946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:54.263238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:54.263516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:54.264310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:54.264622 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:54.266003 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:54.283816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 198/395] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:54.289543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:54.427482 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c53094-727d-4587-86b5-65110adcc964 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:54.449022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f822f3-c841-4b92-9c20-ad5828418594 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:54.487132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723cfc6-db93-499e-a882-ffaf23445d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:54.488018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723cfc6-db93-499e-a882-ffaf23445d8e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:54.488297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723cfc6-db93-499e-a882-ffaf23445d8e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:54.488568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723cfc6-db93-499e-a882-ffaf23445d8e None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:54.489868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723cfc6-db93-499e-a882-ffaf23445d8e None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:54.493632 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723cfc6-db93-499e-a882-ffaf23445d8e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:54.498057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 199/396] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:54 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:54.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23b1c-1d96-4fa5-b2c5-954f8278fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:54.501968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23b1c-1d96-4fa5-b2c5-954f8278fd64 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:54.502276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23b1c-1d96-4fa5-b2c5-954f8278fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:54.502543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23b1c-1d96-4fa5-b2c5-954f8278fd64 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:54.504041 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723cfc6-db93-499e-a882-ffaf23445d8e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:54.505013 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23b1c-1d96-4fa5-b2c5-954f8278fd64 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:54.506445 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23b1c-1d96-4fa5-b2c5-954f8278fd64 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:54.515576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 198/397] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:54 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:54.521445 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23b1c-1d96-4fa5-b2c5-954f8278fd64 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:54.623685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723cfc6-db93-499e-a882-ffaf23445d8e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:54.661294 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24740edc-6b3d-4de4-9870-3cab1463c4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:54.662165 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24740edc-6b3d-4de4-9870-3cab1463c4ea None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:54.662448 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24740edc-6b3d-4de4-9870-3cab1463c4ea None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:54.662724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24740edc-6b3d-4de4-9870-3cab1463c4ea None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:54.664146 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24740edc-6b3d-4de4-9870-3cab1463c4ea None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:54.665605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24740edc-6b3d-4de4-9870-3cab1463c4ea None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:54.667491 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 200/398] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:54 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:54.673349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24740edc-6b3d-4de4-9870-3cab1463c4ea None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:54.748584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23b1c-1d96-4fa5-b2c5-954f8278fd64 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:54.812508 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ec370-ade6-4835-b935-a50f314f766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:54.813965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec370-ade6-4835-b935-a50f314f766d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:54.814238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec370-ade6-4835-b935-a50f314f766d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:54.814615 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec370-ade6-4835-b935-a50f314f766d None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:54.816609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ec370-ade6-4835-b935-a50f314f766d None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:54.818064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ec370-ade6-4835-b935-a50f314f766d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:54.824990 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 199/399] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:54 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:54.825846 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ec370-ade6-4835-b935-a50f314f766d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:54.877373 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24740edc-6b3d-4de4-9870-3cab1463c4ea None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:54.960483 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba780ea-fc8c-4574-89db-7d255df145c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:54.961804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba780ea-fc8c-4574-89db-7d255df145c3 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:54.962307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba780ea-fc8c-4574-89db-7d255df145c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:54.962785 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba780ea-fc8c-4574-89db-7d255df145c3 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79/groups/b2b5eddd41df4270bcc77a58275a8f85/roles/d93601b75fd74dcf89b2cee3d7541f90` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:54.965072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba780ea-fc8c-4574-89db-7d255df145c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4cc0a347718443997a25150c537ff79, group_id=b2b5eddd41df4270bcc77a58275a8f85, role_id=d93601b75fd74dcf89b2cee3d7541f90)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:54.966741 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba780ea-fc8c-4574-89db-7d255df145c3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:54.979747 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ec370-ade6-4835-b935-a50f314f766d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:55.018279 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 201/400] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:15:54 2022] PUT /identity/v3/projects/c4cc0a347718443997a25150c537ff79/groups/b2b5eddd41df4270bcc77a58275a8f85/roles/d93601b75fd74dcf89b2cee3d7541f90 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:55.018924 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5932f-d48f-4e56-a69f-fb081bdd6639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:55.019912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5932f-d48f-4e56-a69f-fb081bdd6639 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.020198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5932f-d48f-4e56-a69f-fb081bdd6639 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.020476 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5932f-d48f-4e56-a69f-fb081bdd6639 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307/groups/b2b5eddd41df4270bcc77a58275a8f85/roles/db0e2f86b328428ba0dbfe6383deffce` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.023052 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5932f-d48f-4e56-a69f-fb081bdd6639 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ffbe1e0bdf144498702098bd867a307, group_id=b2b5eddd41df4270bcc77a58275a8f85, role_id=db0e2f86b328428ba0dbfe6383deffce)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:55.024871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5932f-d48f-4e56-a69f-fb081bdd6639 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:55.058367 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 200/401] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:15:54 2022] PUT /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307/groups/b2b5eddd41df4270bcc77a58275a8f85/roles/db0e2f86b328428ba0dbfe6383deffce => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:55.087123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67185-43f0-418f-ac58-8bd65f0bf3e7 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.087842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67185-43f0-418f-ac58-8bd65f0bf3e7 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.088354 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d67185-43f0-418f-ac58-8bd65f0bf3e7 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.090388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 202/402] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:55.096613 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca847-89eb-4e9e-a381-b94ec9b1f15e None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.097258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca847-89eb-4e9e-a381-b94ec9b1f15e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.097757 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca847-89eb-4e9e-a381-b94ec9b1f15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.117155 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-061ca847-89eb-4e9e-a381-b94ec9b1f15e None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:55.118775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-061ca847-89eb-4e9e-a381-b94ec9b1f15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:55.206816 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 201/403] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:55.224837 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664038b-6172-4266-b47d-a4665f507963 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.225189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664038b-6172-4266-b47d-a4665f507963 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.225394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664038b-6172-4266-b47d-a4665f507963 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.227113 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 203/404] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:55.231041 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ca847-89eb-4e9e-a381-b94ec9b1f15e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:55.232618 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4c99-a1ad-4a2e-8fe3-82034e70d86e None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.232905 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4c99-a1ad-4a2e-8fe3-82034e70d86e None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.233181 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4c99-a1ad-4a2e-8fe3-82034e70d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.251515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ce2f4c99-a1ad-4a2e-8fe3-82034e70d86e None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:55.253595 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ce2f4c99-a1ad-4a2e-8fe3-82034e70d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:55.332214 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 204/405] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:55.364143 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4c99-a1ad-4a2e-8fe3-82034e70d86e None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:55.391013 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ca847-89eb-4e9e-a381-b94ec9b1f15e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:55.427429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddec91-273c-4a17-b51c-d0cf93f025d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:55.428644 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddec91-273c-4a17-b51c-d0cf93f025d9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.429144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddec91-273c-4a17-b51c-d0cf93f025d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.429632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddec91-273c-4a17-b51c-d0cf93f025d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.441264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddec91-273c-4a17-b51c-d0cf93f025d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-dcddec91-273c-4a17-b51c-d0cf93f025d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:55.449829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:55.450844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:55.451843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:55.455223 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 202/406] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:55.461193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddec91-273c-4a17-b51c-d0cf93f025d9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:55.467967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4c99-a1ad-4a2e-8fe3-82034e70d86e None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:55.503509 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72781b0-4394-405c-ac8b-30439cf73eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:55.504351 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72781b0-4394-405c-ac8b-30439cf73eed None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.504633 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72781b0-4394-405c-ac8b-30439cf73eed None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.504904 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72781b0-4394-405c-ac8b-30439cf73eed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.515537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72781b0-4394-405c-ac8b-30439cf73eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d72781b0-4394-405c-ac8b-30439cf73eed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:55.524765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:55.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:55.527151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 205/407] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:55.533374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72781b0-4394-405c-ac8b-30439cf73eed None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:55.594178 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddec91-273c-4a17-b51c-d0cf93f025d9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:55.640973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:55.642821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.643323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.643974 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.645408 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:55.646053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:55.647534 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72781b0-4394-405c-ac8b-30439cf73eed None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:55.648365 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:55.660620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 203/408] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:55.666782 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:55.689268 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:55.690315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.690812 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.691325 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.692354 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:55.692924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:55.694532 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:55.703606 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 206/409] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:55.712418 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:55.839453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186be7ab-6060-40aa-b58a-212b9f4c0133 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:55.881206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3939b27-6c73-4454-988a-1449eafbfd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:55.882088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939b27-6c73-4454-988a-1449eafbfd26 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:55.882372 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939b27-6c73-4454-988a-1449eafbfd26 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:55.882652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939b27-6c73-4454-988a-1449eafbfd26 None admin] PATH_INFO: `/v3/groups/034f575a549c49ed8896ee89258027ef` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:55.886096 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3939b27-6c73-4454-988a-1449eafbfd26 None admin] RBAC: Authorizing `identity:get_group(group_id=034f575a549c49ed8896ee89258027ef)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:55.887585 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3939b27-6c73-4454-988a-1449eafbfd26 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:55.891828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 204/410] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:55 2022] GET /identity/v3/groups/034f575a549c49ed8896ee89258027ef => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:55.897242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3939b27-6c73-4454-988a-1449eafbfd26 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:55.954550 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc001d83-e086-4f20-ade4-2d2652c30a01 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:56.003152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3939b27-6c73-4454-988a-1449eafbfd26 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:56.037660 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca10ec-3f5c-4c50-83f7-06baae9173ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:56.038521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca10ec-3f5c-4c50-83f7-06baae9173ee None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.038805 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca10ec-3f5c-4c50-83f7-06baae9173ee None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.039083 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca10ec-3f5c-4c50-83f7-06baae9173ee None admin] PATH_INFO: `/v3/projects/6755b8fadb0f418da6fcc341947da499` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca10ec-3f5c-4c50-83f7-06baae9173ee None admin] RBAC: Authorizing `identity:get_project(project_id=6755b8fadb0f418da6fcc341947da499)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:56.041776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca10ec-3f5c-4c50-83f7-06baae9173ee None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:56.043828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 205/411] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:55 2022] GET /identity/v3/projects/6755b8fadb0f418da6fcc341947da499 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:56.044499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fe41b-eb6d-4583-82a9-13dc4543e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:56.045440 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fe41b-eb6d-4583-82a9-13dc4543e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.045730 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fe41b-eb6d-4583-82a9-13dc4543e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.046009 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fe41b-eb6d-4583-82a9-13dc4543e6e5 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.047242 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fe41b-eb6d-4583-82a9-13dc4543e6e5 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:56.055808 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fe41b-eb6d-4583-82a9-13dc4543e6e5 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:56.055808 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 207/412] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:55 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:56.057035 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca10ec-3f5c-4c50-83f7-06baae9173ee None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:56.058237 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fe41b-eb6d-4583-82a9-13dc4543e6e5 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:56.191619 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca10ec-3f5c-4c50-83f7-06baae9173ee None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:56.194731 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fe41b-eb6d-4583-82a9-13dc4543e6e5 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:56.226584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1f01f-c2ad-4947-b8d8-2401f95e9cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:56.227467 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1f01f-c2ad-4947-b8d8-2401f95e9cb3 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.227757 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1f01f-c2ad-4947-b8d8-2401f95e9cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.228059 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1f01f-c2ad-4947-b8d8-2401f95e9cb3 None admin] PATH_INFO: `/v3/projects/6755b8fadb0f418da6fcc341947da499/groups/034f575a549c49ed8896ee89258027ef/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.230075 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1f01f-c2ad-4947-b8d8-2401f95e9cb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6755b8fadb0f418da6fcc341947da499, group_id=034f575a549c49ed8896ee89258027ef, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:56.230865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1b611-20f8-43c0-9c37-8f45e40bd3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:56.231541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1f01f-c2ad-4947-b8d8-2401f95e9cb3 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:56.232137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b611-20f8-43c0-9c37-8f45e40bd3ba None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.232581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b611-20f8-43c0-9c37-8f45e40bd3ba None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.233014 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1b611-20f8-43c0-9c37-8f45e40bd3ba None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.234380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1b611-20f8-43c0-9c37-8f45e40bd3ba None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:56.236853 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1b611-20f8-43c0-9c37-8f45e40bd3ba None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:56.243573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 208/413] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:56 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:56.243573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cd5f2-d071-4103-b9d7-532f399dbcaa None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.243573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cd5f2-d071-4103-b9d7-532f399dbcaa None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.243573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cd5f2-d071-4103-b9d7-532f399dbcaa None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.246764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 209/414] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:56.247570 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cd5f2-d071-4103-b9d7-532f399dbcaa None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:56.254992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 206/415] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:15:56 2022] PUT /identity/v3/projects/6755b8fadb0f418da6fcc341947da499/groups/034f575a549c49ed8896ee89258027ef/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:56.256650 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a5425-e154-4f35-94d2-4e934e03c081 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.257159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a5425-e154-4f35-94d2-4e934e03c081 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.257729 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a5425-e154-4f35-94d2-4e934e03c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.294164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-3b8a5425-e154-4f35-94d2-4e934e03c081 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:56.295826 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-3b8a5425-e154-4f35-94d2-4e934e03c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:56.437072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cd5f2-d071-4103-b9d7-532f399dbcaa None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:56.446830 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 207/416] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:56.474057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774449-81d0-4ac4-95a7-418609e06ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:56.475387 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774449-81d0-4ac4-95a7-418609e06ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.475922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774449-81d0-4ac4-95a7-418609e06ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.476413 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2774449-81d0-4ac4-95a7-418609e06ee6 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79/groups/b2b5eddd41df4270bcc77a58275a8f85/roles/db0e2f86b328428ba0dbfe6383deffce` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.479079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2774449-81d0-4ac4-95a7-418609e06ee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4cc0a347718443997a25150c537ff79, group_id=b2b5eddd41df4270bcc77a58275a8f85, role_id=db0e2f86b328428ba0dbfe6383deffce)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:56.480961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2774449-81d0-4ac4-95a7-418609e06ee6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:56.495652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a5425-e154-4f35-94d2-4e934e03c081 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:56.517150 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 210/417] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:15:56 2022] PUT /identity/v3/projects/c4cc0a347718443997a25150c537ff79/groups/b2b5eddd41df4270bcc77a58275a8f85/roles/db0e2f86b328428ba0dbfe6383deffce => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:15:56.625487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a5425-e154-4f35-94d2-4e934e03c081 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:56.665025 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf6d6d-cd9c-4cc8-8a79-6d81cd8b096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:56.665906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf6d6d-cd9c-4cc8-8a79-6d81cd8b096a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.666196 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf6d6d-cd9c-4cc8-8a79-6d81cd8b096a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.666528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf6d6d-cd9c-4cc8-8a79-6d81cd8b096a None admin] PATH_INFO: `/v3/roles/member` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.679333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf6d6d-cd9c-4cc8-8a79-6d81cd8b096a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-88bf6d6d-cd9c-4cc8-8a79-6d81cd8b096a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:56.687485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:56.688790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:56.689895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 208/418] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:56.695518 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774449-81d0-4ac4-95a7-418609e06ee6 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:56.803796 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2774449-81d0-4ac4-95a7-418609e06ee6 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:56.839369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:56.840130 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.840425 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.840705 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:56.841466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:56.841777 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:56.843155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:56.852595 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 211/419] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:56.858044 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf6d6d-cd9c-4cc8-8a79-6d81cd8b096a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:56.962939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf6d6d-cd9c-4cc8-8a79-6d81cd8b096a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:56.997650 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009481b-b01d-4196-b947-19e082b9ead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:56.998301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009481b-b01d-4196-b947-19e082b9ead7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:56.998585 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009481b-b01d-4196-b947-19e082b9ead7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:56.998867 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009481b-b01d-4196-b947-19e082b9ead7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:57.104747 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009481b-b01d-4196-b947-19e082b9ead7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:57.106149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009481b-b01d-4196-b947-19e082b9ead7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:57.252190 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 209/420] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:57.257397 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:57.396161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841e07-c887-4c7a-9ea4-f07ce14995b1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:57.431789 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64b744-448d-4fc9-9ce7-50430f16fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:57.432725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b744-448d-4fc9-9ce7-50430f16fb97 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:57.433010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b744-448d-4fc9-9ce7-50430f16fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:57.433289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b744-448d-4fc9-9ce7-50430f16fb97 None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:57.434542 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64b744-448d-4fc9-9ce7-50430f16fb97 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:57.436021 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64b744-448d-4fc9-9ce7-50430f16fb97 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:57.438256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 212/421] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:57 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:57.444396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009481b-b01d-4196-b947-19e082b9ead7 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:57.566801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009481b-b01d-4196-b947-19e082b9ead7 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:57.609076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8a3f6-559d-4c88-9fea-4228c12bd4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:57.609928 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a3f6-559d-4c88-9fea-4228c12bd4fa None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:57.610749 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a3f6-559d-4c88-9fea-4228c12bd4fa None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:57.611023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a3f6-559d-4c88-9fea-4228c12bd4fa None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:57.612244 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8a3f6-559d-4c88-9fea-4228c12bd4fa None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:57.613685 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8a3f6-559d-4c88-9fea-4228c12bd4fa None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:57.615711 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 210/422] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:57 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:57.621289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64b744-448d-4fc9-9ce7-50430f16fb97 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:57.762502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64b744-448d-4fc9-9ce7-50430f16fb97 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:57.799276 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac40f28-0122-472f-9013-ce33d90149b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:57.799979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40f28-0122-472f-9013-ce33d90149b2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:57.800266 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40f28-0122-472f-9013-ce33d90149b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:57.800546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac40f28-0122-472f-9013-ce33d90149b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:57.801398 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac40f28-0122-472f-9013-ce33d90149b2 None admin] RBAC: Adding query filter params (group.id=b2b5eddd41df4270bcc77a58275a8f85, role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=8ffbe1e0bdf144498702098bd867a307) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:57.801714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac40f28-0122-472f-9013-ce33d90149b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:57.803172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac40f28-0122-472f-9013-ce33d90149b2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:57.809819 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 213/423] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:15:57 2022] GET /identity/v3/role_assignments?group.id=b2b5eddd41df4270bcc77a58275a8f85&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:57.889134 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3d16-7b2a-4fcb-9c87-f64a1725899b None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:57.889812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3d16-7b2a-4fcb-9c87-f64a1725899b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:57.889812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3d16-7b2a-4fcb-9c87-f64a1725899b None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:57.892223 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 211/424] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:57.898556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cae55-2889-4df3-a64f-2cec25d70412 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:57.898884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cae55-2889-4df3-a64f-2cec25d70412 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:57.899109 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cae55-2889-4df3-a64f-2cec25d70412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:57.918697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-8c9cae55-2889-4df3-a64f-2cec25d70412 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:57.919958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-8c9cae55-2889-4df3-a64f-2cec25d70412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:58.004126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 214/425] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:58.007127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ce77-9d8f-41bf-a8b2-ba4709914f1f None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.007416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ce77-9d8f-41bf-a8b2-ba4709914f1f None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.007693 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7ce77-9d8f-41bf-a8b2-ba4709914f1f None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.009102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 212/426] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:58.015299 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41a01-91a4-4704-b3cc-59844d756564 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.015568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41a01-91a4-4704-b3cc-59844d756564 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.015788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd41a01-91a4-4704-b3cc-59844d756564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.033654 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ce77-9d8f-41bf-a8b2-ba4709914f1f None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.035421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-4fd41a01-91a4-4704-b3cc-59844d756564 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:58.036789 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-4fd41a01-91a4-4704-b3cc-59844d756564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:58.147942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 215/427] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:15:58.169987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7ce77-9d8f-41bf-a8b2-ba4709914f1f None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:58.176700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd41a01-91a4-4704-b3cc-59844d756564 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.216973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57be843-b834-4ece-9bf5-33675da9b86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:58.217956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be843-b834-4ece-9bf5-33675da9b86b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.218242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be843-b834-4ece-9bf5-33675da9b86b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.218567 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be843-b834-4ece-9bf5-33675da9b86b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.234680 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57be843-b834-4ece-9bf5-33675da9b86b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-b57be843-b834-4ece-9bf5-33675da9b86b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:58.245290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:58.247511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:15:58.249626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 213/428] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:58.259788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57be843-b834-4ece-9bf5-33675da9b86b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.303534 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd41a01-91a4-4704-b3cc-59844d756564 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:58.345398 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0cc4-6b9e-426c-b3c4-6862e555a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:58.346219 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0cc4-6b9e-426c-b3c4-6862e555a52f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.346502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0cc4-6b9e-426c-b3c4-6862e555a52f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.346776 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0cc4-6b9e-426c-b3c4-6862e555a52f None admin] PATH_INFO: `/v3/roles/member` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.358588 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d0cc4-6b9e-426c-b3c4-6862e555a52f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-c46d0cc4-6b9e-426c-b3c4-6862e555a52f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:58.367708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:58.369986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:58.371999 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 216/429] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:58.374917 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0cc4-6b9e-426c-b3c4-6862e555a52f None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.381706 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57be843-b834-4ece-9bf5-33675da9b86b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:58.440663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:58.442051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.442803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.443305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.444765 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:58.445264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:58.447096 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:58.457133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 214/430] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:58.464053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.492135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0cc4-6b9e-426c-b3c4-6862e555a52f None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:58.527363 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:58.528160 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.528537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.528895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.529805 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] RBAC: Adding query filter params (name=member) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:58.530190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:58.531694 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:58.541325 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 217/431] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:58.546906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.575555 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c0351-9528-4675-80fb-2796958f6004 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:58.614571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa165bb-3b0f-47c2-bf00-978cf940be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:58.615550 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa165bb-3b0f-47c2-bf00-978cf940be12 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.616045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa165bb-3b0f-47c2-bf00-978cf940be12 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.616530 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa165bb-3b0f-47c2-bf00-978cf940be12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.653635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b231-2618-4b7c-887d-88f51c822531 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:58.690848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2f4e0-23c2-4e58-af18-7ef11069a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:58.691629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2f4e0-23c2-4e58-af18-7ef11069a317 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.692009 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2f4e0-23c2-4e58-af18-7ef11069a317 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.692216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa165bb-3b0f-47c2-bf00-978cf940be12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:58.692393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2f4e0-23c2-4e58-af18-7ef11069a317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.694123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa165bb-3b0f-47c2-bf00-978cf940be12 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:58.764630 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2f4e0-23c2-4e58-af18-7ef11069a317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:58.766218 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2f4e0-23c2-4e58-af18-7ef11069a317 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:58.807323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 215/432] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:15:58.808993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa165bb-3b0f-47c2-bf00-978cf940be12 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.876189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 218/433] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:15:58.878268 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2f4e0-23c2-4e58-af18-7ef11069a317 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.919095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa165bb-3b0f-47c2-bf00-978cf940be12 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:58.956910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461f4d1-fa0c-4e08-83ce-e6947bcb666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:58.957887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f4d1-fa0c-4e08-83ce-e6947bcb666f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:58.958244 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f4d1-fa0c-4e08-83ce-e6947bcb666f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:58.958592 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f4d1-fa0c-4e08-83ce-e6947bcb666f None admin] PATH_INFO: `/v3/projects/8ffbe1e0bdf144498702098bd867a307` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:58.959919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461f4d1-fa0c-4e08-83ce-e6947bcb666f None admin] RBAC: Authorizing `identity:get_project(project_id=8ffbe1e0bdf144498702098bd867a307)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:58.961444 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461f4d1-fa0c-4e08-83ce-e6947bcb666f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:58.967974 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 216/434] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/projects/8ffbe1e0bdf144498702098bd867a307 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:58.970330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461f4d1-fa0c-4e08-83ce-e6947bcb666f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:58.986110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2f4e0-23c2-4e58-af18-7ef11069a317 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.023082 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c659a-c986-49ec-8f67-126d50f1e291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.024303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c659a-c986-49ec-8f67-126d50f1e291 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c659a-c986-49ec-8f67-126d50f1e291 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.025215 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c659a-c986-49ec-8f67-126d50f1e291 None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.026590 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c659a-c986-49ec-8f67-126d50f1e291 None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:59.028251 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c659a-c986-49ec-8f67-126d50f1e291 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:59.030632 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 219/435] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:59.036468 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c659a-c986-49ec-8f67-126d50f1e291 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:59.077709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461f4d1-fa0c-4e08-83ce-e6947bcb666f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.119747 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf763c-25c6-4202-bf8e-37e57be2e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.121075 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf763c-25c6-4202-bf8e-37e57be2e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.121075 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf763c-25c6-4202-bf8e-37e57be2e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.121266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf763c-25c6-4202-bf8e-37e57be2e1c2 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.122676 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf763c-25c6-4202-bf8e-37e57be2e1c2 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:59.124279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf763c-25c6-4202-bf8e-37e57be2e1c2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:59.131877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 217/436] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:58 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:59.133104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf763c-25c6-4202-bf8e-37e57be2e1c2 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:59.152198 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c659a-c986-49ec-8f67-126d50f1e291 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.188379 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b5100-cd03-4c88-99d0-5c029e55fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.189660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b5100-cd03-4c88-99d0-5c029e55fa40 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.190185 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b5100-cd03-4c88-99d0-5c029e55fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.190673 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b5100-cd03-4c88-99d0-5c029e55fa40 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.192156 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b5100-cd03-4c88-99d0-5c029e55fa40 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:59.193833 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b5100-cd03-4c88-99d0-5c029e55fa40 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:59.201162 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 220/437] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:15:59 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:15:59.202282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b5100-cd03-4c88-99d0-5c029e55fa40 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:59.237912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf763c-25c6-4202-bf8e-37e57be2e1c2 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.272418 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24796d5-57cf-4601-99f7-173bcfa244d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.273101 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24796d5-57cf-4601-99f7-173bcfa244d2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.273396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24796d5-57cf-4601-99f7-173bcfa244d2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.273677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24796d5-57cf-4601-99f7-173bcfa244d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.274520 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24796d5-57cf-4601-99f7-173bcfa244d2 None admin] RBAC: Adding query filter params (group.id=b2b5eddd41df4270bcc77a58275a8f85, role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=8ffbe1e0bdf144498702098bd867a307) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:59.274837 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24796d5-57cf-4601-99f7-173bcfa244d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:59.276359 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24796d5-57cf-4601-99f7-173bcfa244d2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:59.283182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 218/438] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:15:59 2022] GET /identity/v3/role_assignments?group.id=b2b5eddd41df4270bcc77a58275a8f85&scope.project.id=8ffbe1e0bdf144498702098bd867a307&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:59.302316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19522ac2-88a3-4a1b-82f7-63aa3280d3c3 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.303004 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19522ac2-88a3-4a1b-82f7-63aa3280d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.303491 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19522ac2-88a3-4a1b-82f7-63aa3280d3c3 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.305747 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 219/439] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:15:59.311812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002201-0a25-4816-ad2c-ca47a3a3da5f None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.312178 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002201-0a25-4816-ad2c-ca47a3a3da5f None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.312405 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002201-0a25-4816-ad2c-ca47a3a3da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.315197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b5100-cd03-4c88-99d0-5c029e55fa40 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.331479 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-86002201-0a25-4816-ad2c-ca47a3a3da5f None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:59.332767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-86002201-0a25-4816-ad2c-ca47a3a3da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:59.355040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.355757 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.356046 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.356325 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.357183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] RBAC: Adding query filter params (group.id=b2b5eddd41df4270bcc77a58275a8f85, role.id=d93601b75fd74dcf89b2cee3d7541f90, scope.project.id=c4cc0a347718443997a25150c537ff79) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:59.357498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:59.358998 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:59.371990 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 221/440] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:15:59 2022] GET /identity/v3/role_assignments?group.id=b2b5eddd41df4270bcc77a58275a8f85&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=d93601b75fd74dcf89b2cee3d7541f90 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:59.415543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 220/441] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:59.441844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:59.507444 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174894c3-4d68-48fb-99bc-524a9ce85071 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.507930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174894c3-4d68-48fb-99bc-524a9ce85071 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.508314 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174894c3-4d68-48fb-99bc-524a9ce85071 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.509963 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 221/442] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:15:59.518320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf628-c6b6-4fe3-ba18-4b5bc1a209fe None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.519477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf628-c6b6-4fe3-ba18-4b5bc1a209fe None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.519960 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebf628-c6b6-4fe3-ba18-4b5bc1a209fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.542479 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-c0ebf628-c6b6-4fe3-ba18-4b5bc1a209fe None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:15:59.543886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-c0ebf628-c6b6-4fe3-ba18-4b5bc1a209fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:15:59.567692 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3022b-d3e0-4d3b-9740-33dfa58b483a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.617181 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7106c-45ff-47c5-b1d5-4a0288659888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.617990 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7106c-45ff-47c5-b1d5-4a0288659888 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.618269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7106c-45ff-47c5-b1d5-4a0288659888 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.618666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7106c-45ff-47c5-b1d5-4a0288659888 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.632616 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7106c-45ff-47c5-b1d5-4a0288659888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:59.640016 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 222/443] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-06e7106c-45ff-47c5-b1d5-4a0288659888 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:59.641362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:59.642400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:15:59.643298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:59.647413 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 222/444] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:15:59.648703 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf628-c6b6-4fe3-ba18-4b5bc1a209fe None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:59.664299 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7106c-45ff-47c5-b1d5-4a0288659888 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:59.764292 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebf628-c6b6-4fe3-ba18-4b5bc1a209fe None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.776206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7106c-45ff-47c5-b1d5-4a0288659888 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.805544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.806323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.806615 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.806892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.807654 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:59.808566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:59.809395 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:59.814659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b446a6-7067-435e-bde5-218e32bb9e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.815560 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b446a6-7067-435e-bde5-218e32bb9e50 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.815942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b446a6-7067-435e-bde5-218e32bb9e50 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.816309 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b446a6-7067-435e-bde5-218e32bb9e50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.818291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 223/445] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:15:59.824056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:59.832141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b446a6-7067-435e-bde5-218e32bb9e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b2b446a6-7067-435e-bde5-218e32bb9e50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:15:59.840404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:15:59.841519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:15:59.842416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 223/446] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:15:59.849696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b446a6-7067-435e-bde5-218e32bb9e50 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:15:59.933004 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff32f03-72e4-41ce-851a-ba9fc835d555 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.954040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b446a6-7067-435e-bde5-218e32bb9e50 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:15:59.966172 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b862c-55ab-4af0-b37b-179cbf246e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.966788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b862c-55ab-4af0-b37b-179cbf246e39 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.967067 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b862c-55ab-4af0-b37b-179cbf246e39 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.967340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b862c-55ab-4af0-b37b-179cbf246e39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.987540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:15:59.988247 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:15:59.988535 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:15:59.988817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:15:59.989566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:15:59.989877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:15:59.991253 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:15:59.998888 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 224/447] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:15:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:00.004545 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:00.034310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b862c-55ab-4af0-b37b-179cbf246e39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:00.035681 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b862c-55ab-4af0-b37b-179cbf246e39 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:00.099261 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07aabe-04d2-488f-aef1-385e0510d7e8 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:00.129345 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 224/448] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:16:00.132694 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e223-c3eb-4cc1-8dfd-49eb40425299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:00.133353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e223-c3eb-4cc1-8dfd-49eb40425299 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:00.133645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e223-c3eb-4cc1-8dfd-49eb40425299 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:00.133926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e223-c3eb-4cc1-8dfd-49eb40425299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:00.134924 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b862c-55ab-4af0-b37b-179cbf246e39 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:00.202037 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587e223-c3eb-4cc1-8dfd-49eb40425299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:00.203507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587e223-c3eb-4cc1-8dfd-49eb40425299 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:00.228299 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b862c-55ab-4af0-b37b-179cbf246e39 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:00.260182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199385f5-7160-4154-ad52-38c29b2e4fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:00.261013 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199385f5-7160-4154-ad52-38c29b2e4fe2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:00.261289 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199385f5-7160-4154-ad52-38c29b2e4fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:00.261557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199385f5-7160-4154-ad52-38c29b2e4fe2 None admin] PATH_INFO: `/v3/projects/6755b8fadb0f418da6fcc341947da499` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:00.262722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199385f5-7160-4154-ad52-38c29b2e4fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=6755b8fadb0f418da6fcc341947da499)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:00.264168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199385f5-7160-4154-ad52-38c29b2e4fe2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:00.265831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 225/449] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:16:00 2022] GET /identity/v3/projects/6755b8fadb0f418da6fcc341947da499 => generated 344 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:00.271916 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199385f5-7160-4154-ad52-38c29b2e4fe2 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:00.297554 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 225/450] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:16:00.303105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e223-c3eb-4cc1-8dfd-49eb40425299 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:00.365716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199385f5-7160-4154-ad52-38c29b2e4fe2 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:00.395149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e223-c3eb-4cc1-8dfd-49eb40425299 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:00.397759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0a331-693b-4b70-9101-87f59ffab087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:00.398592 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a331-693b-4b70-9101-87f59ffab087 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:00.398874 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a331-693b-4b70-9101-87f59ffab087 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:00.399144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0a331-693b-4b70-9101-87f59ffab087 None admin] PATH_INFO: `/v3/groups/034f575a549c49ed8896ee89258027ef` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:00.400349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0a331-693b-4b70-9101-87f59ffab087 None admin] RBAC: Authorizing `identity:get_group(group_id=034f575a549c49ed8896ee89258027ef)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:00.401782 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0a331-693b-4b70-9101-87f59ffab087 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:00.403400 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 226/451] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:16:00 2022] GET /identity/v3/groups/034f575a549c49ed8896ee89258027ef => generated 229 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:00.409233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0a331-693b-4b70-9101-87f59ffab087 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:00.427304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b4bc-9866-472c-91b3-0af559138a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:00.428185 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b4bc-9866-472c-91b3-0af559138a3e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:00.428462 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b4bc-9866-472c-91b3-0af559138a3e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:00.428729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71b4bc-9866-472c-91b3-0af559138a3e None admin] PATH_INFO: `/v3/projects/c4cc0a347718443997a25150c537ff79` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:00.429897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71b4bc-9866-472c-91b3-0af559138a3e None admin] RBAC: Authorizing `identity:get_project(project_id=c4cc0a347718443997a25150c537ff79)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:00.431314 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71b4bc-9866-472c-91b3-0af559138a3e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:00.433038 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 226/452] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:16:00 2022] GET /identity/v3/projects/c4cc0a347718443997a25150c537ff79 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:00.438990 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b4bc-9866-472c-91b3-0af559138a3e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:00.504109 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0a331-693b-4b70-9101-87f59ffab087 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:00.536026 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:00.536674 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:00.536955 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:00.537232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:00.538062 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] RBAC: Adding query filter params (group.id=034f575a549c49ed8896ee89258027ef, role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=6755b8fadb0f418da6fcc341947da499) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:00.538372 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:00.539808 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:00.545415 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 227/453] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:16:00 2022] GET /identity/v3/role_assignments?group.id=034f575a549c49ed8896ee89258027ef&scope.project.id=6755b8fadb0f418da6fcc341947da499&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:00.548416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71b4bc-9866-472c-91b3-0af559138a3e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:00.586014 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f35c5-9e17-4dbb-adc9-288b49db36c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:00.586895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f35c5-9e17-4dbb-adc9-288b49db36c2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:00.587178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f35c5-9e17-4dbb-adc9-288b49db36c2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:00.587450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f35c5-9e17-4dbb-adc9-288b49db36c2 None admin] PATH_INFO: `/v3/groups/b2b5eddd41df4270bcc77a58275a8f85` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:00.588737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f35c5-9e17-4dbb-adc9-288b49db36c2 None admin] RBAC: Authorizing `identity:get_group(group_id=b2b5eddd41df4270bcc77a58275a8f85)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:00.590218 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f35c5-9e17-4dbb-adc9-288b49db36c2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:00.591929 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 227/454] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:16:00 2022] GET /identity/v3/groups/b2b5eddd41df4270bcc77a58275a8f85 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:00.598310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:00.701822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e715b34-724b-4b6d-8a45-d1c8fd7c57d6 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:00.736827 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9f682-c3a7-4e64-8ce1-f1977c733ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:00.737478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9f682-c3a7-4e64-8ce1-f1977c733ecb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:00.737764 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9f682-c3a7-4e64-8ce1-f1977c733ecb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:00.738043 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9f682-c3a7-4e64-8ce1-f1977c733ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:00.738881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9f682-c3a7-4e64-8ce1-f1977c733ecb None admin] RBAC: Adding query filter params (group.id=b2b5eddd41df4270bcc77a58275a8f85, role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=c4cc0a347718443997a25150c537ff79) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:00.739194 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9f682-c3a7-4e64-8ce1-f1977c733ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:00.740648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9f682-c3a7-4e64-8ce1-f1977c733ecb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:00.746480 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 228/455] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:16:00 2022] GET /identity/v3/role_assignments?group.id=b2b5eddd41df4270bcc77a58275a8f85&scope.project.id=c4cc0a347718443997a25150c537ff79&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:03.631271 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52486d4b-3139-4dac-9816-70400c270938 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:03.631870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52486d4b-3139-4dac-9816-70400c270938 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:03.631870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52486d4b-3139-4dac-9816-70400c270938 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:03.633501 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 228/456] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:03.639031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a1d4-9c49-46bf-8e32-62e7e7aa3535 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:03.639498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a1d4-9c49-46bf-8e32-62e7e7aa3535 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:03.639598 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21a1d4-9c49-46bf-8e32-62e7e7aa3535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:03.657765 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-6f21a1d4-9c49-46bf-8e32-62e7e7aa3535 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:03.658986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-6f21a1d4-9c49-46bf-8e32-62e7e7aa3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:03.728189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 229/457] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:03.753272 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52486d4b-3139-4dac-9816-70400c270938 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:03.884573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52486d4b-3139-4dac-9816-70400c270938 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:03.937241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:03.938105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:03.938387 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:03.938623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:03.949861 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:03.951378 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:03.973275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac1c8-04e3-412f-9116-0b7464c5374d None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:03.973702 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac1c8-04e3-412f-9116-0b7464c5374d None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:03.973967 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdac1c8-04e3-412f-9116-0b7464c5374d None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:03.975170 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 230/458] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:03.977729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:03.981079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:03.985097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:03.985097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:03.985097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:03.985097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:03.985097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 229/459] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:03.986316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec5d18-566d-49aa-958c-ba32ef6ec472 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:03.986316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec5d18-566d-49aa-958c-ba32ef6ec472 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:03.986316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec5d18-566d-49aa-958c-ba32ef6ec472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:03.986987 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:04.015279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-62ec5d18-566d-49aa-958c-ba32ef6ec472 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:04.017315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-62ec5d18-566d-49aa-958c-ba32ef6ec472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:04.087250 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 231/460] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:04.088407 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b101e-d14d-4f98-ac7f-d197cc28ce53 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.088698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b101e-d14d-4f98-ac7f-d197cc28ce53 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.088980 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b101e-d14d-4f98-ac7f-d197cc28ce53 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.095792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 232/461] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:04.105177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049ccd1-e31e-410d-b809-cdc8c175eeba None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.105522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049ccd1-e31e-410d-b809-cdc8c175eeba None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.105780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049ccd1-e31e-410d-b809-cdc8c175eeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.126779 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-b049ccd1-e31e-410d-b809-cdc8c175eeba None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:04.128002 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-b049ccd1-e31e-410d-b809-cdc8c175eeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:04.145829 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feae02-3bc5-413a-8b98-c94cdcbd299b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:04.180950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:04.181433 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.181708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.182040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.182703 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:04.183011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:04.184425 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:04.197587 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 230/462] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:04.198431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:04.213071 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 233/463] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:04.214594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049ccd1-e31e-410d-b809-cdc8c175eeba None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:04.298717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19967-d81d-4e9c-8f84-c6d84f9dc4a0 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:04.320449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049ccd1-e31e-410d-b809-cdc8c175eeba None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:04.333357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:04.334148 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.334408 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.334697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.345123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:04.346579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:04.355051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee265-fee4-41a3-a867-f48d81c301ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:04.355711 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee265-fee4-41a3-a867-f48d81c301ca None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.356022 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee265-fee4-41a3-a867-f48d81c301ca None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.356271 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee265-fee4-41a3-a867-f48d81c301ca None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.356953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bee265-fee4-41a3-a867-f48d81c301ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:04.358377 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bee265-fee4-41a3-a867-f48d81c301ca None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:04.365436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:04.369110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:04.373392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:04.373392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:04.373392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:04.373392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:04.373392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 231/464] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:04.373392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:04.385352 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 234/465] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:16:04 2022] POST /identity/v3/users => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:04.388443 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee265-fee4-41a3-a867-f48d81c301ca None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:04.479179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2e323-3810-42ed-b1be-efc18dffac1a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:04.515092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:04.516496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.516782 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.517034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.527474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:04.528995 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:04.549139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:04.552635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:04.556184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:04.556184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:04.556184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:04.556184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:04.556184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 232/466] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:04.564864 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee265-fee4-41a3-a867-f48d81c301ca None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:04.565137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:04.599701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:04.600422 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.600706 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.600967 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.601716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:04.602024 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:04.603426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:04.624418 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 235/467] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:04.632530 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:04.780256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1320cd1-8d7a-4a01-beaf-6bf202a58484 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:04.817864 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f873ba-8e7f-4149-9163-95cfed038696 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:04.818762 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:04.819638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.820116 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.820553 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.821827 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:04.822292 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:04.823887 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:04.836972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 233/468] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:04.844020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:04.858520 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875f44c-ab64-48e4-9f02-8db52debaf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:04.859497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875f44c-ab64-48e4-9f02-8db52debaf77 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.860564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875f44c-ab64-48e4-9f02-8db52debaf77 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.860940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875f44c-ab64-48e4-9f02-8db52debaf77 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.861782 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875f44c-ab64-48e4-9f02-8db52debaf77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:04.863290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875f44c-ab64-48e4-9f02-8db52debaf77 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:04.890294 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 236/469] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:16:04 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:04.892427 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2df68-968a-4f50-82b9-5eff9dff6209 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.892719 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2df68-968a-4f50-82b9-5eff9dff6209 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.893000 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2df68-968a-4f50-82b9-5eff9dff6209 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.894550 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 237/470] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:04.900105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7560e54-c54a-4d50-a07b-e95b0ffd67e2 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:04.900398 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7560e54-c54a-4d50-a07b-e95b0ffd67e2 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:04.900678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7560e54-c54a-4d50-a07b-e95b0ffd67e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:04.928943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-c7560e54-c54a-4d50-a07b-e95b0ffd67e2 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:04.930190 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-c7560e54-c54a-4d50-a07b-e95b0ffd67e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:05.004898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03917e3-716a-4e6d-998f-f39e6f62bbf7 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:05.069997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 238/471] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:05.083264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545900-b481-4650-90fb-dff3e9d2113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:05.083992 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545900-b481-4650-90fb-dff3e9d2113d None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:05.084280 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545900-b481-4650-90fb-dff3e9d2113d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:05.084568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545900-b481-4650-90fb-dff3e9d2113d None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:05.085302 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89545900-b481-4650-90fb-dff3e9d2113d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:05.086790 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89545900-b481-4650-90fb-dff3e9d2113d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:05.095417 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7560e54-c54a-4d50-a07b-e95b0ffd67e2 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:05.128032 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 234/472] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:16:04 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:05.217949 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7560e54-c54a-4d50-a07b-e95b0ffd67e2 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:05.258320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1632f-6ff8-4d22-b1ca-7bde62d4cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:05.259563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1632f-6ff8-4d22-b1ca-7bde62d4cc87 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:05.260115 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1632f-6ff8-4d22-b1ca-7bde62d4cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:05.260624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1632f-6ff8-4d22-b1ca-7bde62d4cc87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:05.273936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1632f-6ff8-4d22-b1ca-7bde62d4cc87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:05.276055 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1632f-6ff8-4d22-b1ca-7bde62d4cc87 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-f4f1632f-6ff8-4d22-b1ca-7bde62d4cc87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:05.298612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:05.299668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:05.300718 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:05.300718 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:05.300718 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:05.300718 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:05.303223 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 239/473] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:05.309062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545900-b481-4650-90fb-dff3e9d2113d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:05.434839 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545900-b481-4650-90fb-dff3e9d2113d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:05.469766 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:05.470434 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:05.470715 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:05.470987 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:05.471715 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:05.472048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:05.473422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:05.481832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488ad36-d657-433e-ab27-d520373e0893 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:05.481832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488ad36-d657-433e-ab27-d520373e0893 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:05.481832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488ad36-d657-433e-ab27-d520373e0893 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:05.481832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 240/474] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:05.489225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84997bee-d6b4-4523-95e8-96fc320e2c07 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:05.489576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84997bee-d6b4-4523-95e8-96fc320e2c07 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:05.489854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84997bee-d6b4-4523-95e8-96fc320e2c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:05.492384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 235/475] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:05.506157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:05.511362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-84997bee-d6b4-4523-95e8-96fc320e2c07 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:05.512586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-84997bee-d6b4-4523-95e8-96fc320e2c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:05.596402 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 241/476] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:16:05.616239 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84997bee-d6b4-4523-95e8-96fc320e2c07 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:05.624257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03727f54-5eee-4211-bc7f-0a230c1ade43 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:05.662401 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f558-cfaf-4b86-ac2e-a107bb5e1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:05.663125 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f558-cfaf-4b86-ac2e-a107bb5e1e8d None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:05.663409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f558-cfaf-4b86-ac2e-a107bb5e1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:05.663680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f558-cfaf-4b86-ac2e-a107bb5e1e8d None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:05.664426 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8f558-cfaf-4b86-ac2e-a107bb5e1e8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:05.665868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8f558-cfaf-4b86-ac2e-a107bb5e1e8d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:05.715080 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 236/477] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:16:05 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:16:05.721040 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84997bee-d6b4-4523-95e8-96fc320e2c07 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:05.759113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:05.759805 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:05.760085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:05.760361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:05.761128 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:05.762511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:05.775809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.sql.core [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:16:05.775809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:16:05.775809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [parameters: {'id': 'eb4b4dd0e1e243e48d39507dcd03cee5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:16:05.775809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143187) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application conn.query(q) May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application result.read() May 09 15:16:05.797993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return ref.to_dict() May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:16:05.799149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application next(self.gen) May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application yield resource May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application next(self.gen) May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise self.value May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application session.commit() May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:16:05.800227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.session.flush() May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application compat.raise_( May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:16:05.801225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:16:05.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application conn.query(q) May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application result.read() May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:16:05.806139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [parameters: {'id': 'eb4b4dd0e1e243e48d39507dcd03cee5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:05.808275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:16:05.814624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:05.816862 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 242/478] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:16:05 2022] POST /identity/v3/roles => generated 144 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:05.817011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f558-cfaf-4b86-ac2e-a107bb5e1e8d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:05.935641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f558-cfaf-4b86-ac2e-a107bb5e1e8d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:05.979245 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4288451-8402-4aed-95a4-d9cdefde765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:05.980067 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288451-8402-4aed-95a4-d9cdefde765e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:05.980356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288451-8402-4aed-95a4-d9cdefde765e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:05.980634 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288451-8402-4aed-95a4-d9cdefde765e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:05.993067 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4288451-8402-4aed-95a4-d9cdefde765e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f4288451-8402-4aed-95a4-d9cdefde765e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:06.002770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:06.004004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:06.005068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 237/479] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:06.011154 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:06.120918 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ca397-c5fc-4f22-b2e9-2e954c84ded0 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:06.157425 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b488d-ec08-4ddd-aa75-3f5eab21cf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:06.158155 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b488d-ec08-4ddd-aa75-3f5eab21cf01 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:06.158440 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b488d-ec08-4ddd-aa75-3f5eab21cf01 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:06.158713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b488d-ec08-4ddd-aa75-3f5eab21cf01 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:06.159471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b488d-ec08-4ddd-aa75-3f5eab21cf01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:06.159785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b488d-ec08-4ddd-aa75-3f5eab21cf01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:06.161241 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b488d-ec08-4ddd-aa75-3f5eab21cf01 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:06.175911 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 243/480] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:07.404011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e8191-911c-4d91-90dc-8132a9156d8e None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:07.404766 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e8191-911c-4d91-90dc-8132a9156d8e None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:07.404766 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e8191-911c-4d91-90dc-8132a9156d8e None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:07.405904 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 238/481] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:07.412109 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9ca7-c6bf-4bd2-beaa-d62f693db5b7 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:07.412668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9ca7-c6bf-4bd2-beaa-d62f693db5b7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:07.412668 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f9ca7-c6bf-4bd2-beaa-d62f693db5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:07.433111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-f11f9ca7-c6bf-4bd2-beaa-d62f693db5b7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:07.434293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-f11f9ca7-c6bf-4bd2-beaa-d62f693db5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:07.528228 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 244/482] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:07.564857 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e8191-911c-4d91-90dc-8132a9156d8e None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:07.691086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e8191-911c-4d91-90dc-8132a9156d8e None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:07.735929 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bd771-dfca-4086-b773-4887a8583cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:07.736738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd771-dfca-4086-b773-4887a8583cf7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:07.737059 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd771-dfca-4086-b773-4887a8583cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:07.737324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bd771-dfca-4086-b773-4887a8583cf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:07.753242 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bd771-dfca-4086-b773-4887a8583cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f97bd771-dfca-4086-b773-4887a8583cf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:07.761025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:07.763273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:07.765400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 239/483] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:07.771788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f9ca7-c6bf-4bd2-beaa-d62f693db5b7 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:07.841921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3d820-68b2-4a45-b9da-e1f83e79cae8 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:07.842271 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3d820-68b2-4a45-b9da-e1f83e79cae8 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:07.842466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3d820-68b2-4a45-b9da-e1f83e79cae8 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:07.844200 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 240/484] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:16:07.849876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b01c94-57c3-4817-886e-2c798bb53eef None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:07.850454 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b01c94-57c3-4817-886e-2c798bb53eef None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:07.850959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b01c94-57c3-4817-886e-2c798bb53eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:07.868383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-a4b01c94-57c3-4817-886e-2c798bb53eef None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:07.870022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-a4b01c94-57c3-4817-886e-2c798bb53eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:07.918381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f9ca7-c6bf-4bd2-beaa-d62f693db5b7 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:07.977888 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 241/485] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:07.986690 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:07.987635 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:07.988186 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:07.988701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:07.989671 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:07.990189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:07.991793 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:08.003739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 245/486] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:08.009611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b01c94-57c3-4817-886e-2c798bb53eef None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.062503 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.178015 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b01c94-57c3-4817-886e-2c798bb53eef None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.227191 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccb2b6-38db-4142-99f5-c88eee491c25 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.248905 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.249657 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.249939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.250733 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.263700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636771e-26f4-466a-a042-6751d24d4896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.264890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636771e-26f4-466a-a042-6751d24d4896 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.265408 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636771e-26f4-466a-a042-6751d24d4896 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.266499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636771e-26f4-466a-a042-6751d24d4896 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.267182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:08.268692 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:08.278049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636771e-26f4-466a-a042-6751d24d4896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-f636771e-26f4-466a-a042-6751d24d4896 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:08.286519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:08.287531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:08.288487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:08.291262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 246/487] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:08.295882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:08.296854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:08.298308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:08.298308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:08.298308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:08.298308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:08.298308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 242/488] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:08.300301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636771e-26f4-466a-a042-6751d24d4896 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.300511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.404963 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636771e-26f4-466a-a042-6751d24d4896 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.419980 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c143c4-1393-469c-9c56-357f1f8cc16e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.441493 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c05ea-809b-4294-8c45-92e6b962a71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.442840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c05ea-809b-4294-8c45-92e6b962a71b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.443363 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c05ea-809b-4294-8c45-92e6b962a71b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.443906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c05ea-809b-4294-8c45-92e6b962a71b None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.444901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c05ea-809b-4294-8c45-92e6b962a71b None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:08.445422 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c05ea-809b-4294-8c45-92e6b962a71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:08.447259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c05ea-809b-4294-8c45-92e6b962a71b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:08.454268 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d632-25bc-4c6f-8a8c-7d1a401f053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.455157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d632-25bc-4c6f-8a8c-7d1a401f053b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.455657 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d632-25bc-4c6f-8a8c-7d1a401f053b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.456120 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d632-25bc-4c6f-8a8c-7d1a401f053b None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.457064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d632-25bc-4c6f-8a8c-7d1a401f053b None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:08.457511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d632-25bc-4c6f-8a8c-7d1a401f053b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:08.459102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d632-25bc-4c6f-8a8c-7d1a401f053b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:08.461323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 247/489] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:08.462774 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e67ae-2d49-4853-a15b-021c1ba60387 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.463168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e67ae-2d49-4853-a15b-021c1ba60387 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.463548 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e67ae-2d49-4853-a15b-021c1ba60387 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.465307 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 248/490] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:08.466107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e67ae-2d49-4853-a15b-021c1ba60387 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.473918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 243/491] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:08.480113 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185a2f-de7b-4e51-9536-d1845e81c572 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.480641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185a2f-de7b-4e51-9536-d1845e81c572 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.481068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185a2f-de7b-4e51-9536-d1845e81c572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.502324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-5e185a2f-de7b-4e51-9536-d1845e81c572 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:08.503973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-5e185a2f-de7b-4e51-9536-d1845e81c572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:08.581861 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e67ae-2d49-4853-a15b-021c1ba60387 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.595906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 244/492] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:08.597162 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e185a2f-de7b-4e51-9536-d1845e81c572 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.625201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.626331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.626617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.626892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.640446 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:08.642877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:08.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:08.667020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:08.668122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:08.668122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:08.668122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:08.668122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:08.668122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 249/493] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:08.673482 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.706921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e185a2f-de7b-4e51-9536-d1845e81c572 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.742109 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.743192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.744125 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] PATH_INFO: `/v3/users/nova` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.752568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:08.754260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:08.771296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:08.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:08.773968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:08.774627 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5ee8e-3dc1-495f-84cf-217546095a8b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.776372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 245/494] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:08.777424 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.812016 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d1909-0c05-464d-a91f-344d6e9cede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.813589 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1909-0c05-464d-a91f-344d6e9cede4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.813894 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1909-0c05-464d-a91f-344d6e9cede4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.814174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d1909-0c05-464d-a91f-344d6e9cede4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.825678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d1909-0c05-464d-a91f-344d6e9cede4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-704d1909-0c05-464d-a91f-344d6e9cede4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:08.833773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:08.834803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:08.835714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 250/495] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:08.837011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfb876-d6a5-494e-9e42-8f934a153ff3 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.837011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfb876-d6a5-494e-9e42-8f934a153ff3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.837011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfb876-d6a5-494e-9e42-8f934a153ff3 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.842343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 251/496] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:08.842343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfb876-d6a5-494e-9e42-8f934a153ff3 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.885920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a62489-db2a-4626-bb7a-e26e883f2dac None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.923593 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.924293 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.924570 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.924841 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:08.925571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:08.925876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:08.927250 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:08.938250 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 246/497] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:08.939063 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:08.962941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfb876-d6a5-494e-9e42-8f934a153ff3 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:08.997934 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f753a6-88db-40b2-b70e-592b728128f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:08.998606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f753a6-88db-40b2-b70e-592b728128f3 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:08.998892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f753a6-88db-40b2-b70e-592b728128f3 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:08.999174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f753a6-88db-40b2-b70e-592b728128f3 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.000546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f753a6-88db-40b2-b70e-592b728128f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:09.000887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f753a6-88db-40b2-b70e-592b728128f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.002376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f753a6-88db-40b2-b70e-592b728128f3 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.044107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 252/498] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:09.044107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdad2c-8a41-4f9b-85c1-ae95d30ceb8a None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.044107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdad2c-8a41-4f9b-85c1-ae95d30ceb8a None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.044107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bdad2c-8a41-4f9b-85c1-ae95d30ceb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.048252 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde0f7-90c7-4bae-8b2f-8573bab9fb1f None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.058478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-18bdad2c-8a41-4f9b-85c1-ae95d30ceb8a None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:09.059652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-18bdad2c-8a41-4f9b-85c1-ae95d30ceb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:09.081964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.082630 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.082909 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.083188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.083963 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] RBAC: Adding query filter params (name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:09.084269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.085632 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.093441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 247/499] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:09.095437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.132113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 253/500] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:09.132982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdad2c-8a41-4f9b-85c1-ae95d30ceb8a None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.190880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fdd02-a6b6-4ddb-9f9f-d556d189ea82 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.222907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195819a-3187-45ce-acc8-57006fc5eab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.223699 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195819a-3187-45ce-acc8-57006fc5eab6 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.224008 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195819a-3187-45ce-acc8-57006fc5eab6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.224285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195819a-3187-45ce-acc8-57006fc5eab6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.228996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bdad2c-8a41-4f9b-85c1-ae95d30ceb8a None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.231491 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195819a-3187-45ce-acc8-57006fc5eab6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.232958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195819a-3187-45ce-acc8-57006fc5eab6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-0195819a-3187-45ce-acc8-57006fc5eab6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:09.247507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:09.248758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 248/501] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed658-2a5c-46a5-900c-e9985065e4db None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.250494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed658-2a5c-46a5-900c-e9985065e4db None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.251289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed658-2a5c-46a5-900c-e9985065e4db None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.252065 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 249/502] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:09.252787 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ed658-2a5c-46a5-900c-e9985065e4db None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.264936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6186371-a550-40ae-a93a-0d5842689fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.265590 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6186371-a550-40ae-a93a-0d5842689fdd None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.265925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6186371-a550-40ae-a93a-0d5842689fdd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.266212 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6186371-a550-40ae-a93a-0d5842689fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.331207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6186371-a550-40ae-a93a-0d5842689fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.332629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6186371-a550-40ae-a93a-0d5842689fdd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.350820 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ed658-2a5c-46a5-900c-e9985065e4db None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.382092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.382868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.383153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.383431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.394314 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.395774 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:09.413055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:09.414186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:09.415138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:09.415138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:09.415138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:09.415138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:09.415138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 250/503] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:09.415452 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.430999 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 254/504] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:09.431864 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6186371-a550-40ae-a93a-0d5842689fdd None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.509801 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e6f62-4117-4f35-98bb-9f974fdd2e1d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.526241 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6186371-a550-40ae-a93a-0d5842689fdd None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.541111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2cf84-79ae-48bf-bd92-afe230bb7c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.541898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2cf84-79ae-48bf-bd92-afe230bb7c4b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.542183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2cf84-79ae-48bf-bd92-afe230bb7c4b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.542459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2cf84-79ae-48bf-bd92-afe230bb7c4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.552753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2cf84-79ae-48bf-bd92-afe230bb7c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:09.559625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.560306 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-bad2cf84-79ae-48bf-bd92-afe230bb7c4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:09.560547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:09.561690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:09.562644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:09.564060 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.564060 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.564060 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:09.564296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 251/505] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:09.564408 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.564486 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e5abe-b8b2-44b0-92b1-c922dfb8cc5d None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.564486 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e5abe-b8b2-44b0-92b1-c922dfb8cc5d None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.564486 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e5abe-b8b2-44b0-92b1-c922dfb8cc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.564685 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.582169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 255/506] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:09.582825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-4f6e5abe-b8b2-44b0-92b1-c922dfb8cc5d None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:09.582957 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.584158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-4f6e5abe-b8b2-44b0-92b1-c922dfb8cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:09.648157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 252/507] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:09.648995 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e5abe-b8b2-44b0-92b1-c922dfb8cc5d None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.680957 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e559cb-a318-4a43-ae35-fc2614f712a4 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.713716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.714362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.714648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.714923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.715645 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:09.715978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.717344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.728630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 256/508] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:09.729411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.744424 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e5abe-b8b2-44b0-92b1-c922dfb8cc5d None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.776524 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.777309 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.777592 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.777865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.788048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.789501 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:09.806936 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:09.808192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:09.809254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:09.809254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:09.809254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:09.809254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:09.813586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 253/509] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:09.813586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.824764 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9218a8-29d1-4ab2-9494-3c5055f7eca4 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.857110 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.857704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.857983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.858257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.858999 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:09.859302 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:09.860751 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:09.868354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 257/510] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:09.869128 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:09.909187 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2120c27-2842-473e-ab6a-53c6de96f141 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.941383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97810f6b-3fb5-4972-9a85-57ac9b258ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.942029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97810f6b-3fb5-4972-9a85-57ac9b258ec4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.942313 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97810f6b-3fb5-4972-9a85-57ac9b258ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.942590 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97810f6b-3fb5-4972-9a85-57ac9b258ec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:09.963343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8eb77-1065-462f-9922-77ea8a4be7df None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:09.994679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:09.995460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:09.995742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:09.996053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.006559 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.007678 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97810f6b-3fb5-4972-9a85-57ac9b258ec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.008069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.009150 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97810f6b-3fb5-4972-9a85-57ac9b258ec4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:10.024982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:10.026111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:10.027072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:10.027072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:10.027072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:10.027072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:10.027072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 258/511] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:10.027383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.111210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 254/512] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:10.111991 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97810f6b-3fb5-4972-9a85-57ac9b258ec4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.124793 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eedf1-eab2-4078-a95a-4eac1115cd7f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.157640 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.158432 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.158747 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.159025 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.166415 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.167910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:10.183396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:10.184564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 259/513] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:10.185620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.210808 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97810f6b-3fb5-4972-9a85-57ac9b258ec4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.243421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.244105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.244383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.244654 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.245373 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:10.245674 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.247066 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.258521 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 255/514] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:10.259327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.285514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c223220-fc71-4011-b17a-706040bd36b2 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.317454 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.318236 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.318516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.318789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.329627 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.331066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:10.348039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:10.349135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:10.350098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:10.350098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:10.350098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:10.350098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:10.350098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 260/515] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:10.350711 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.361626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc349c5-2dc7-4dcb-ae01-7575ab0c8d60 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.393847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.394604 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.394885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.395159 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.395913 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:10.396218 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.397599 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.410272 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 256/516] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:10.411059 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.445238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759350c-3f07-4313-a5cd-ac095738e441 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.478112 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.478887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.479174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.479453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.489936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.491377 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.507744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5ab94-7948-431e-b18d-3c4d3402794d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:10.508525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:10.509547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:10.510646 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:10.510646 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:10.510646 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:10.510646 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:10.510646 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 261/517] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:10.510646 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.541245 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.541972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.542256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.542532 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.543402 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:10.543710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.545183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.582705 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 257/518] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:10.583566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.611264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f7725-10d6-4364-9095-c3b4c5e518ed None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.643182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.644003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.644350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.644627 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.651109 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.652576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:10.667441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:10.668651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 262/519] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:10.675056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.680977 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67831ec4-e92d-4d3f-93ac-6567c5e5299a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.713293 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.713957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.714234 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.714503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.715219 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:10.715520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.716926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.728129 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 258/520] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:10.728904 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.768369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c3a4d-72ae-4440-b455-77d8d58f467c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.801103 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e506-eab9-42fc-9a05-dbbc4484e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.801761 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e506-eab9-42fc-9a05-dbbc4484e486 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.802046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e506-eab9-42fc-9a05-dbbc4484e486 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.802323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90e506-eab9-42fc-9a05-dbbc4484e486 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.803017 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e506-eab9-42fc-9a05-dbbc4484e486 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.804506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90e506-eab9-42fc-9a05-dbbc4484e486 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.822575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e366c3-b317-49e4-a1e0-ea982e4d1240 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.824205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 263/521] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:16:10 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:10.825011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e506-eab9-42fc-9a05-dbbc4484e486 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.863661 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.864384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.864659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.864938 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.865684 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:10.865993 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:10.867420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:10.881011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 259/522] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:10.882059 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:10.938334 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90e506-eab9-42fc-9a05-dbbc4484e486 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:10.976637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c7ce9-116b-4dee-9fbd-ae5b7d8a76a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:10.977305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c7ce9-116b-4dee-9fbd-ae5b7d8a76a2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:10.977590 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c7ce9-116b-4dee-9fbd-ae5b7d8a76a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:10.977867 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c7ce9-116b-4dee-9fbd-ae5b7d8a76a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:10.995147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296f95a-0850-4e71-802a-03bd51d0a702 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.032627 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.033296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.033579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.033846 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.034636 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:11.034935 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.036423 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.051012 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c7ce9-116b-4dee-9fbd-ae5b7d8a76a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.052973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c7ce9-116b-4dee-9fbd-ae5b7d8a76a2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.057129 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 260/523] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:11.058071 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.157349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 264/524] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:11.158207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c7ce9-116b-4dee-9fbd-ae5b7d8a76a2 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.163859 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c095512-fef5-4fcd-92f8-ea1422fee734 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.198273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.199001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.199281 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.199556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.207179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.208680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:11.223844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:11.225073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:11.226104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 261/525] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:11.226782 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.268450 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c7ce9-116b-4dee-9fbd-ae5b7d8a76a2 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.304206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.304995 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.305279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.305555 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.313528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.314968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:11.330539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:11.331532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:11.332546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 265/526] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:11.333090 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.336327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71760cb-8599-4f6a-8a8f-dfea52e5187c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.370029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.370694 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.370978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.371265 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.372131 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=865e4a29d11c4000988326f5ce35b25b) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:11.372448 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.373890 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.387828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 262/527] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/role_assignments?user.id=865e4a29d11c4000988326f5ce35b25b&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:11.387828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.448441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d4d71-0768-40d2-894e-34da202b9d9d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.487075 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.487917 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.488205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.488487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.499660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209d0a3-add2-4fad-afc9-c6aa439e8c8c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.501025 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.502663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:11.521206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:11.522257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:11.524092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:11.524092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:11.524092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:11.524092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:11.524092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 266/528] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:11.524092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.542667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.544172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.544672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.545153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.546215 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:11.546958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.549219 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.569452 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 263/529] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:11.570647 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.632733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c415f-a77f-4d64-a5aa-05e745df7b97 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.676671 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.678154 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.678929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.679414 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.680995 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:11.681803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.683310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1527d-d2a5-4eb5-835f-a7c7f308915b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.683669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.710095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 267/530] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:11.711989 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.725753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.726814 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.727353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.727897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.728898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:11.729405 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.731031 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.744022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 264/531] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:11.745387 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.818466 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3d54a-dca5-48fb-9cc3-af37222369d4 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.849640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3ac72-0526-4358-843a-ddabb63b82a8 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:11.853087 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce808a21-7bdf-4c31-a910-4533f1059169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.853983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808a21-7bdf-4c31-a910-4533f1059169 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.854478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808a21-7bdf-4c31-a910-4533f1059169 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.854992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce808a21-7bdf-4c31-a910-4533f1059169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.885696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:11.886448 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:11.886640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:11.886897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:11.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=dd50aa56dbe848fcb99bf334f7659f5f) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:11.888050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.889556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:11.895616 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 265/532] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/role_assignments?user.id=dd50aa56dbe848fcb99bf334f7659f5f&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:11.896511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:11.956748 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce808a21-7bdf-4c31-a910-4533f1059169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:11.958255 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce808a21-7bdf-4c31-a910-4533f1059169 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:12.088611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c824d5-b697-40d4-8b9b-707db055f700 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:12.133420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:12.137877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:12.137877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:12.138055 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 268/533] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:12.138139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:12.143807 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce808a21-7bdf-4c31-a910-4533f1059169 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:12.154838 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:12.156737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:12.189317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:12.190366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:12.191339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:12.191339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:12.191339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:12.191339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:12.191339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:12.191339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:12.191339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:12.191339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:12.193983 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 266/534] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:12.200015 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:12.249725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce808a21-7bdf-4c31-a910-4533f1059169 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:12.288703 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:12.289715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:12.289857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:12.290030 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:12.322129 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:12.323594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:12.351077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e003fe-db74-4474-8cfb-9e6f0f4829ff None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:12.364523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:12.365538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:12.366546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:12.366546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:12.366546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:12.366546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:12.372251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 269/535] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:12.377880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:12.391173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:12.392270 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:12.392774 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:12.393289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:12.394299 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:12.394821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:12.396509 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:12.408984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 267/536] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:12.414950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:12.516545 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ad7da-5292-405b-9a0f-5fc95c93b298 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:12.552818 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:12.554300 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:12.554825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:12.555329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:12.556413 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=4e95ad8de2464133abda7210cd273e06) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:12.556961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:12.558619 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:12.565481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 268/537] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:12 2022] GET /identity/v3/role_assignments?user.id=4e95ad8de2464133abda7210cd273e06&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:12.570131 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75a1a7-aa5e-4c16-a8f8-9517997f0bd0 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:12.656736 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:12.657489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:12.657595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:12.657870 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:12.658628 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:12.658934 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:12.660583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:12.676121 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 270/538] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:12.681829 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:12.798906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e8dc1-850d-4df4-97db-ccad9c7035be None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:12.835952 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:12.837161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:12.837701 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:12.838224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:12.846907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:12.848775 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:12.864310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:12.865341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:12.866409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:12.866409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:12.866409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:12.866409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:12.866409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:12.866409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:12.866409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:12.866409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:12.868940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 269/539] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:12.874511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:12.986948 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91c73b-1f48-4b1b-bda8-20ce2b8e64ad None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:13.021155 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e1277-eb83-444e-bd57-4f245364b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:13.021823 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1277-eb83-444e-bd57-4f245364b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:13.022113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1277-eb83-444e-bd57-4f245364b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:13.022394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1277-eb83-444e-bd57-4f245364b7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:13.023192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e1277-eb83-444e-bd57-4f245364b7d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:13.023506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e1277-eb83-444e-bd57-4f245364b7d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:13.024991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e1277-eb83-444e-bd57-4f245364b7d4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:13.039482 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 271/540] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:13.046132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:13.186766 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdab01-ad3e-4387-bc22-fd674ac9ab7e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:13.232094 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735af27-ad0b-4a96-bd65-772dab10d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:13.232819 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735af27-ad0b-4a96-bd65-772dab10d17b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:13.233104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735af27-ad0b-4a96-bd65-772dab10d17b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:13.233377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735af27-ad0b-4a96-bd65-772dab10d17b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:13.234254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735af27-ad0b-4a96-bd65-772dab10d17b None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=a14b3bdef9874881aa5008410b4259df) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:13.234578 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735af27-ad0b-4a96-bd65-772dab10d17b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:13.236087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735af27-ad0b-4a96-bd65-772dab10d17b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:13.242596 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 270/541] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:13 2022] GET /identity/v3/role_assignments?user.id=a14b3bdef9874881aa5008410b4259df&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:13.445046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a2176-071b-4251-8400-2c89a180bee8 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:13.445771 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a2176-071b-4251-8400-2c89a180bee8 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:13.446538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a2176-071b-4251-8400-2c89a180bee8 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:13.448169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 272/542] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:13.454403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c11b02-7152-4713-a419-6652ef3d430f None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:13.454696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c11b02-7152-4713-a419-6652ef3d430f None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:13.454974 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c11b02-7152-4713-a419-6652ef3d430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:13.478419 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-57c11b02-7152-4713-a419-6652ef3d430f None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:13.479616 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-57c11b02-7152-4713-a419-6652ef3d430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:13.573028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 271/543] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:13.606731 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a2176-071b-4251-8400-2c89a180bee8 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:13.743258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a2176-071b-4251-8400-2c89a180bee8 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:13.789736 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35272e3-c66f-4072-a729-70ab52b6dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:13.790561 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35272e3-c66f-4072-a729-70ab52b6dc12 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:13.790847 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35272e3-c66f-4072-a729-70ab52b6dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:13.791126 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35272e3-c66f-4072-a729-70ab52b6dc12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:13.810545 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35272e3-c66f-4072-a729-70ab52b6dc12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e35272e3-c66f-4072-a729-70ab52b6dc12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:13.819281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:13.820544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:13.821818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 273/544] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:13.829575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c11b02-7152-4713-a419-6652ef3d430f None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:13.971897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c11b02-7152-4713-a419-6652ef3d430f None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:13.992834 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230277-32c5-43a8-840f-6b8be0081790 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:13.993166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230277-32c5-43a8-840f-6b8be0081790 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:13.993400 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94230277-32c5-43a8-840f-6b8be0081790 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:13.995029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 274/545] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:16:14.000118 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60071f75-d386-41ed-919b-1611e2b4388c None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:14.000397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60071f75-d386-41ed-919b-1611e2b4388c None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:14.000678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60071f75-d386-41ed-919b-1611e2b4388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:14.013815 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:14.014708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:14.015152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:14.016154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:14.017072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] RBAC: Adding query filter params (name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:14.017539 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:14.019066 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:14.027737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 272/546] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:14.033715 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:14.036766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-60071f75-d386-41ed-919b-1611e2b4388c None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:14.037987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-60071f75-d386-41ed-919b-1611e2b4388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:14.173089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a734bb-f407-4d3f-a98c-9d0d52d6dd43 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:14.185545 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 275/547] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:14.220042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:14.220865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:14.222035 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60071f75-d386-41ed-919b-1611e2b4388c None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:14.233444 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:14.233847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:14.254613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:14.256100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:14.290652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:14.291718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:14.292724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:14.292724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:14.292724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:14.292724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:14.292724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 273/548] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:14.298376 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:14.402887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60071f75-d386-41ed-919b-1611e2b4388c None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:14.448655 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce3542-954e-4347-a19f-658989b4b456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:14.449852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce3542-954e-4347-a19f-658989b4b456 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:14.450357 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce3542-954e-4347-a19f-658989b4b456 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:14.450857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce3542-954e-4347-a19f-658989b4b456 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:14.474776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce3542-954e-4347-a19f-658989b4b456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-35ce3542-954e-4347-a19f-658989b4b456 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:14.491251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:14.492330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:14.493291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:14.498371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 276/549] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:14.504750 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce3542-954e-4347-a19f-658989b4b456 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:14.509881 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7170a-6f27-44a5-a79c-c390967acb52 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:14.589424 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:14.590092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:14.590392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:14.590688 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:14.591432 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:14.591742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:14.593176 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:14.626148 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 274/550] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:14.631676 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:14.670989 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce3542-954e-4347-a19f-658989b4b456 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:14.777930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:14.778592 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:14.778892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:14.779085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:14.779857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:14.780172 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:14.782411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:14.785844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf3bf8-fccc-417f-928d-4ae481ce6d93 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:14.803263 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 277/551] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:14.808472 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:14.833915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dfdd2-304a-4ce8-9638-e510c33980b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:14.834719 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dfdd2-304a-4ce8-9638-e510c33980b3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:14.835056 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dfdd2-304a-4ce8-9638-e510c33980b3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:14.835334 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dfdd2-304a-4ce8-9638-e510c33980b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:14.852522 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dfdd2-304a-4ce8-9638-e510c33980b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:14.855513 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dfdd2-304a-4ce8-9638-e510c33980b3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-035dfdd2-304a-4ce8-9638-e510c33980b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:14.892197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:14.893305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:14.894331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 275/552] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:14.895535 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404730f5-6612-4eeb-9631-a653813c4978 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:14.895535 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404730f5-6612-4eeb-9631-a653813c4978 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:14.895718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404730f5-6612-4eeb-9631-a653813c4978 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:14.897966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 276/553] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:14.898888 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404730f5-6612-4eeb-9631-a653813c4978 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:14.974804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd62e7-b0fc-4c29-aff6-a817d27e533e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.014842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404730f5-6612-4eeb-9631-a653813c4978 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.019035 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846d404-9cd6-4dfb-93cf-cdc729b20625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.020139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846d404-9cd6-4dfb-93cf-cdc729b20625 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.020632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846d404-9cd6-4dfb-93cf-cdc729b20625 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.021128 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846d404-9cd6-4dfb-93cf-cdc729b20625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.034759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846d404-9cd6-4dfb-93cf-cdc729b20625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.037082 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846d404-9cd6-4dfb-93cf-cdc729b20625 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-3846d404-9cd6-4dfb-93cf-cdc729b20625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:15.060712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:15.061758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:15.063543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:15.063543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:15.063543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:15.063543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:15.063821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.063821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.063821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.064074 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.065269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:15.065647 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.066801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 278/554] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:15.067279 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.068526 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78dbd-5c01-484c-9e12-b474f35fadab None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.069501 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78dbd-5c01-484c-9e12-b474f35fadab None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.071050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b78dbd-5c01-484c-9e12-b474f35fadab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.087451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 277/555] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:16:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:15.088691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.096669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-f4b78dbd-5c01-484c-9e12-b474f35fadab None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:15.097954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-f4b78dbd-5c01-484c-9e12-b474f35fadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:15.176085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 279/556] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:15.177098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b78dbd-5c01-484c-9e12-b474f35fadab None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.198661 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51c296-abd7-438a-9eab-5fde57972f86 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.236135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.237284 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.237784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.238282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.239264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:15.239832 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.241511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.256029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 278/557] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:15.257321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.302332 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b78dbd-5c01-484c-9e12-b474f35fadab None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.338163 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e2593-3ec6-4d4c-8dec-2e98db88aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.339107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2593-3ec6-4d4c-8dec-2e98db88aed4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.339229 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2593-3ec6-4d4c-8dec-2e98db88aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.339405 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2593-3ec6-4d4c-8dec-2e98db88aed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.366022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dee26-af57-4c66-b83d-3c2c70c505d3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.404531 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef58a-b14e-42b9-a04f-69af403affad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.405770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef58a-b14e-42b9-a04f-69af403affad None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.407101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef58a-b14e-42b9-a04f-69af403affad None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.407621 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acef58a-b14e-42b9-a04f-69af403affad None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.409457 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e2593-3ec6-4d4c-8dec-2e98db88aed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.411133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e2593-3ec6-4d4c-8dec-2e98db88aed4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.423606 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acef58a-b14e-42b9-a04f-69af403affad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-2acef58a-b14e-42b9-a04f-69af403affad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:15.434204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:15.435230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:15.436191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:15.439480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 279/558] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:15.440443 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef58a-b14e-42b9-a04f-69af403affad None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.518264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 280/559] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:15.519609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfbd20-fc18-403d-b13b-f2d6f69c3e23 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.519925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfbd20-fc18-403d-b13b-f2d6f69c3e23 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.520203 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfbd20-fc18-403d-b13b-f2d6f69c3e23 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.521636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 281/560] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:15.522165 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfbd20-fc18-403d-b13b-f2d6f69c3e23 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.548347 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acef58a-b14e-42b9-a04f-69af403affad None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.588132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.588930 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.589195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.589465 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] PATH_INFO: `/v3/users/nova` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.597754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.599203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:15.612885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:15.614152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 280/561] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:15.615263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.634045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfbd20-fc18-403d-b13b-f2d6f69c3e23 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.670913 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd827c8a-039b-4752-85d4-dc21975e1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.671572 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827c8a-039b-4752-85d4-dc21975e1d7c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.672400 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827c8a-039b-4752-85d4-dc21975e1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.672658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd827c8a-039b-4752-85d4-dc21975e1d7c None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.673572 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd827c8a-039b-4752-85d4-dc21975e1d7c None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:15.673875 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd827c8a-039b-4752-85d4-dc21975e1d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.675228 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd827c8a-039b-4752-85d4-dc21975e1d7c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.687880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 282/562] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:15.687880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0cdc1-dc26-40c9-8615-7e2ce046cd19 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.687880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0cdc1-dc26-40c9-8615-7e2ce046cd19 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.687880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0cdc1-dc26-40c9-8615-7e2ce046cd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.701582 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-e4a0cdc1-dc26-40c9-8615-7e2ce046cd19 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:15.702887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-e4a0cdc1-dc26-40c9-8615-7e2ce046cd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:15.733604 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eae5c6-0f4d-4ca9-a939-b372e09e628e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.767018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.767849 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.775855 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.775999 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 283/563] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:15.776119 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.776219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0cdc1-dc26-40c9-8615-7e2ce046cd19 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.790860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.792969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:15.811049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:15.812077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:15.814090 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:15.814090 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:15.814090 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:15.814090 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:15.814090 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 281/564] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:15.814090 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.871753 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0cdc1-dc26-40c9-8615-7e2ce046cd19 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.904821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.905483 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.905769 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.906614 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.907454 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:15.907793 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.909234 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.909953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa099ade-72ba-4e71-a2bf-7cc558f20681 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:15.926161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 284/565] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:15.926973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:15.942964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:15.943753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:15.944064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:15.944342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:15.955211 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:15.956691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:15.973780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:15.974900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:15.976415 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:15.976415 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:15.976415 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:15.976415 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:15.976415 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 282/566] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:15.976415 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.025167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2fe5-184c-4d2a-9e48-b1570b2e27a4 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.058770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a103f43-0b3c-4283-a9d0-977c3e5bff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.059557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103f43-0b3c-4283-a9d0-977c3e5bff6e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.059876 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103f43-0b3c-4283-a9d0-977c3e5bff6e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.060145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103f43-0b3c-4283-a9d0-977c3e5bff6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.070824 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a103f43-0b3c-4283-a9d0-977c3e5bff6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:16.074704 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba29bc-9131-4dd8-b3ae-b9fb39675b0c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-0a103f43-0b3c-4283-a9d0-977c3e5bff6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:16.079941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:16.081021 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:16.081953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 285/567] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:16.082702 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a7ca-41ef-45ac-a827-124bfa32501e None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.083018 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a7ca-41ef-45ac-a827-124bfa32501e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.083242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519a7ca-41ef-45ac-a827-124bfa32501e None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.084650 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 286/568] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:16.086404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519a7ca-41ef-45ac-a827-124bfa32501e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.112232 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.112898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.113183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.113459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.114185 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:16.114491 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.115877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.133758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 283/569] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:16.133758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.184900 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519a7ca-41ef-45ac-a827-124bfa32501e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.217199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.217972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.218253 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.218563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.223400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27871b-f8b5-4fdb-a33a-ea3b43de6485 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.228603 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.230050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:16.246818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:16.247997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:16.254168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:16.254168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:16.254168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:16.254168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:16.254168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 287/570] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:16.254168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.258844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6c6f-d1a5-4731-bc1e-03751c9da26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.259508 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6c6f-d1a5-4731-bc1e-03751c9da26e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.259810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6c6f-d1a5-4731-bc1e-03751c9da26e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.260087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6c6f-d1a5-4731-bc1e-03751c9da26e None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.260810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6c6f-d1a5-4731-bc1e-03751c9da26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:16.261111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6c6f-d1a5-4731-bc1e-03751c9da26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.263804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6c6f-d1a5-4731-bc1e-03751c9da26e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.273482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 284/571] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:16.274664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4510f-8325-4fe8-8240-a5d6666ad47b None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.274944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4510f-8325-4fe8-8240-a5d6666ad47b None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.275218 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4510f-8325-4fe8-8240-a5d6666ad47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.290501 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-aaa4510f-8325-4fe8-8240-a5d6666ad47b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:16.291869 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-aaa4510f-8325-4fe8-8240-a5d6666ad47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:16.350943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bac695-6ea9-41ef-8a41-085a104a3be8 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.357423 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 285/572] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:16.358271 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4510f-8325-4fe8-8240-a5d6666ad47b None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.384370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.384964 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.385250 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.385525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.386286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:16.386594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.387977 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.396261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 288/573] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:16.397048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.465829 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4510f-8325-4fe8-8240-a5d6666ad47b None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.492662 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa29267-6b2c-495c-94bc-de8cd07756a5 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.498264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.499061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.499345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.499618 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.506683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.508172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:16.521967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:16.523166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 286/574] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:16.524183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.530571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.532120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.532120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.532120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.532658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:16.532996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.534369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.546037 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 289/575] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:16.546862 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.622549 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010dbe7-6849-4fc0-b1d0-d25c2a9e9dbf None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.644397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7bb41-9b1f-4dc1-88a1-9ce675dafc91 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.654767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.655566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.655887 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.656315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] PATH_INFO: `/v3/users/glance` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.663584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.665052 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.676513 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec249d-9324-41bb-ad40-5b284e55e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.677298 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec249d-9324-41bb-ad40-5b284e55e5ac None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.677582 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec249d-9324-41bb-ad40-5b284e55e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.677859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec249d-9324-41bb-ad40-5b284e55e5ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:16.678747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:16.679946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 287/576] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:16.681336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.692849 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec249d-9324-41bb-ad40-5b284e55e5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-13ec249d-9324-41bb-ad40-5b284e55e5ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:16.700810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:16.701931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 290/577] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:16.702930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec249d-9324-41bb-ad40-5b284e55e5ac None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.782389 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad65a1c-b463-43ee-8175-dbcca3858175 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.809097 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec249d-9324-41bb-ad40-5b284e55e5ac None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.815245 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.816157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.816441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.816713 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.830486 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.832030 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.841764 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.842422 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.842709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.842988 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.844491 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:16.844954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.846377 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:16.849966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:16.851101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:16.856804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:16.856804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:16.856804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:16.856804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:16.856804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 288/578] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:16.856804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.858253 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 291/579] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:16.859091 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:16.951580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb9473-1487-4a9e-91f4-4b37f3fd3c0d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.951843 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263abd4-ba7c-4417-aa7c-6ac50f553c1f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:16.985213 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.985998 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.986276 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.986717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.986840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:16.987376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:16.987664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:16.987972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:16.988812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:16.989124 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.990549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:16.993234 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:16.994649 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.007081 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 292/580] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:17.007918 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:17.008377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:17.009307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:17.010289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:17.010289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:17.010289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:17.010289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:17.010289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:17.010289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:17.010289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:17.010289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:17.011338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 289/581] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:17.012195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.106427 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4b3d8-e5d5-4eed-aa18-d39fe970ec77 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.108863 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef003d-f56f-4d48-a5ea-cd9437d68dcb None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.143375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.143656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.144077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.144293 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.144396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.144579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.144687 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.144854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.145361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:17.145582 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:17.145690 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.145891 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.147013 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.147241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.154913 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 293/582] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:17.155708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.167753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 290/583] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:17.167753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.252132 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c0f5c-e5d6-479f-be52-1f316fc39346 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.259268 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1675438-a994-4e82-9ef3-433e44b9ff3a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.284180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.284829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.285115 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.285392 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.286222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=6fa1a77cf42a46f092b7c5894761dfb9) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:17.286537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.287989 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.290927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.291704 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.292013 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.292291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.293231 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 294/584] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/role_assignments?user.id=6fa1a77cf42a46f092b7c5894761dfb9&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:17.294012 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.303816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.305613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:17.325147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:17.326380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:17.327667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:17.327667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:17.327667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:17.327667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:17.331985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 291/585] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:17.332940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.412896 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eca97a-2aa3-45cd-84d3-d92ae9bbab21 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.438069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5f89-5351-43a8-bd09-7f37aebc63db None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.448901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.449569 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.449854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.450122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.450925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:17.451233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.452740 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.466472 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 295/586] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:17.467348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.479164 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.480098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.480290 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.480551 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.491557 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.493167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:17.512139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:17.513152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:17.519502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:17.519502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:17.519502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:17.519502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:17.519502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 292/587] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:17.519502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.572019 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a522404-00da-496d-b197-c7fc7d6ec6ed None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.606231 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.606928 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.607208 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.607482 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.614225 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5831f0-29bd-4da2-92c4-508141f47ab2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.615300 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.617211 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:17.631812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:17.632898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:17.634147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 296/588] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:17.636256 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.653277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.654083 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.654467 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.654817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.655624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:17.656641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.658181 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.675149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 293/589] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:17.675149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.740870 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b777f-d0c9-4985-b32a-054a19958c05 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.768062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c218bde-7561-438d-8e77-ac115259ee05 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.773819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221a588-8cd8-4242-b4fc-8751c1660d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.774704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a588-8cd8-4242-b4fc-8751c1660d37 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.774984 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a588-8cd8-4242-b4fc-8751c1660d37 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.775261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221a588-8cd8-4242-b4fc-8751c1660d37 None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/865e4a29d11c4000988326f5ce35b25b/roles/e56e935653824c0d983483cabd28c5be` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.790489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221a588-8cd8-4242-b4fc-8751c1660d37 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=865e4a29d11c4000988326f5ce35b25b, role_id=e56e935653824c0d983483cabd28c5be)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.791956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221a588-8cd8-4242-b4fc-8751c1660d37 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.804420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.805088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.805393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.805723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 297/590] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:17 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/865e4a29d11c4000988326f5ce35b25b/roles/e56e935653824c0d983483cabd28c5be => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:16:17.806570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221a588-8cd8-4242-b4fc-8751c1660d37 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.807568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.808706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:17.809380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.810945 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.827437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 294/591] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:17.829159 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:17.927295 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221a588-8cd8-4242-b4fc-8751c1660d37 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.966377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06d0f3-4d26-4f07-a5a4-2956853c3c29 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:17.967742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:17.969740 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:17.970288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:17.970816 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:17.972209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:17.972763 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:17.974626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:17.994645 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 298/592] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:17.995983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.010506 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.011781 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.012089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.012369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.022260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.024128 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:18.039922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:18.041154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 295/593] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:18.042377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.113321 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d11d-59b2-4c80-ba01-7ec3fe85e725 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.149400 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.150199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.150485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.150763 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.151151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8a812-c78c-4fa6-928d-4b555bceddcc None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.158773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.160261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:18.175361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:18.177632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 299/594] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:18.180056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.191436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.192412 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.192692 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.193015 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.204500 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.206148 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:18.223918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:18.226151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:18.228456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:18.228456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:18.228456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:18.228456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:18.231906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 296/595] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:18.231906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.280345 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a35585-de5e-4428-874a-5330120aae74 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.315365 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.316060 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.316348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.316628 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.317422 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:18.317733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.319166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.336332 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 300/596] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:18.336332 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.339375 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8f580-ed3a-4c67-808a-4eaf2b52f65d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.375732 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.376714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.377166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.377589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.378579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:18.379035 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.380772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.400441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 297/597] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:16:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:18.401323 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.452706 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0baca-117e-4b6f-b52e-054173bc5e13 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.490635 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.491592 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.492076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.492527 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.493424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:18.493897 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.495415 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.506132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c3116-f540-429f-8be9-73ee66ab4934 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.512006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 301/598] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:18.513034 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.556231 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08d60e-359f-43a3-83d2-71266bb5fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.557405 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08d60e-359f-43a3-83d2-71266bb5fb4d None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.557870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08d60e-359f-43a3-83d2-71266bb5fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.558303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08d60e-359f-43a3-83d2-71266bb5fb4d None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/dd50aa56dbe848fcb99bf334f7659f5f/roles/e56e935653824c0d983483cabd28c5be` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.578495 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08d60e-359f-43a3-83d2-71266bb5fb4d None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=dd50aa56dbe848fcb99bf334f7659f5f, role_id=e56e935653824c0d983483cabd28c5be)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.580327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08d60e-359f-43a3-83d2-71266bb5fb4d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.604048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 298/599] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:18 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/dd50aa56dbe848fcb99bf334f7659f5f/roles/e56e935653824c0d983483cabd28c5be => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:16:18.605148 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08d60e-359f-43a3-83d2-71266bb5fb4d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.659218 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6bfa1-b6a4-4794-81b1-d9c4a72ec7be None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.696773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.697881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.698343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.698785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.710937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.712696 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:18.732319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:18.733565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:18.735172 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:18.735172 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:18.735172 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:18.735172 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:18.744276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 302/600] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:18.749612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.768572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08d60e-359f-43a3-83d2-71266bb5fb4d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.807255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.808006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.808339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.808612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.821914 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.823397 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:18.849666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:18.850925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:18.852277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 299/601] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:18.857737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:18.940767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ef72b-f7ad-4f14-bdec-65ca6180211c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.973411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bea1a-d0da-4dda-a65a-7b280b64df4b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:18.980578 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:18.981873 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:18.982365 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:18.982784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:18.983658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:18.984745 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:18.986427 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:19.005825 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 303/602] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:19.007415 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:19.010106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:19.010851 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:19.011212 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:19.011562 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:19.012462 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:19.012850 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:19.014356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:19.028336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 300/603] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:19.034687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:19.138195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2955b74-1470-4a9a-8a75-0a1d78a7878d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:19.180227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4ef70-b8df-4009-b378-83dde52d6352 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:19.185481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52fd0-e5e5-4fca-a334-1d1101d43652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:19.186394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52fd0-e5e5-4fca-a334-1d1101d43652 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:19.186677 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52fd0-e5e5-4fca-a334-1d1101d43652 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:19.186951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52fd0-e5e5-4fca-a334-1d1101d43652 None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/4e95ad8de2464133abda7210cd273e06/roles/e56e935653824c0d983483cabd28c5be` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:19.222286 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea52fd0-e5e5-4fca-a334-1d1101d43652 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=4e95ad8de2464133abda7210cd273e06, role_id=e56e935653824c0d983483cabd28c5be)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:19.225347 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea52fd0-e5e5-4fca-a334-1d1101d43652 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:19.237475 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:19.238522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:19.239000 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:19.239453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:19.246967 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:19.252881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:19.256167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 301/604] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:19 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/4e95ad8de2464133abda7210cd273e06/roles/e56e935653824c0d983483cabd28c5be => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:19.272634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:19.273895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:19.275174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:19.275174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:19.275174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:19.275174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:19.275174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:19.275174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:19.275174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:19.275174 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:19.283261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 304/605] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:19.284941 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52fd0-e5e5-4fca-a334-1d1101d43652 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:19.408247 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52fd0-e5e5-4fca-a334-1d1101d43652 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:19.459573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a952829-d4b0-456f-8d7f-492212b50430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:19.460581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a952829-d4b0-456f-8d7f-492212b50430 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:19.461039 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a952829-d4b0-456f-8d7f-492212b50430 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:19.461481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a952829-d4b0-456f-8d7f-492212b50430 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:19.462463 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a952829-d4b0-456f-8d7f-492212b50430 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:19.462937 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a952829-d4b0-456f-8d7f-492212b50430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:19.464649 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a952829-d4b0-456f-8d7f-492212b50430 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:19.483476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 302/606] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:19.490525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:19.618629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56cab-5f99-4302-96af-04384be08b42 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:19.659471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c217fe4-6d3b-4be3-8716-0a571cd13dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:19.660312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217fe4-6d3b-4be3-8716-0a571cd13dd7 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:19.660590 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217fe4-6d3b-4be3-8716-0a571cd13dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:19.660859 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c217fe4-6d3b-4be3-8716-0a571cd13dd7 None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/a14b3bdef9874881aa5008410b4259df/roles/e56e935653824c0d983483cabd28c5be` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:19.676457 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c217fe4-6d3b-4be3-8716-0a571cd13dd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=a14b3bdef9874881aa5008410b4259df, role_id=e56e935653824c0d983483cabd28c5be)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:19.677897 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c217fe4-6d3b-4be3-8716-0a571cd13dd7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:19.710363 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 305/607] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:19 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/a14b3bdef9874881aa5008410b4259df/roles/e56e935653824c0d983483cabd28c5be => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:16:19.799129 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46f3c-e209-4f74-bd47-ae413b00c9d8 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:19.799749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46f3c-e209-4f74-bd47-ae413b00c9d8 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:19.799749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46f3c-e209-4f74-bd47-ae413b00c9d8 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:19.801396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 303/608] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:19.811473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a993bc-79a0-4286-8293-86391012bc27 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:19.811839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a993bc-79a0-4286-8293-86391012bc27 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:19.812079 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a993bc-79a0-4286-8293-86391012bc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:19.835703 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-87a993bc-79a0-4286-8293-86391012bc27 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:19.836953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-87a993bc-79a0-4286-8293-86391012bc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:19.910168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 306/609] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:19.954336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de46f3c-e209-4f74-bd47-ae413b00c9d8 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:20.080277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de46f3c-e209-4f74-bd47-ae413b00c9d8 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:20.116364 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f5ec8-b05b-4150-b40b-339e94478c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:20.117324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f5ec8-b05b-4150-b40b-339e94478c1c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:20.117680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f5ec8-b05b-4150-b40b-339e94478c1c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:20.118028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f5ec8-b05b-4150-b40b-339e94478c1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:20.129696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f5ec8-b05b-4150-b40b-339e94478c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-9b3f5ec8-b05b-4150-b40b-339e94478c1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:20.137948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:20.140169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:20.143322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 304/610] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:20.150927 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a993bc-79a0-4286-8293-86391012bc27 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:20.303146 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a993bc-79a0-4286-8293-86391012bc27 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:20.355290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdaf736-ad4e-42b7-872e-1e8cbbf91210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:20.355990 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf736-ad4e-42b7-872e-1e8cbbf91210 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:20.356270 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf736-ad4e-42b7-872e-1e8cbbf91210 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:20.356543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf736-ad4e-42b7-872e-1e8cbbf91210 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:20.357301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdaf736-ad4e-42b7-872e-1e8cbbf91210 None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:20.357603 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdaf736-ad4e-42b7-872e-1e8cbbf91210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:20.359464 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdaf736-ad4e-42b7-872e-1e8cbbf91210 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:20.379649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 307/611] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:20.385418 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f5ec8-b05b-4150-b40b-339e94478c1c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:20.421005 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114d92-5e1a-47aa-94a5-e0ba9d502aaa None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:20.421996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114d92-5e1a-47aa-94a5-e0ba9d502aaa None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:20.422276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c114d92-5e1a-47aa-94a5-e0ba9d502aaa None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:20.423935 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 308/612] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:16:20.440881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4ba5-8f64-41b2-8b72-2241d1dbffea None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:20.441205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4ba5-8f64-41b2-8b72-2241d1dbffea None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:20.441431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4ba5-8f64-41b2-8b72-2241d1dbffea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:20.485324 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-5dea4ba5-8f64-41b2-8b72-2241d1dbffea None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:20.486515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-5dea4ba5-8f64-41b2-8b72-2241d1dbffea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:20.502922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f5ec8-b05b-4150-b40b-339e94478c1c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:20.561981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:20.563422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:20.563705 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:20.563893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:20.593173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:20.595644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:20.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:20.625737 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:20.628187 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:20.628187 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:20.628187 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:20.628187 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:20.630730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 309/613] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 09 15:16:20.630939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 305/614] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:20.637773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea4ba5-8f64-41b2-8b72-2241d1dbffea None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:20.653584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:20.764360 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd25b-df8b-4eaf-9690-b8ee6b78148d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:20.801756 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594ccd7-d126-4027-b200-2ce5511440d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:20.803369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594ccd7-d126-4027-b200-2ce5511440d4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:20.803894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594ccd7-d126-4027-b200-2ce5511440d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:20.804387 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594ccd7-d126-4027-b200-2ce5511440d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:20.816488 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594ccd7-d126-4027-b200-2ce5511440d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b594ccd7-d126-4027-b200-2ce5511440d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:20.825461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:20.826464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:20.827403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:20.830842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 306/615] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:20.837954 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594ccd7-d126-4027-b200-2ce5511440d4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:20.916760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea4ba5-8f64-41b2-8b72-2241d1dbffea None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:20.950964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594ccd7-d126-4027-b200-2ce5511440d4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:20.990976 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:20.992203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:20.992713 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:20.993380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:20.994352 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] RBAC: Adding query filter params (name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:20.994875 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:20.996835 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.006568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 307/616] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:21.012237 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:21.016471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:21.017157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.017445 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.017724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.018462 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:21.018772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:21.020191 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.048264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 310/617] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:21.053453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:21.189924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8c72-b95d-4aa9-b91e-1e5088930859 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:21.230271 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e4cd5-1a1e-4a61-9206-eb5b7c88ac39 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:21.273733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:21.274530 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.274812 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.275087 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.279353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:21.280288 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.280572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.281517 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.289076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:21.290527 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.308910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:21.310500 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:21.319293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:21.320362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:21.321677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:21.324426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 311/618] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:21.332904 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:21.339315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:21.340332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:21.341329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:21.341329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:21.341329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:21.341329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:21.341329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 308/619] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:21.347922 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:21.463461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b443618-70d2-44c9-9062-8ad753c374ce None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:21.503594 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:21.506729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.507011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.507285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.508043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:21.508350 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:21.509723 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.557791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 309/620] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:21.563618 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:21.578817 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bd675-62a4-4a89-9e0e-efbd6c241239 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:21.615997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6b6af-18c3-43c0-a1bd-713f02c5381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:21.616920 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6b6af-18c3-43c0-a1bd-713f02c5381c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.617364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6b6af-18c3-43c0-a1bd-713f02c5381c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.617880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6b6af-18c3-43c0-a1bd-713f02c5381c None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.618889 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6b6af-18c3-43c0-a1bd-713f02c5381c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:21.619376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6b6af-18c3-43c0-a1bd-713f02c5381c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:21.621000 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6b6af-18c3-43c0-a1bd-713f02c5381c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.638755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 312/621] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:21.640386 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f5b2e-d1f1-4b73-bc1e-10392821c7c3 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.640839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f5b2e-d1f1-4b73-bc1e-10392821c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.641360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f5b2e-d1f1-4b73-bc1e-10392821c7c3 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.643050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 313/622] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:21.651789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cb84-6c10-4621-89b3-cfb60fbcd880 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.651789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cb84-6c10-4621-89b3-cfb60fbcd880 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.651789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cb84-6c10-4621-89b3-cfb60fbcd880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.670708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-a971cb84-6c10-4621-89b3-cfb60fbcd880 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:21.673674 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-a971cb84-6c10-4621-89b3-cfb60fbcd880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:21.681636 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1929a83-d789-4128-b677-a6d5c8f261b1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:21.722739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:21.723784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.724648 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.733671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:21.736600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:21.754111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:21.755278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:21.756450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 310/624] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:21.757422 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 314/624] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:21.760795 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:21.761310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971cb84-6c10-4621-89b3-cfb60fbcd880 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:21.883112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db236-ab8a-4ee8-9233-917cb2571304 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:21.886490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971cb84-6c10-4621-89b3-cfb60fbcd880 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:21.918458 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:21.919422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.919838 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.920217 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.930013 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:21.930999 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:21.931240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:21.931373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:21.931533 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:21.932409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:21.932714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:21.933172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.934119 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:21.951623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:21.953682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:21.955645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:21.955645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:21.955645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:21.955645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:21.960965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 315/626] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:21.960965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:21.961334 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 311/626] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:21.961334 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.064061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645544e-cd7b-41c9-b701-d046188a4236 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.081416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccc0dc-da20-4984-b880-58dace3f5c62 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.102683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce5d2-ce1e-4c26-ba0e-851356037a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.103445 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce5d2-ce1e-4c26-ba0e-851356037a44 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.103821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce5d2-ce1e-4c26-ba0e-851356037a44 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.104170 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce5d2-ce1e-4c26-ba0e-851356037a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.117227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f13e57-1d5e-42bf-a7b8-f03b7f24150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.118023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13e57-1d5e-42bf-a7b8-f03b7f24150c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.118304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13e57-1d5e-42bf-a7b8-f03b7f24150c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.118580 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13e57-1d5e-42bf-a7b8-f03b7f24150c None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.131222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f13e57-1d5e-42bf-a7b8-f03b7f24150c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e0f13e57-1d5e-42bf-a7b8-f03b7f24150c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:22.139514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:22.142127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 316/627] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:22.144631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f13e57-1d5e-42bf-a7b8-f03b7f24150c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.193747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce5d2-ce1e-4c26-ba0e-851356037a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:22.196267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce5d2-ce1e-4c26-ba0e-851356037a44 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:22.257221 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f13e57-1d5e-42bf-a7b8-f03b7f24150c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.297490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879a54-94c0-408b-8d26-fc6205b711c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.298165 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879a54-94c0-408b-8d26-fc6205b711c5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.298449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879a54-94c0-408b-8d26-fc6205b711c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.298727 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879a54-94c0-408b-8d26-fc6205b711c5 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.299452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879a54-94c0-408b-8d26-fc6205b711c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:22.299758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879a54-94c0-408b-8d26-fc6205b711c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:22.301172 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879a54-94c0-408b-8d26-fc6205b711c5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:22.319480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 312/628] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:22.319480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce5d2-ce1e-4c26-ba0e-851356037a44 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.319790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 317/629] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:22.319963 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bef0a-7394-40f1-a644-f41561c41c32 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.320263 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bef0a-7394-40f1-a644-f41561c41c32 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.320540 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bef0a-7394-40f1-a644-f41561c41c32 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.326082 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 318/630] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:22.326082 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bef0a-7394-40f1-a644-f41561c41c32 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.418714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce5d2-ce1e-4c26-ba0e-851356037a44 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.425647 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bef0a-7394-40f1-a644-f41561c41c32 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.454459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.455123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.455410 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.455680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.456479 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] RBAC: Adding query filter params (name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:22.456783 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:22.458163 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:22.460362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbf38b-ee0d-468c-8743-3114d74cfb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.461148 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf38b-ee0d-468c-8743-3114d74cfb79 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.461432 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf38b-ee0d-468c-8743-3114d74cfb79 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.461705 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf38b-ee0d-468c-8743-3114d74cfb79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.466072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 313/631] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:22.466873 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.469747 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbf38b-ee0d-468c-8743-3114d74cfb79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:22.471337 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbf38b-ee0d-468c-8743-3114d74cfb79 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-28fbf38b-ee0d-468c-8743-3114d74cfb79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:22.486120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:22.487189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:22.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 319/632] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:22.488758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972db1d-bd2b-4102-a255-55f33f14bde5 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.488833 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972db1d-bd2b-4102-a255-55f33f14bde5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.489093 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972db1d-bd2b-4102-a255-55f33f14bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.505342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-f972db1d-bd2b-4102-a255-55f33f14bde5 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:22.506538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-f972db1d-bd2b-4102-a255-55f33f14bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:22.569637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78879f-b949-4adc-b172-15b5ad6d1d71 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.573329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 320/633] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:22.574752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c23f8-39d5-491a-821d-a7dd06f4fc20 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.575046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c23f8-39d5-491a-821d-a7dd06f4fc20 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.575323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c23f8-39d5-491a-821d-a7dd06f4fc20 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.576677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 321/634] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:22.577363 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c23f8-39d5-491a-821d-a7dd06f4fc20 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.607008 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.607835 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.608121 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.608401 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.618672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:22.620131 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:22.636585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:22.637728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:22.638702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:22.638702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:22.638702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:22.638702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:22.638702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 314/635] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:22.638702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.683634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c23f8-39d5-491a-821d-a7dd06f4fc20 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.716635 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801618c-9377-4b14-8af6-b30186cabc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.717415 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801618c-9377-4b14-8af6-b30186cabc60 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.717697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801618c-9377-4b14-8af6-b30186cabc60 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.717973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801618c-9377-4b14-8af6-b30186cabc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.728134 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801618c-9377-4b14-8af6-b30186cabc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:22.729561 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801618c-9377-4b14-8af6-b30186cabc60 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:22.736591 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b84e00-7e79-4283-a501-6c896001842d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-c801618c-9377-4b14-8af6-b30186cabc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:22.746312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:22.747371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:22.748583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:22.748583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:22.748583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:22.748583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:22.748583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 322/636] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:22.748877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fc38e-3206-476e-8844-1f4485625809 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.749104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fc38e-3206-476e-8844-1f4485625809 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.749301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fc38e-3206-476e-8844-1f4485625809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.764924 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-6e0fc38e-3206-476e-8844-1f4485625809 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:22.766666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-6e0fc38e-3206-476e-8844-1f4485625809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:22.772652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.773315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.773606 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.773881 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.774669 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:22.774980 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:22.776435 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:22.788588 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 315/637] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:22.789379 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.830800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 323/638] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:22.831560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fc38e-3206-476e-8844-1f4485625809 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.896700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bfc5e-577f-472d-8ae6-4e9cf12ac3d6 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.925532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fc38e-3206-476e-8844-1f4485625809 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:22.928556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa40455-1b6f-4d08-8b62-07587ebab992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.929347 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40455-1b6f-4d08-8b62-07587ebab992 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.929630 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40455-1b6f-4d08-8b62-07587ebab992 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.929901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa40455-1b6f-4d08-8b62-07587ebab992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.940624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa40455-1b6f-4d08-8b62-07587ebab992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-3fa40455-1b6f-4d08-8b62-07587ebab992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:22.948543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:22.949585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 316/639] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:22.950480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa40455-1b6f-4d08-8b62-07587ebab992 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:22.963375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:22.964077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:22.964358 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:22.964634 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:22.965361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:22.965666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:22.967023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:22.978637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 324/640] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:22.979380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.047098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa40455-1b6f-4d08-8b62-07587ebab992 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.077418 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec7716-8fa0-461e-97c0-73de1a8dad2a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.080182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.080913 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.081133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.081411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.082138 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:23.082445 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.083833 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.095651 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 317/641] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:23.096479 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.113245 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89ae91-d142-4a39-995b-59afad630a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.114134 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89ae91-d142-4a39-995b-59afad630a22 None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.114417 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89ae91-d142-4a39-995b-59afad630a22 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.114693 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89ae91-d142-4a39-995b-59afad630a22 None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/6fa1a77cf42a46f092b7c5894761dfb9/roles/e56e935653824c0d983483cabd28c5be` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.129237 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89ae91-d142-4a39-995b-59afad630a22 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=6fa1a77cf42a46f092b7c5894761dfb9, role_id=e56e935653824c0d983483cabd28c5be)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.130707 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89ae91-d142-4a39-995b-59afad630a22 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.146044 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 325/642] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:22 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/6fa1a77cf42a46f092b7c5894761dfb9/roles/e56e935653824c0d983483cabd28c5be => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:16:23.146853 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89ae91-d142-4a39-995b-59afad630a22 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.198977 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37cc76-ec71-49c0-91c6-b2dad18071cb None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.236202 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717d56b-0e67-4368-ba88-1c71b23f7869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.237015 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717d56b-0e67-4368-ba88-1c71b23f7869 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.237300 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717d56b-0e67-4368-ba88-1c71b23f7869 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.237574 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717d56b-0e67-4368-ba88-1c71b23f7869 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.248923 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717d56b-0e67-4368-ba88-1c71b23f7869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:23.252891 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89ae91-d142-4a39-995b-59afad630a22 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-3717d56b-0e67-4368-ba88-1c71b23f7869 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:23.257739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:23.258824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:23.259744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 318/643] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:23.260536 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717d56b-0e67-4368-ba88-1c71b23f7869 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.295204 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.295973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.296180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.296977 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.297915 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:23.298222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.299636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.313854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 326/644] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:23.313854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.378273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717d56b-0e67-4368-ba88-1c71b23f7869 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.413076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852cd55-ae34-4b54-b2ae-843d35247645 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.413314 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.413910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.414200 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.414655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.422901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.424414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:23.439332 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:23.440499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:23.441503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 319/645] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:23.442053 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.454564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.455613 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.456077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.456524 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.464264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.465890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:23.480673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:23.481910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:16:23.483188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:23.489908 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 327/646] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:23.489908 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.547818 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b3023-1737-4f7d-a769-7d411bedef3c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.589639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623093c-8ea7-47c2-b9e6-29915c96adf6 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.590007 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.590887 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.591185 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.591466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.592261 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:23.592572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.594635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.607639 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 320/647] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:23.607639 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.625544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.626385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.626670 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.626941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.637865 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.639257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:23.657455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:23.658517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:23.659939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:23.659939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:23.659939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:23.659939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:23.659939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 328/648] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:23.659939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.711621 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7f19d-4062-4725-8636-da268d694cc4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.745322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.745994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.746328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.746554 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.747353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:23.747666 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.749129 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.767126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 321/649] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:23.767126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.770977 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5811913-1121-4746-8309-77b07ab73408 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.822829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.824029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.824502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.824969 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.826241 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:23.826767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.829789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.861522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 329/650] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:23.861522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:23.895384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119420c-2b35-4ab8-bd6a-4753d80120e1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.929303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:23.930100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:23.930387 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:23.930662 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:23.941535 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:23.942985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:23.961352 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737a31a-ceb6-44b5-8b03-89c0bcc89f57 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:23.962161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:23.963393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:23.964626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:23.964626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:23.964626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:23.964626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:23.964626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 322/651] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:23.964626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.005227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.005989 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.006279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.006559 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.007291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:24.007602 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.009006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.025113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 330/652] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:24.025113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.076616 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a8999-c443-4af8-bb15-46f993d1537a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.114029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.115011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.115486 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.116002 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.117054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=865e4a29d11c4000988326f5ce35b25b) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:24.117616 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.119336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.121881 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f3041-e14b-437b-b988-2e2d20c7aafa None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.125889 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 323/653] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:23 2022] GET /identity/v3/role_assignments?user.id=865e4a29d11c4000988326f5ce35b25b&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:24.126935 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.161459 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbbf76-25a8-472e-b50d-12a84ab8dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.162143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbbf76-25a8-472e-b50d-12a84ab8dc37 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.162368 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbbf76-25a8-472e-b50d-12a84ab8dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.162648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbbf76-25a8-472e-b50d-12a84ab8dc37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.247970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbbf76-25a8-472e-b50d-12a84ab8dc37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.250664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbbf76-25a8-472e-b50d-12a84ab8dc37 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.257402 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71e110-51f5-44aa-86af-d31317b87a94 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.295805 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.297054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.297340 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.297616 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.298438 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:24.298747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.300251 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.317892 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 324/654] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:24.318858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.372074 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 331/655] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:24.372935 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbbf76-25a8-472e-b50d-12a84ab8dc37 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.448328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83878e9f-3df4-4750-83d2-81547ee88dca None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.487395 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.488235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.488561 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.488835 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.496671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.497536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbbf76-25a8-472e-b50d-12a84ab8dc37 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.498114 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:24.512953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:24.514055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 325/656] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:24.515860 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.535620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.536475 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.536758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.537033 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.544337 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.545776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:24.561678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:24.564639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 332/657] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:24.567048 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.619255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7624ec-8421-4ae0-99f6-2ba9ca4af0ad None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.653946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.654739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.655015 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.655287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.667481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.668979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.670915 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcebf20-115e-43c9-a182-abfa2e213def None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:24.686682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:24.689480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:24.691702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:24.691702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:24.691702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:24.691702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:24.691702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 326/658] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:24.691702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.709136 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.709785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.710073 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.710352 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.711192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:24.711503 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.713007 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.731622 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 333/659] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:24.732648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.790631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bedfb-2ec8-4393-bcfa-5f60bd063f1a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.824394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.825064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.825340 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.825611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.826450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:24.826749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.828711 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.840107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95381-c538-4b16-8ddf-071f6d73e5d1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.847366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 327/660] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:24.848324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.878898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.879614 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.879947 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.880275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:24.881003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:24.881369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:24.882793 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:24.896206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 334/661] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:24.897175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:24.948643 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a0e9-84fa-4847-8afc-f0c3c52677c3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:24.983645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57538b13-dfd3-4dec-ba6d-e5b8aaed52d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:24.984280 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57538b13-dfd3-4dec-ba6d-e5b8aaed52d8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:24.984556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57538b13-dfd3-4dec-ba6d-e5b8aaed52d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:24.984829 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57538b13-dfd3-4dec-ba6d-e5b8aaed52d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.005321 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48e923-cb53-46f8-a364-7b58d13a0112 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:25.044404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdc4cd-ae03-417e-adaf-0d54eb492869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:25.045137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc4cd-ae03-417e-adaf-0d54eb492869 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.045417 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc4cd-ae03-417e-adaf-0d54eb492869 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.045747 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdc4cd-ae03-417e-adaf-0d54eb492869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.052693 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57538b13-dfd3-4dec-ba6d-e5b8aaed52d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.054149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57538b13-dfd3-4dec-ba6d-e5b8aaed52d8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.119699 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdc4cd-ae03-417e-adaf-0d54eb492869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.121276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdc4cd-ae03-417e-adaf-0d54eb492869 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.154128 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 328/662] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:25.154988 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57538b13-dfd3-4dec-ba6d-e5b8aaed52d8 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:25.238759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 335/663] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:25.239754 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdc4cd-ae03-417e-adaf-0d54eb492869 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:25.262120 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57538b13-dfd3-4dec-ba6d-e5b8aaed52d8 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:25.301310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:25.302224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.302656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.302898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.310671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.313427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:25.329141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:25.330192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:25.331192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 329/664] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:25.331800 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:25.355154 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdc4cd-ae03-417e-adaf-0d54eb492869 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:25.391872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:25.393620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.394253 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.394701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.409165 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.410819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:25.435724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:25.437678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:25.439039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:25.439039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:25.439039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:25.439039 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:25.441679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 336/665] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:25.442990 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:25.455198 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3ea8-f282-49b1-a3d9-b713737a7799 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:25.496969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:25.497683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.497967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.498244 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.509658 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.511115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:25.528547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:25.529608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:25.530742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:25.530742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:25.530742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:25.530742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:25.530742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 330/666] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:25.530742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:25.558214 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e68fd-995a-4745-9d0e-6efcf78b388c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:25.592889 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08216b-9992-4c8e-bcc8-16232edb9546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:25.594012 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08216b-9992-4c8e-bcc8-16232edb9546 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.594474 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08216b-9992-4c8e-bcc8-16232edb9546 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.594906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08216b-9992-4c8e-bcc8-16232edb9546 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.595877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08216b-9992-4c8e-bcc8-16232edb9546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:25.596359 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08216b-9992-4c8e-bcc8-16232edb9546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.597937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08216b-9992-4c8e-bcc8-16232edb9546 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.610592 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 337/667] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:25.611991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8dde3-203b-47e7-8c98-06c92c7b99e3 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.612287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8dde3-203b-47e7-8c98-06c92c7b99e3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.612567 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8dde3-203b-47e7-8c98-06c92c7b99e3 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.615870 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 338/668] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:25.615870 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8dde3-203b-47e7-8c98-06c92c7b99e3 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:25.649989 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192046e-6a18-4a51-908d-58665f816fae None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:25.683920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:25.684583 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.684867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.685143 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.685874 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:25.686178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.688444 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.704722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 331/669] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:25.704722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:25.728152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8dde3-203b-47e7-8c98-06c92c7b99e3 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:25.760969 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359feb7-12f6-4fac-a6fd-c6a443f7ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:25.761558 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359feb7-12f6-4fac-a6fd-c6a443f7ac57 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.761846 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359feb7-12f6-4fac-a6fd-c6a443f7ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.762123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359feb7-12f6-4fac-a6fd-c6a443f7ac57 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.762849 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359feb7-12f6-4fac-a6fd-c6a443f7ac57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:25.763157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359feb7-12f6-4fac-a6fd-c6a443f7ac57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.764546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359feb7-12f6-4fac-a6fd-c6a443f7ac57 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.781064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 339/670] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:25.781064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0561b-e9af-44ac-9e40-3ddbc1ef8702 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.781064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0561b-e9af-44ac-9e40-3ddbc1ef8702 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.781064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0561b-e9af-44ac-9e40-3ddbc1ef8702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.797341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-86a0561b-e9af-44ac-9e40-3ddbc1ef8702 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:25.798548 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-86a0561b-e9af-44ac-9e40-3ddbc1ef8702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:25.807302 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922383-4fae-4425-a409-b5e5e2919fd7 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:25.842116 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:25.842777 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:25.843174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:25.844123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:25.844990 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=dd50aa56dbe848fcb99bf334f7659f5f) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:25.845306 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:25.846739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:25.852883 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 332/671] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/role_assignments?user.id=dd50aa56dbe848fcb99bf334f7659f5f&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:25.853683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:25.887791 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 340/672] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:25.887791 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0561b-e9af-44ac-9e40-3ddbc1ef8702 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.003812 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58963a3-b76e-41aa-9089-aea7b2b53e43 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.032153 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0561b-e9af-44ac-9e40-3ddbc1ef8702 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.047404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.049846 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.049846 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.049846 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.058069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:26.059534 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:26.073960 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:26.074700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:26.075675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:26.076948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:26.076948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:26.076948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:26.076948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:26.076948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:26.076948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:26.076948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:26.076948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:26.078148 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.078148 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.078148 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.078621 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 333/673] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:26.078621 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.089798 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:26.091278 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:26.106841 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:26.107901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:26.109943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:26.109943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:26.109943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:26.109943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:26.109943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:26.109943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:26.109943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:26.109943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:26.113508 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 341/674] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:26.114431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.211123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8a626-55fc-41fd-b67f-f93ac11fbae4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.246822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059b2cb-9e50-42d6-bba6-ed6cc1325311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.247567 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b2cb-9e50-42d6-bba6-ed6cc1325311 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.247885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b2cb-9e50-42d6-bba6-ed6cc1325311 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.248171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b2cb-9e50-42d6-bba6-ed6cc1325311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.254320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260736d-1a33-4654-9ceb-e02fa65c9f9a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.258889 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059b2cb-9e50-42d6-bba6-ed6cc1325311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-9059b2cb-9e50-42d6-bba6-ed6cc1325311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:26.267209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:26.268301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:26.269235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 334/675] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:26.270005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059b2cb-9e50-42d6-bba6-ed6cc1325311 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.301405 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.302322 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.302917 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.303664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.304933 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:26.305427 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:26.307199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:26.326393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 342/676] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:26.326393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.382581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059b2cb-9e50-42d6-bba6-ed6cc1325311 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.421057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.422896 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.423357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.423825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.424801 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:26.425273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:26.427015 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:26.435139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ed144-84f1-4f7a-a3dc-b53039b2ba40 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.440944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 335/677] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:26.442054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.473514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.474320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.474675 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.475049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.476177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:26.476297 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:26.477746 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:26.486794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 343/678] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:26.488128 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.550361 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05fdf3-aa99-4d21-8179-8a9b38a2ef6b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.592493 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.594095 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.594388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.594665 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.595506 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=4e95ad8de2464133abda7210cd273e06) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:26.595855 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:26.597294 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:26.603100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 336/679] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/role_assignments?user.id=4e95ad8de2464133abda7210cd273e06&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:26.603940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.610630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458c3a9-4af1-4ecd-84e9-1989ecd0171f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.662937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc24f91-bbb5-4b13-832e-53901f5bbf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.664041 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24f91-bbb5-4b13-832e-53901f5bbf06 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.664569 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24f91-bbb5-4b13-832e-53901f5bbf06 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.665059 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc24f91-bbb5-4b13-832e-53901f5bbf06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.666166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc24f91-bbb5-4b13-832e-53901f5bbf06 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=a14b3bdef9874881aa5008410b4259df) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:26.666734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc24f91-bbb5-4b13-832e-53901f5bbf06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:26.668554 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc24f91-bbb5-4b13-832e-53901f5bbf06 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:26.677687 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 344/680] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/role_assignments?user.id=a14b3bdef9874881aa5008410b4259df&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:26.679527 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546f1d-05a7-424d-9825-449a3d23a30f None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.680107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546f1d-05a7-424d-9825-449a3d23a30f None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.680639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546f1d-05a7-424d-9825-449a3d23a30f None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.682735 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 345/681] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:26.689146 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaaceb-6c64-4828-ab86-0ca9c77e12d7 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.689798 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaaceb-6c64-4828-ab86-0ca9c77e12d7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.690319 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaaceb-6c64-4828-ab86-0ca9c77e12d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.731498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-41eaaceb-6c64-4828-ab86-0ca9c77e12d7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:26.733214 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-41eaaceb-6c64-4828-ab86-0ca9c77e12d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:26.773134 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba89e36-7e78-4a3a-b7c0-9df819185d13 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:26.844981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:26.845185 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:26.845440 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:26.845701 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:26.861178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:26.863303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:26.872663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 346/682] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:26.889761 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:26.891394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:26.892431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:26.892431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:26.892431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:26.892431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:26.895927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 337/683] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:26.901740 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaaceb-6c64-4828-ab86-0ca9c77e12d7 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:26.913984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:27.018370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaaceb-6c64-4828-ab86-0ca9c77e12d7 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:27.048752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46f9f8-9a14-4020-91ed-7a9024998e53 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:27.053926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:27.054587 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:27.054868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:27.055145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:27.055901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:27.056208 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:27.057589 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:27.074107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 347/684] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:27.082945 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:27.117510 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9f0b7-b93d-478c-bbec-55ceca20edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:27.118285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f0b7-b93d-478c-bbec-55ceca20edd9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:27.118566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f0b7-b93d-478c-bbec-55ceca20edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:27.118880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f0b7-b93d-478c-bbec-55ceca20edd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:27.140509 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9f0b7-b93d-478c-bbec-55ceca20edd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d2f9f0b7-b93d-478c-bbec-55ceca20edd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:27.153042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:27.154203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:27.155136 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:27.162289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 338/685] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:27.166498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9f0b7-b93d-478c-bbec-55ceca20edd9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:27.282857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5858e-b821-4829-9143-72a5138fdd28 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:27.323097 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:27.323925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:27.324210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:27.324481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:27.334887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:27.336721 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:27.349331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9f0b7-b93d-478c-bbec-55ceca20edd9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:27.357886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:27.359273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:27.360492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:27.370066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 348/686] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:27.376301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:27.393202 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:27.393896 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:27.394240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:27.394452 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:27.395213 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:27.395584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:27.396994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:27.414354 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 339/687] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:27.421273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:27.491623 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6c0a2-221c-4198-bfae-f54d6e7d97f9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:27.528171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:27.529208 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:27.529766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:27.530263 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:27.531986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:27.532515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:27.534146 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:27.552652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 349/688] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:16:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:27.558527 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:27.614732 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78141d52-8bb8-4b82-b732-8858ac2eecf0 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:27.652499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:27.653753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:27.654683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:27.655179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:27.802638 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9b17f-6753-4bff-927d-658a382f5f22 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:27.822174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:27.824113 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:27.849831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:27.850876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:27.851910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:27.851910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:27.851910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:27.851910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:27.854834 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 340/689] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:27.862564 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:27.877569 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d1888-a1a1-4b5d-93f7-e5199402bcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:27.878227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1888-a1a1-4b5d-93f7-e5199402bcb9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:27.878517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1888-a1a1-4b5d-93f7-e5199402bcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:27.878848 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d1888-a1a1-4b5d-93f7-e5199402bcb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.008240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d1888-a1a1-4b5d-93f7-e5199402bcb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:28.011403 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d1888-a1a1-4b5d-93f7-e5199402bcb9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:28.046702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd10a0-1da9-440f-8bea-419dda1f446c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:28.100538 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:28.102078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.102593 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.103077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.104050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:28.104598 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:28.106182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:28.133267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 341/690] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:28.142047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:28.205955 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 350/691] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:16:28.212255 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d1888-a1a1-4b5d-93f7-e5199402bcb9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:28.290327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db229d9e-e276-4896-8c54-9ee005f68d95 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:28.319540 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d1888-a1a1-4b5d-93f7-e5199402bcb9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:28.331556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:28.332396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.332682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.332962 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] PATH_INFO: `/v3/users/nova` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.349205 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:28.350687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:28.358182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7355f82-56ab-496a-a01d-78b1ab8e95e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:28.359955 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355f82-56ab-496a-a01d-78b1ab8e95e9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.360482 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355f82-56ab-496a-a01d-78b1ab8e95e9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.361006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355f82-56ab-496a-a01d-78b1ab8e95e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.371922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7355f82-56ab-496a-a01d-78b1ab8e95e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:28.373722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7355f82-56ab-496a-a01d-78b1ab8e95e9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:28.373921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:28.376115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:28.377182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 342/692] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:16:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:28.384689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e7355f82-56ab-496a-a01d-78b1ab8e95e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:28.402851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:28.404193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:28.406002 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:28.406002 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:28.406002 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:28.406002 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:28.408483 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 351/693] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:28.409958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708510f6-d638-4a60-a65a-fa6ad7c7c554 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.414708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708510f6-d638-4a60-a65a-fa6ad7c7c554 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.415334 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708510f6-d638-4a60-a65a-fa6ad7c7c554 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.417188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 352/694] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:28.418226 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708510f6-d638-4a60-a65a-fa6ad7c7c554 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:28.504366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6adf9-3431-4a19-993c-f08c298dd39c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:28.538967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18319629-c1c4-48ed-bdfe-abcfa861f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:28.539644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319629-c1c4-48ed-bdfe-abcfa861f030 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.540001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319629-c1c4-48ed-bdfe-abcfa861f030 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.540279 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319629-c1c4-48ed-bdfe-abcfa861f030 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.541231 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18319629-c1c4-48ed-bdfe-abcfa861f030 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:28.541493 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18319629-c1c4-48ed-bdfe-abcfa861f030 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:28.542948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18319629-c1c4-48ed-bdfe-abcfa861f030 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:28.554058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708510f6-d638-4a60-a65a-fa6ad7c7c554 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:28.566840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 343/695] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:16:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:28.566840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e1a9d-8323-424c-a5d7-8f92c28050d3 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.566840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e1a9d-8323-424c-a5d7-8f92c28050d3 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.566840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e1a9d-8323-424c-a5d7-8f92c28050d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.592014 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-335e1a9d-8323-424c-a5d7-8f92c28050d3 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:28.593862 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-335e1a9d-8323-424c-a5d7-8f92c28050d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:28.602518 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:28.603553 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.604397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.604959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.606503 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:28.607043 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:28.609264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:28.624036 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 353/696] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:28.626005 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:28.675937 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 344/697] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:28.676885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e1a9d-8323-424c-a5d7-8f92c28050d3 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:28.752205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08450b-4c4e-4850-a0d7-3476e679d18e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:28.797098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e1a9d-8323-424c-a5d7-8f92c28050d3 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:28.799061 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac7e2-7dc8-4e7d-8327-c8e1011db401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:28.800502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac7e2-7dc8-4e7d-8327-c8e1011db401 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.800789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac7e2-7dc8-4e7d-8327-c8e1011db401 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.801070 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bac7e2-7dc8-4e7d-8327-c8e1011db401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.833840 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:28.834665 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:28.834949 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:28.835294 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:28.842404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:28.845287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:28.859474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:28.860625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:28.861611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 345/698] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:28.862139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:28.888292 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bac7e2-7dc8-4e7d-8327-c8e1011db401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:28.890918 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bac7e2-7dc8-4e7d-8327-c8e1011db401 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.007827 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccb403-3a61-4b55-a4d2-fe48340d63e4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:29.029024 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 354/699] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:29.029946 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac7e2-7dc8-4e7d-8327-c8e1011db401 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:29.066097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:29.066806 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.067084 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.067355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.092561 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:29.097070 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:29.133321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:29.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:29.136716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:29.136716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:29.136716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:29.136716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:29.141517 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 346/700] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:29.142541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:29.146987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bac7e2-7dc8-4e7d-8327-c8e1011db401 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:29.181825 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:29.182885 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.183398 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.183920 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.184924 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:29.185490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:29.187752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.200517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 355/701] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:29.201739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:29.271702 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ade61-2b0c-4f98-8a70-78e78aaf6079 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:29.321882 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951558-332c-4586-94fc-25effa54a463 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:29.334178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:29.335650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.337329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.337615 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.360780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:29.361834 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.362348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.362834 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.362959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:29.363940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:29.364448 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.364718 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:29.366348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.384139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 356/702] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:29.385361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:29.403257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:29.404349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:29.405342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:29.405342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:29.405342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:29.405342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:29.414806 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 347/703] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:29.414806 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:29.501515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfc79f-b798-494e-a2df-421c4cfa8c70 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:29.542430 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:29.543880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.544272 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.544655 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.545502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=6fa1a77cf42a46f092b7c5894761dfb9) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:29.545819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:29.547893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.552693 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707ce72-7fc3-432a-b774-c61eaf73ae5f None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:29.553901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 357/704] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:29 2022] GET /identity/v3/role_assignments?user.id=6fa1a77cf42a46f092b7c5894761dfb9&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:29.554702 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:29.600492 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec24b-21ab-410e-8e54-15493bbe86d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:29.602583 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec24b-21ab-410e-8e54-15493bbe86d3 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.603455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec24b-21ab-410e-8e54-15493bbe86d3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.604109 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec24b-21ab-410e-8e54-15493bbe86d3 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.605693 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec24b-21ab-410e-8e54-15493bbe86d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:29.610125 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec24b-21ab-410e-8e54-15493bbe86d3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.641375 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 348/705] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:16:29 2022] POST /identity/v3/users => generated 254 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:29.643141 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c63a3f-3912-4269-a063-cc4266e10bf0 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.643746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c63a3f-3912-4269-a063-cc4266e10bf0 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.644291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c63a3f-3912-4269-a063-cc4266e10bf0 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.645940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 349/706] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:29.647500 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eee70-57f1-45ca-a821-92ebf2844ada None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.648072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eee70-57f1-45ca-a821-92ebf2844ada None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.648608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eee70-57f1-45ca-a821-92ebf2844ada None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.650551 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 350/707] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:29.652426 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3423a8-e30f-434f-9769-82ea6daaaacd None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.652935 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3423a8-e30f-434f-9769-82ea6daaaacd None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.653430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3423a8-e30f-434f-9769-82ea6daaaacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.671917 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-fa3423a8-e30f-434f-9769-82ea6daaaacd None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:29.673620 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-fa3423a8-e30f-434f-9769-82ea6daaaacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:29.704199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016e880-3c2a-42e6-b825-8b1b97011b07 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:29.751027 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:29.751827 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.752122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.752403 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.753160 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:29.753469 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:29.755610 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.774574 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 351/708] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:16:29.778038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 358/709] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:29.779072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:29.780268 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78172d-6e05-4f72-bff5-ccb921971bb9 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.782292 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78172d-6e05-4f72-bff5-ccb921971bb9 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.782842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78172d-6e05-4f72-bff5-ccb921971bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.805830 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-1a78172d-6e05-4f72-bff5-ccb921971bb9 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:29.807431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-1a78172d-6e05-4f72-bff5-ccb921971bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:29.896944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 352/710] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:29.897722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78172d-6e05-4f72-bff5-ccb921971bb9 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:29.917209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7606891-aeee-4ef9-8dc5-7e17aa66fe6c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:29.959666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:29.960494 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:29.960776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:29.961499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:29.972593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:29.974275 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:29.987800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:29.988878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 359/711] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:29.989880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:30.021508 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78172d-6e05-4f72-bff5-ccb921971bb9 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:30.057338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:30.058178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:30.058457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:30.058722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] PATH_INFO: `/v3/services/network` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:30.059379 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:30.060792 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:30.075563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:30.076908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:30.078451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:30.082323 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 353/712] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:29 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:30.083288 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:30.111971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66b26d-f76b-4f62-a210-a8078a2058f9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:30.155201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:30.156651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:30.157095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:30.157497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:30.158226 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:30.160500 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:30.175840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:30.178127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:30.180282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 360/713] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:16:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:30.182233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:30.199145 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e1abd-b03a-46cd-af62-e8d0d1275f95 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:30.243251 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:30.244105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:30.244510 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:30.244797 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:30.245762 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:30.246075 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:30.248107 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:30.264322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 354/714] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:30.265896 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:30.307376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019f431-723f-471d-8f99-ff20326259ca None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:30.345076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:30.345908 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:30.346291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:30.346672 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:30.347490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:30.347949 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:30.349429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:30.359511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 361/715] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:30.360540 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:30.389612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca1351-57f3-4178-af36-d61bcb1fa16e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:30.426186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:30.426973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:30.427364 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:30.427743 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:30.428591 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:30.429021 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:30.430511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:30.435507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 355/716] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:16:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:30.436620 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:30.476570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355fcf-4866-4b14-b248-c3f4e9c697a7 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:30.513719 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:30.514573 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:30.515505 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:30.515959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:30.516984 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=865e4a29d11c4000988326f5ce35b25b) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:30.517400 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:30.518941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:30.525383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 362/717] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:30 2022] GET /identity/v3/role_assignments?user.id=865e4a29d11c4000988326f5ce35b25b&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:30.526399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:30.604171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e445bd1-cbfb-4380-a9c5-8ae90c110489 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:30.652489 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d570dd3-5f2e-4eb7-a2cd-d1f299a696d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:30.657723 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d570dd3-5f2e-4eb7-a2cd-d1f299a696d9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:30.658311 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d570dd3-5f2e-4eb7-a2cd-d1f299a696d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:30.658777 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d570dd3-5f2e-4eb7-a2cd-d1f299a696d9 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:30.659823 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d570dd3-5f2e-4eb7-a2cd-d1f299a696d9 None admin] RBAC: Adding query filter params (type=network) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:30.660306 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d570dd3-5f2e-4eb7-a2cd-d1f299a696d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:30.661883 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d570dd3-5f2e-4eb7-a2cd-d1f299a696d9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:30.677386 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 356/718] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:30.723956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fe272-6255-4b3a-a554-46230d2fe0c1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:30.768459 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca7e15-f676-4cce-943d-78b5e821fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:30.769445 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7e15-f676-4cce-943d-78b5e821fc47 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:30.769892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7e15-f676-4cce-943d-78b5e821fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:30.770351 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7e15-f676-4cce-943d-78b5e821fc47 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:30.771293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca7e15-f676-4cce-943d-78b5e821fc47 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:30.771806 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca7e15-f676-4cce-943d-78b5e821fc47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:30.773438 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca7e15-f676-4cce-943d-78b5e821fc47 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:30.781482 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 363/719] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:16:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:32.220045 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e7f3-8b22-48a4-9f35-7299d4848125 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:32.220638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e7f3-8b22-48a4-9f35-7299d4848125 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:32.220638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e7f3-8b22-48a4-9f35-7299d4848125 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:32.222271 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 357/720] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:32.228217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8725cc-4473-4a08-9a09-5ce32c87d038 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:32.228639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8725cc-4473-4a08-9a09-5ce32c87d038 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:32.228801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8725cc-4473-4a08-9a09-5ce32c87d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:32.259709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-eb8725cc-4473-4a08-9a09-5ce32c87d038 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:32.260950 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-eb8725cc-4473-4a08-9a09-5ce32c87d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:32.350502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 364/721] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:16:32.350897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cdf4f-e13a-4ff0-b5b6-b47ed4d4091a None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:32.351267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cdf4f-e13a-4ff0-b5b6-b47ed4d4091a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:32.351677 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cdf4f-e13a-4ff0-b5b6-b47ed4d4091a None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:32.353389 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 358/722] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:16:32.359214 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d1da1-87ee-49a7-8699-a97184f0f87e None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:32.359506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d1da1-87ee-49a7-8699-a97184f0f87e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:32.359804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d1da1-87ee-49a7-8699-a97184f0f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:32.383868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-684d1da1-87ee-49a7-8699-a97184f0f87e None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:32.385056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-684d1da1-87ee-49a7-8699-a97184f0f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:32.408207 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cdf4f-e13a-4ff0-b5b6-b47ed4d4091a None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:32.522415 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 365/723] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:32.523518 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cdf4f-e13a-4ff0-b5b6-b47ed4d4091a None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:32.559997 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b590c-31cc-448a-bbbc-d8abc86166c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:32.561134 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b590c-31cc-448a-bbbc-d8abc86166c8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:32.561996 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b590c-31cc-448a-bbbc-d8abc86166c8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:32.563086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b590c-31cc-448a-bbbc-d8abc86166c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:32.563216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d1da1-87ee-49a7-8699-a97184f0f87e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:32.588297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b590c-31cc-448a-bbbc-d8abc86166c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-9f4b590c-31cc-448a-bbbc-d8abc86166c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:32.597540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:32.598568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:32.599473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:32.602881 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 359/724] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:32.608789 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b590c-31cc-448a-bbbc-d8abc86166c8 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:32.776094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d1da1-87ee-49a7-8699-a97184f0f87e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:32.793980 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b590c-31cc-448a-bbbc-d8abc86166c8 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:32.832942 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:32.833635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:32.833924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:32.834199 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:32.834980 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:32.835288 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:32.836743 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:32.851646 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 360/725] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:32.853166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:32.955016 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c20db-b14e-43d0-8fbb-8346cbba9dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:32.955850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c20db-b14e-43d0-8fbb-8346cbba9dfa None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:32.956136 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c20db-b14e-43d0-8fbb-8346cbba9dfa None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:32.956410 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c20db-b14e-43d0-8fbb-8346cbba9dfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:32.974476 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c20db-b14e-43d0-8fbb-8346cbba9dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-821c20db-b14e-43d0-8fbb-8346cbba9dfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:32.982361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:32.984114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:32.985031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:32.985735 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 366/726] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:32.991051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c20db-b14e-43d0-8fbb-8346cbba9dfa None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:33.087898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54733d71-6aec-41ce-8331-b1b38f5a1ea9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:33.142300 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:33.143109 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.143394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.143673 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.157315 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:33.159550 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:33.179319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:33.180383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:33.181372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:33.181372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:33.181372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:33.181372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:33.181372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 361/727] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:33.188988 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:33.207787 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c20db-b14e-43d0-8fbb-8346cbba9dfa None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:33.271400 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:33.273531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.273821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.274097 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.274868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:33.275180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:33.276593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:33.298908 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 367/728] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:33.304499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:33.363526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d489cb-9bc4-4287-a505-903ad7660fd9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:33.411466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:33.413329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.413616 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.413894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.416954 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:33.417277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:33.418675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:33.443045 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 362/729] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:33.449417 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:33.463236 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727918f3-6942-48fa-931b-fb9c7fcc2d39 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:33.500264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce454b3-5d51-4719-a965-2ecb33c505b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:33.501053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce454b3-5d51-4719-a965-2ecb33c505b6 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.501330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce454b3-5d51-4719-a965-2ecb33c505b6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.501968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce454b3-5d51-4719-a965-2ecb33c505b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.514619 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce454b3-5d51-4719-a965-2ecb33c505b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:33.517572 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce454b3-5d51-4719-a965-2ecb33c505b6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-2ce454b3-5d51-4719-a965-2ecb33c505b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:33.535939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:33.538198 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:33.540512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:33.540512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:33.540512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:33.540512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:33.540512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 368/730] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:33.540512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c047d-853c-4435-96df-0b23ea7a5e23 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.540512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c047d-853c-4435-96df-0b23ea7a5e23 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.540512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c047d-853c-4435-96df-0b23ea7a5e23 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.545211 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 369/731] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:33.546116 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c047d-853c-4435-96df-0b23ea7a5e23 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:33.578184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c656b19-e8c3-41ca-b482-8343bc43fbe8 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:33.614511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e542d-2bf3-4cc5-85d9-bb74400187af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:33.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e542d-2bf3-4cc5-85d9-bb74400187af None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.615604 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e542d-2bf3-4cc5-85d9-bb74400187af None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.616252 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e542d-2bf3-4cc5-85d9-bb74400187af None admin] PATH_INFO: `/v3/users/swift` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.623968 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e542d-2bf3-4cc5-85d9-bb74400187af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:33.625593 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e542d-2bf3-4cc5-85d9-bb74400187af None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-a84e542d-2bf3-4cc5-85d9-bb74400187af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:33.641330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:33.642624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:33.643884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 363/732] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:33.644537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0cf9-b5f8-41e2-8bbb-8c8bb7506658 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.644627 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0cf9-b5f8-41e2-8bbb-8c8bb7506658 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.644848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f0cf9-b5f8-41e2-8bbb-8c8bb7506658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.663515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c047d-853c-4435-96df-0b23ea7a5e23 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:33.664025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-c04f0cf9-b5f8-41e2-8bbb-8c8bb7506658 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:33.665095 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-c04f0cf9-b5f8-41e2-8bbb-8c8bb7506658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:33.698267 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785f2ca-5dd2-4709-b5ff-a0a6dffa97c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:33.698923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785f2ca-5dd2-4709-b5ff-a0a6dffa97c3 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.699203 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785f2ca-5dd2-4709-b5ff-a0a6dffa97c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.699477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785f2ca-5dd2-4709-b5ff-a0a6dffa97c3 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.700230 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785f2ca-5dd2-4709-b5ff-a0a6dffa97c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:33.700528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785f2ca-5dd2-4709-b5ff-a0a6dffa97c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:33.701877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785f2ca-5dd2-4709-b5ff-a0a6dffa97c3 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:33.717049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 370/733] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:33.717049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89c3f-8ef4-43f2-a59f-cb896da2baf0 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.717049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89c3f-8ef4-43f2-a59f-cb896da2baf0 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.717049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89c3f-8ef4-43f2-a59f-cb896da2baf0 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.717049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 371/734] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:33.717049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a89c3f-8ef4-43f2-a59f-cb896da2baf0 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:33.737869 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 364/735] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:33.738717 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f0cf9-b5f8-41e2-8bbb-8c8bb7506658 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:33.839131 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a89c3f-8ef4-43f2-a59f-cb896da2baf0 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:33.847291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f0cf9-b5f8-41e2-8bbb-8c8bb7506658 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:33.871824 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108929e8-1b81-4430-a402-c695315816cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:33.872426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108929e8-1b81-4430-a402-c695315816cc None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.872708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108929e8-1b81-4430-a402-c695315816cc None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.872987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108929e8-1b81-4430-a402-c695315816cc None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.873818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108929e8-1b81-4430-a402-c695315816cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:33.874710 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108929e8-1b81-4430-a402-c695315816cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:33.876159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108929e8-1b81-4430-a402-c695315816cc None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:33.879886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:33.880698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.880983 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.881258 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.888193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:33.890149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:33.893119 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 372/736] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:16:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:33.894389 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2f38-a671-43b4-a2ff-1a4b9aedcea7 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.894618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2f38-a671-43b4-a2ff-1a4b9aedcea7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.894898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2f38-a671-43b4-a2ff-1a4b9aedcea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:33.905275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:33.906353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 365/737] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:16:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:33.907407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:33.912652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-85ae2f38-a671-43b4-a2ff-1a4b9aedcea7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:33.914543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-85ae2f38-a671-43b4-a2ff-1a4b9aedcea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:33.975923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 373/738] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:33.977342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030bd98-7def-4180-9493-d43d9440f2c8 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:33.977630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030bd98-7def-4180-9493-d43d9440f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:33.977903 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030bd98-7def-4180-9493-d43d9440f2c8 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:33.983288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 374/739] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:33.983288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030bd98-7def-4180-9493-d43d9440f2c8 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.008899 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f4ba0-a42b-44f1-8f53-5642477bafba None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.041002 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ca788-6617-4cf4-b43c-b77613b7ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.041664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca788-6617-4cf4-b43c-b77613b7ee1e None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.041939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca788-6617-4cf4-b43c-b77613b7ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.042214 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca788-6617-4cf4-b43c-b77613b7ee1e None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.042926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ca788-6617-4cf4-b43c-b77613b7ee1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.044311 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ca788-6617-4cf4-b43c-b77613b7ee1e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.059925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 366/740] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:16:33 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:34.060755 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ca788-6617-4cf4-b43c-b77613b7ee1e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.106965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030bd98-7def-4180-9493-d43d9440f2c8 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.146270 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3326a-d78d-484a-b4b9-aa269175c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3326a-d78d-484a-b4b9-aa269175c853 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.147127 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3326a-d78d-484a-b4b9-aa269175c853 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.147405 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3326a-d78d-484a-b4b9-aa269175c853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.172883 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ca788-6617-4cf4-b43c-b77613b7ee1e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.208655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28c3d3-b8f2-4430-b5a5-706b2f95ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.209342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c3d3-b8f2-4430-b5a5-706b2f95ee01 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.209633 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c3d3-b8f2-4430-b5a5-706b2f95ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.209911 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c3d3-b8f2-4430-b5a5-706b2f95ee01 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.210772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28c3d3-b8f2-4430-b5a5-706b2f95ee01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:34.211086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28c3d3-b8f2-4430-b5a5-706b2f95ee01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.212587 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28c3d3-b8f2-4430-b5a5-706b2f95ee01 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.220393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3326a-d78d-484a-b4b9-aa269175c853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.221949 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3326a-d78d-484a-b4b9-aa269175c853 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.235866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 367/741] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:16:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:34.235866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6d1a-3d81-43e4-af96-c2878069f207 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.235866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6d1a-3d81-43e4-af96-c2878069f207 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.235866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a6d1a-3d81-43e4-af96-c2878069f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.252450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-f90a6d1a-3d81-43e4-af96-c2878069f207 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:34.253638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-f90a6d1a-3d81-43e4-af96-c2878069f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:34.323978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 375/742] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:34.328037 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3326a-d78d-484a-b4b9-aa269175c853 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.331921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 368/743] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:16:34.333146 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a6d1a-3d81-43e4-af96-c2878069f207 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.424683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3326a-d78d-484a-b4b9-aa269175c853 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.432549 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a6d1a-3d81-43e4-af96-c2878069f207 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.459051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bb30-644d-4965-95f0-bbb7d2a69dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.459971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bb30-644d-4965-95f0-bbb7d2a69dfc None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.460333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bb30-644d-4965-95f0-bbb7d2a69dfc None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.460621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bb30-644d-4965-95f0-bbb7d2a69dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.466956 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ebfc-c1ec-4c42-8ce4-b7541a476486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.467593 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ebfc-c1ec-4c42-8ce4-b7541a476486 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.468150 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ebfc-c1ec-4c42-8ce4-b7541a476486 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.468521 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416ebfc-c1ec-4c42-8ce4-b7541a476486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.471852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945bb30-644d-4965-95f0-bbb7d2a69dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e945bb30-644d-4965-95f0-bbb7d2a69dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:34.479404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:34.480485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 376/744] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:34.481419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bb30-644d-4965-95f0-bbb7d2a69dfc None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.541990 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416ebfc-c1ec-4c42-8ce4-b7541a476486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.543742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416ebfc-c1ec-4c42-8ce4-b7541a476486 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bb30-644d-4965-95f0-bbb7d2a69dfc None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.621308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.622091 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.622369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.622637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.636863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.639076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:34.659313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:34.660506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:34.661487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:34.661487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:34.661487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:34.661487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:34.665327 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 377/745] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:34.665683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 369/746] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:34 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:16:34.665863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.666798 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ebfc-c1ec-4c42-8ce4-b7541a476486 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.762034 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce6d41-9d4a-4a79-a430-a9959705babf None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.762403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416ebfc-c1ec-4c42-8ce4-b7541a476486 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.797249 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2121-2f1c-4e1b-ae2a-027b0d8cf49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.797479 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.797924 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2121-2f1c-4e1b-ae2a-027b0d8cf49c None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.798040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.798243 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.798349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2121-2f1c-4e1b-ae2a-027b0d8cf49c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.798515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.798626 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2121-2f1c-4e1b-ae2a-027b0d8cf49c None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.799195 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c2121-2f1c-4e1b-ae2a-027b0d8cf49c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.799311 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:34.799512 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.800612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c2121-2f1c-4e1b-ae2a-027b0d8cf49c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.800903 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.814719 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 370/747] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:34.815605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.828064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 378/748] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:16:34 2022] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:34.828064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2121-2f1c-4e1b-ae2a-027b0d8cf49c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:34.937474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a457191-e365-42ab-8a33-f88f39a4211e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.939102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2121-2f1c-4e1b-ae2a-027b0d8cf49c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:34.976915 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.977722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.978008 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.978287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.979221 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:34.980181 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:34.980629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:34.981081 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:34.981991 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:34.982466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.984233 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.991175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:34.992713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:34.998318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 371/749] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:35.000220 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:35.012429 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:35.013452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:35.014477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:35.014477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:35.014477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:35.014477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:35.014477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 379/750] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:35.014477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.109105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb7cb2-de8d-489a-9708-cc417c8a1e8e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.121076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953713eb-ee3e-40fd-9e7a-498d40fa6f27 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.156814 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb073f-8069-4c71-b433-284af259647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.157970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb073f-8069-4c71-b433-284af259647a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.158460 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb073f-8069-4c71-b433-284af259647a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.158951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb073f-8069-4c71-b433-284af259647a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.160961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.162236 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.162538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.162816 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.170295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb073f-8069-4c71-b433-284af259647a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.172519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.173246 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb073f-8069-4c71-b433-284af259647a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.174018 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:35.191344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:35.192409 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:35.193489 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 380/751] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:35.194035 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-18eb073f-8069-4c71-b433-284af259647a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:35.196736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:35.197685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:35.198686 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:35.198686 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:35.198686 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:35.198686 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:35.200928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 372/752] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:35.201937 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb073f-8069-4c71-b433-284af259647a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.310821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb073f-8069-4c71-b433-284af259647a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.311492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383109f-d563-4d0f-834a-40617f0bb089 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.348110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.349102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.349752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.349869 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.350171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.350521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.350708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.351178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.351428 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:35.351838 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.352603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:35.353100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.353402 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.355102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.366882 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 381/753] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:35.367937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.370267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 373/754] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:35.372087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.488991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc52d01-3cd6-436e-b7fe-938a28faefd9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.496123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fd40e-97d5-4328-92fd-80cfa0634be9 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.532506 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.533611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.534123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.534590 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.536014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.536995 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.537353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.537741 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.538922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:35.539302 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.540814 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.543929 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.545592 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.555464 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 382/755] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:35.556492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:35.564365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:35.565343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:35.566322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:35.566322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:35.566322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:35.566322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:35.566322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:35.566322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:35.566322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:35.566322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:35.569011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 374/756] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:35.570321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.672932 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb652d9-6459-4fd6-932e-a1550d90e540 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.684191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a48d5-3a2e-4916-978f-8e60e9064d8b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.710362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.711584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.712457 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.713080 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.714272 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=6fa1a77cf42a46f092b7c5894761dfb9) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:35.714923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.717228 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.721405 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.722273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.722618 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.722961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.725135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 383/757] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/role_assignments?user.id=6fa1a77cf42a46f092b7c5894761dfb9&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:35.726824 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.731623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.732841 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:35.751092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:35.752267 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:35.753374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:35.757187 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 375/758] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:35.758517 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.852786 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715f32-acc5-4597-8c28-8b7364c121d8 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.884528 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fd317-b124-4067-a475-ef7bd4673e40 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:35.889424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.890289 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.890658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.891020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.891929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:35.892303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.893796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.907254 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 384/759] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:35.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:35.933540 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:35.934655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:35.935158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:35.935671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:35.937383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:35.938174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:35.939961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:35.974197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 376/760] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:35.989265 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:36.029089 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89568c3-8e63-4ee2-9e48-1c48bff38e98 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:36.063888 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:36.064543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:36.064822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:36.065095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:36.066012 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=a8c0147cba5e4243acc460b09031bbad) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:36.066220 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:36.067895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:36.074816 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 385/761] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/role_assignments?user.id=a8c0147cba5e4243acc460b09031bbad&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:36.109804 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358159-25ec-4b10-b6a4-96ff25f563c2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:36.151461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:36.152338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:36.152624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:36.152901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:36.166799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:36.168287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:36.195396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:36.196754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:36.197767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:36.197767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:36.197767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:36.197767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:36.198446 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 377/762] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:36.202856 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:36.364464 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96ab97-414b-449e-847a-752af2e2add1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:36.406467 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179d854-3c46-4481-ac71-fc2b434b4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:36.407522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179d854-3c46-4481-ac71-fc2b434b4916 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:36.408052 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179d854-3c46-4481-ac71-fc2b434b4916 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:36.408566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179d854-3c46-4481-ac71-fc2b434b4916 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:36.409514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179d854-3c46-4481-ac71-fc2b434b4916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:36.410071 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179d854-3c46-4481-ac71-fc2b434b4916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:36.411657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179d854-3c46-4481-ac71-fc2b434b4916 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:36.429774 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 386/763] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:36.437630 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:36.520350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec576d-cca7-45cf-8cc8-a62055b0873f None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:36.520707 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec576d-cca7-45cf-8cc8-a62055b0873f None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:36.520920 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec576d-cca7-45cf-8cc8-a62055b0873f None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:36.522543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 387/764] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:36.527800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81338d-976f-4b70-a4f2-200b9253c8f6 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:36.528171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81338d-976f-4b70-a4f2-200b9253c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:36.528449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81338d-976f-4b70-a4f2-200b9253c8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:36.552743 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc2b6c-a6ec-499d-938a-b150dd2ab843 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:36.564819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-fd81338d-976f-4b70-a4f2-200b9253c8f6 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:36.566537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-fd81338d-976f-4b70-a4f2-200b9253c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:36.590310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:36.591155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:36.591471 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:36.591754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:36.599956 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:36.601637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:36.637577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:36.638579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:36.639641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:36.639641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:36.639641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:36.639641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:36.639641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:36.639641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:36.639641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:36.639641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:36.643784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 378/765] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:36.647019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:36.713756 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 388/766] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:36.737025 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81338d-976f-4b70-a4f2-200b9253c8f6 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:36.837671 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81338d-976f-4b70-a4f2-200b9253c8f6 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:36.847421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5cfa1-9cb5-4c5b-92d1-e6edae5b6a7f None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:36.891560 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:36.892986 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:36.893598 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:36.894182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:36.895201 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:36.895720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:36.897389 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:36.901490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:36.902313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:36.902600 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:36.902879 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:36.903546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:36.904956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:36.913669 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 379/767] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:36.919918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:36.932792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:36.933880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:36.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:36.940290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 389/768] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:16:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:36.948032 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:37.079584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688e614-8770-4e3f-bac6-5976dc98941c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:37.130897 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3741231-e8e4-4fc6-b4a5-65423a3bde1a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:37.147550 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea1a68-d7c7-41f1-8515-285ea8019c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:37.148822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1a68-d7c7-41f1-8515-285ea8019c8b None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:37.149301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1a68-d7c7-41f1-8515-285ea8019c8b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:37.149786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1a68-d7c7-41f1-8515-285ea8019c8b None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/865e4a29d11c4000988326f5ce35b25b/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:37.153501 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea1a68-d7c7-41f1-8515-285ea8019c8b None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=865e4a29d11c4000988326f5ce35b25b, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:37.156247 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea1a68-d7c7-41f1-8515-285ea8019c8b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:37.174505 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 380/769] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:36 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/865e4a29d11c4000988326f5ce35b25b/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:16:37.208674 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:37.209362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:37.209656 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:37.209940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:37.210675 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:37.210988 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:37.212403 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:37.218051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 390/770] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:16:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:37.224192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea1a68-d7c7-41f1-8515-285ea8019c8b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:37.377273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea1a68-d7c7-41f1-8515-285ea8019c8b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:37.416304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:37.417303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:37.417782 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:37.418266 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:37.419186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:37.419687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:37.421434 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:37.427270 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 381/771] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:16:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:37.433333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:37.544963 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8eb03-ccf4-47fd-be19-8847cc6dddbc None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:37.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b5b1e-51fa-43ce-b82a-2634e9c452bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:37.594144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5b1e-51fa-43ce-b82a-2634e9c452bf None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:37.594643 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5b1e-51fa-43ce-b82a-2634e9c452bf None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:37.595110 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b5b1e-51fa-43ce-b82a-2634e9c452bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:37.596133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5b1e-51fa-43ce-b82a-2634e9c452bf None admin] RBAC: Adding query filter params (interface=public, service_id=a438f4d1339143eaa260e1828f6d4fa8, region_id=RegionOne) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:37.596641 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5b1e-51fa-43ce-b82a-2634e9c452bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:37.598232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b5b1e-51fa-43ce-b82a-2634e9c452bf None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:37.606813 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 391/772] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:16:37 2022] GET /identity/v3/endpoints?service_id=a438f4d1339143eaa260e1828f6d4fa8&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:37.612583 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:37.717331 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad554a-af58-4dc2-98d6-0c920485cfaa None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:37.753495 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b15d1-f664-4696-9808-5a3880b5a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:37.754518 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b15d1-f664-4696-9808-5a3880b5a808 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:37.755016 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b15d1-f664-4696-9808-5a3880b5a808 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:37.755482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b15d1-f664-4696-9808-5a3880b5a808 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:37.756399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b15d1-f664-4696-9808-5a3880b5a808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:37.758030 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b15d1-f664-4696-9808-5a3880b5a808 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:37.767874 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 382/773] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:16:37 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:37.783070 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48957e8d-1ad1-4e2e-afd9-f8d3846fd23a None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:37.783367 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48957e8d-1ad1-4e2e-afd9-f8d3846fd23a None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:37.783653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48957e8d-1ad1-4e2e-afd9-f8d3846fd23a None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:37.785197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 392/774] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:37.791169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d267-69e7-4c4f-9333-2fa4828be73b None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:37.791870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d267-69e7-4c4f-9333-2fa4828be73b None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:37.792381 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92d267-69e7-4c4f-9333-2fa4828be73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:37.812780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-de92d267-69e7-4c4f-9333-2fa4828be73b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:37.814482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-de92d267-69e7-4c4f-9333-2fa4828be73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:37.897481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 383/775] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:37.922323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48957e8d-1ad1-4e2e-afd9-f8d3846fd23a None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:38.058380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48957e8d-1ad1-4e2e-afd9-f8d3846fd23a None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:38.101799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:38.102962 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:38.103500 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:38.104043 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] PATH_INFO: `/v3/services/network` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:38.104931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:38.106508 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:38.120077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:38.121232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:38.122149 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:38.125935 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 393/776] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:37 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:38.132089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92d267-69e7-4c4f-9333-2fa4828be73b None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:38.240029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92d267-69e7-4c4f-9333-2fa4828be73b None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:38.284342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68663c06-4ff8-4436-983f-dd8106d5a9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:38.285437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68663c06-4ff8-4436-983f-dd8106d5a9ff None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:38.285929 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68663c06-4ff8-4436-983f-dd8106d5a9ff None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:38.286407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68663c06-4ff8-4436-983f-dd8106d5a9ff None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:38.287336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68663c06-4ff8-4436-983f-dd8106d5a9ff None admin] RBAC: Adding query filter params (name=network) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:38.287895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68663c06-4ff8-4436-983f-dd8106d5a9ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:38.289476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68663c06-4ff8-4436-983f-dd8106d5a9ff None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:38.300202 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 384/777] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:38.306282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:38.444286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a2fa6-a995-471c-aac6-618d0260adb8 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:38.492473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:38.493562 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:38.494063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:38.494544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:38.495456 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] RBAC: Adding query filter params (type=network) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:38.496003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:38.497566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:38.500456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd393-b1f2-4547-b25b-70bf8cec595a None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:38.501000 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd393-b1f2-4547-b25b-70bf8cec595a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:38.501511 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd393-b1f2-4547-b25b-70bf8cec595a None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:38.503344 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 385/778] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:38.508358 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982bc20-2d94-4a71-95ca-e572a40536ee None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:38.508649 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982bc20-2d94-4a71-95ca-e572a40536ee None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:38.508930 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982bc20-2d94-4a71-95ca-e572a40536ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:38.509513 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 394/779] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:38.515693 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:38.532262 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-a982bc20-2d94-4a71-95ca-e572a40536ee None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:38.533464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-a982bc20-2d94-4a71-95ca-e572a40536ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:38.625356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 386/780] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:38.660470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982bc20-2d94-4a71-95ca-e572a40536ee None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:38.734697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100c93-6890-47e3-844c-5eae676b5099 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:38.789199 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982bc20-2d94-4a71-95ca-e572a40536ee None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:38.831240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d30825-87e4-4e84-afb9-e3a713ac22eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:38.833353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d30825-87e4-4e84-afb9-e3a713ac22eb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:38.833641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d30825-87e4-4e84-afb9-e3a713ac22eb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:38.833919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d30825-87e4-4e84-afb9-e3a713ac22eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:38.835026 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ffaf3-50ea-4dbf-83d5-61ce9220d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:38.835678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffaf3-50ea-4dbf-83d5-61ce9220d8ca None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:38.835984 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffaf3-50ea-4dbf-83d5-61ce9220d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:38.836258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffaf3-50ea-4dbf-83d5-61ce9220d8ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:38.837069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ffaf3-50ea-4dbf-83d5-61ce9220d8ca None admin] RBAC: Adding query filter params (interface=public, service_id=b236c4c5d32d45de851d3f22849de19d, region_id=RegionOne) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:38.837380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ffaf3-50ea-4dbf-83d5-61ce9220d8ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:38.838749 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ffaf3-50ea-4dbf-83d5-61ce9220d8ca None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:38.852804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 395/781] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:16:38 2022] GET /identity/v3/endpoints?service_id=b236c4c5d32d45de851d3f22849de19d&interface=public®ion_id=RegionOne => generated 194 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:38.855696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d30825-87e4-4e84-afb9-e3a713ac22eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:38.859227 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933195-3d9a-42aa-bf0f-ed6cc6533956 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:38.859529 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933195-3d9a-42aa-bf0f-ed6cc6533956 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:38.859856 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62933195-3d9a-42aa-bf0f-ed6cc6533956 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:38.861440 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 396/782] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:38.862155 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933195-3d9a-42aa-bf0f-ed6cc6533956 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-86d30825-87e4-4e84-afb9-e3a713ac22eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:38.864520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:38.865515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:38.866429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 387/783] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:38.871514 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d30825-87e4-4e84-afb9-e3a713ac22eb None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:38.976629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62933195-3d9a-42aa-bf0f-ed6cc6533956 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:38.998342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d30825-87e4-4e84-afb9-e3a713ac22eb None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:39.012796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ddab9-737b-4dfd-b31a-66a65fa2a8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.013618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ddab9-737b-4dfd-b31a-66a65fa2a8d9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.014008 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ddab9-737b-4dfd-b31a-66a65fa2a8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.015002 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ddab9-737b-4dfd-b31a-66a65fa2a8d9 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.016434 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ddab9-737b-4dfd-b31a-66a65fa2a8d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:39.017912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ddab9-737b-4dfd-b31a-66a65fa2a8d9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:39.023856 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 397/784] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:16:38 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:39.025272 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193552-5b48-4c1e-aeed-e770d5d6485b None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.025707 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193552-5b48-4c1e-aeed-e770d5d6485b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.026095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60193552-5b48-4c1e-aeed-e770d5d6485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.052063 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.052818 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.054253 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.054559 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.055364 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:39.055678 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:39.057173 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-60193552-5b48-4c1e-aeed-e770d5d6485b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:39.058407 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-60193552-5b48-4c1e-aeed-e770d5d6485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:39.060904 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:39.080408 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 388/785] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:39.087603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:39.215053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 398/786] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:39.257216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60193552-5b48-4c1e-aeed-e770d5d6485b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:39.261359 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f8f65-36a2-4255-abee-2f7920f04e96 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:39.298598 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.299445 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.299734 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.300044 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.310966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:39.313235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:39.331172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:39.332210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:39.333208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:39.333208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:39.333208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:39.333208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:39.333208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 389/787] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:39.338454 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:39.366317 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60193552-5b48-4c1e-aeed-e770d5d6485b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:39.406199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c012c0-6f8c-488c-a672-b67c9bacb240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.407016 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c012c0-6f8c-488c-a672-b67c9bacb240 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.407303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c012c0-6f8c-488c-a672-b67c9bacb240 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.407589 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c012c0-6f8c-488c-a672-b67c9bacb240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.424779 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c012c0-6f8c-488c-a672-b67c9bacb240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e8c012c0-6f8c-488c-a672-b67c9bacb240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:39.438609 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:39.439734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:39.440678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:39.443671 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 399/788] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:39.448101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498fff8-ce0f-4e78-b06c-2b4adc03abde None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:39.449681 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c012c0-6f8c-488c-a672-b67c9bacb240 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:39.484386 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.491906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.491906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.491906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.491906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:39.491906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:39.491906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:39.501470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 390/789] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:39.507009 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:39.604279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c012c0-6f8c-488c-a672-b67c9bacb240 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:39.641316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.642385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.642899 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.643382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.644362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:39.644895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:39.646482 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:39.648193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bd6cd-c39c-4c6a-ad67-6d622106fdfe None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:39.656625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 400/790] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:39.668905 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:39.703026 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.704081 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.704228 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.704455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] PATH_INFO: `/v3/users/swift` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.715165 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:39.716760 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:39.745672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:39.746764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:39.747852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 391/791] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:39.757005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:39.789958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de354b07-b47f-4fff-b679-cd47621bcbb6 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:39.826523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.828282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.828775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.829284 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.840829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:39.843683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:39.860669 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110136-4054-4f03-a07c-0d98f4e8ca0c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:39.861839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:39.862789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:39.863755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:39.863755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:39.863755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:39.863755 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:39.865963 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 401/792] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:39.873413 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:39.895678 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:39.896393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:39.896680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:39.896959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:39.897809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:39.898121 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:39.900357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:39.923790 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 392/793] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:39.924271 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.008330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11675664-3675-4edc-a88d-63c4bee5a45e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.034330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83222f55-d0de-450a-a238-f408fff3ed7b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.070462 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.071516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.071824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.072105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.083430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.084923 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:40.101984 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.102581 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.102873 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.103152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:40.103584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:40.104626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:40.105603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:40.105603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:40.105603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:40.105603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:40.105854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:40.105854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.106007 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 393/794] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:40.106081 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:40.110687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.131279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 402/795] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:40.136814 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.215645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d540d1-ffa8-415e-827c-5b4423657997 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.260538 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.261224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.261512 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.261790 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.262535 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:40.262847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.264265 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:40.285409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 394/796] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:40.290827 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.305613 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d829d9-6e8a-4274-bfc8-62874a4c63dd None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.345858 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9daa8-b8bd-42e3-ace6-3c09b8f72262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.346669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9daa8-b8bd-42e3-ace6-3c09b8f72262 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.346953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9daa8-b8bd-42e3-ace6-3c09b8f72262 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.347230 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9daa8-b8bd-42e3-ace6-3c09b8f72262 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.356425 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9daa8-b8bd-42e3-ace6-3c09b8f72262 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.357826 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9daa8-b8bd-42e3-ace6-3c09b8f72262 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-96c9daa8-b8bd-42e3-ace6-3c09b8f72262 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:40.373586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:40.375373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:40.376502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 403/797] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:16:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:40.377154 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696364dd-703c-479b-b59b-14c469978c33 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.377994 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696364dd-703c-479b-b59b-14c469978c33 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.377994 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696364dd-703c-479b-b59b-14c469978c33 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.387638 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 404/798] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:40.387638 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696364dd-703c-479b-b59b-14c469978c33 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.435395 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae371c-178a-448f-b44f-f716e10ac8f1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.471960 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0e7f8-72f0-4de4-ac57-3fdf6d5e49ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.473148 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0e7f8-72f0-4de4-ac57-3fdf6d5e49ce None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.473651 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0e7f8-72f0-4de4-ac57-3fdf6d5e49ce None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.474163 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0e7f8-72f0-4de4-ac57-3fdf6d5e49ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.481466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0e7f8-72f0-4de4-ac57-3fdf6d5e49ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.483229 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0e7f8-72f0-4de4-ac57-3fdf6d5e49ce None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:40.489846 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696364dd-703c-479b-b59b-14c469978c33 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-4cc0e7f8-72f0-4de4-ac57-3fdf6d5e49ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:40.498924 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:40.499946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:40.500940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:40.500940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:40.500940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:40.500940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:40.500940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:40.500940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:40.500940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:40.500940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:40.508146 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 395/799] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:40.509768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75354a-19e5-4087-8e78-6c95230df1e3 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.510301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75354a-19e5-4087-8e78-6c95230df1e3 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.510795 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75354a-19e5-4087-8e78-6c95230df1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.525622 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.526309 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.526597 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.526884 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.527794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:40.528206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.529827 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:40.530484 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-0a75354a-19e5-4087-8e78-6c95230df1e3 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:40.532082 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-0a75354a-19e5-4087-8e78-6c95230df1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:40.555751 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 405/800] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:16:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:40.556794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.619977 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 396/801] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:40.621062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75354a-19e5-4087-8e78-6c95230df1e3 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.677801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1aceb-7642-4dc3-b47e-a9908614fa3d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.714458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.715381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.715848 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.716317 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.717271 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:40.718309 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.719947 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:40.732321 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 406/802] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:40.734159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.751297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75354a-19e5-4087-8e78-6c95230df1e3 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.789778 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.790667 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.790958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.791234 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.802040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.803521 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:40.822660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:40.823886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:40.825060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:40.825060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:40.825060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:40.825060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:40.828592 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 397/803] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:40.829411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.840635 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d876c9-871d-4e62-9e8a-2e0ff0a62fd9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.875335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5d791-5a84-4563-947e-96f4ea7bceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.876070 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d791-5a84-4563-947e-96f4ea7bceff None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.876356 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d791-5a84-4563-947e-96f4ea7bceff None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.876638 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5d791-5a84-4563-947e-96f4ea7bceff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.886481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5d791-5a84-4563-947e-96f4ea7bceff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-6aa5d791-5a84-4563-947e-96f4ea7bceff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:40.894185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:40.895455 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:40.896775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 407/804] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:40.901084 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28f53b-ea86-49d2-baf1-c1ffb943d279 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.901376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28f53b-ea86-49d2-baf1-c1ffb943d279 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.901662 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28f53b-ea86-49d2-baf1-c1ffb943d279 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.902959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 408/805] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:40.903652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28f53b-ea86-49d2-baf1-c1ffb943d279 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:40.935432 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a159c-a380-4d85-9ffb-551bc4e25d4c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:40.973124 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206ed57-0886-4959-a4f5-afb6ebaafe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:40.974467 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206ed57-0886-4959-a4f5-afb6ebaafe53 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:40.974991 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206ed57-0886-4959-a4f5-afb6ebaafe53 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:40.975423 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206ed57-0886-4959-a4f5-afb6ebaafe53 None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/6fa1a77cf42a46f092b7c5894761dfb9/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:40.977672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206ed57-0886-4959-a4f5-afb6ebaafe53 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=6fa1a77cf42a46f092b7c5894761dfb9, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:40.979341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206ed57-0886-4959-a4f5-afb6ebaafe53 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.002319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 398/806] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:40 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/6fa1a77cf42a46f092b7c5894761dfb9/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:16:41.002319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206ed57-0886-4959-a4f5-afb6ebaafe53 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.017089 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28f53b-ea86-49d2-baf1-c1ffb943d279 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.065587 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88294147-7ffc-445a-93e6-b3cf403fbd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.066886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294147-7ffc-445a-93e6-b3cf403fbd7b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.067182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294147-7ffc-445a-93e6-b3cf403fbd7b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.067466 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294147-7ffc-445a-93e6-b3cf403fbd7b None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.068565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294147-7ffc-445a-93e6-b3cf403fbd7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:41.068877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294147-7ffc-445a-93e6-b3cf403fbd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.071074 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294147-7ffc-445a-93e6-b3cf403fbd7b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.088543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 409/807] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:41.090007 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc71f-14a9-4701-88d3-aa9db88924c3 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.090303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc71f-14a9-4701-88d3-aa9db88924c3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.090583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc71f-14a9-4701-88d3-aa9db88924c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.113697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-ac1bc71f-14a9-4701-88d3-aa9db88924c3 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:41.115229 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-ac1bc71f-14a9-4701-88d3-aa9db88924c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:41.127490 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206ed57-0886-4959-a4f5-afb6ebaafe53 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.171098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.173305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.173305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.173808 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.174451 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:41.174768 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.176225 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.186735 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 399/808] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:41.187152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.210490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 410/809] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:41.211431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc71f-14a9-4701-88d3-aa9db88924c3 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.322591 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc71f-14a9-4701-88d3-aa9db88924c3 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.323031 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f8fa1-45da-43a9-a998-bb63c3025d92 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.357093 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.357893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.358712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.358995 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.367146 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.368680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.369196 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.369976 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.371242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.373225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.378401 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.380552 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:41.391886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:41.392919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:41.393951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:41.393951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:41.393951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:41.393951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:41.393951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 411/810] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:41.394693 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:41.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:41.400959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:41.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:41.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:41.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:41.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:41.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:41.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:41.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:41.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:41.405932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 400/811] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:41.406932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.522937 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adfd77-984c-4d05-a79d-f234f02e7ba3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.528638 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8a434-99bf-4fa2-836d-7d9ced82fd9a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.559115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.560120 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.560570 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.560850 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.562134 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:41.562439 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.563961 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.581348 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 401/812] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:41.581348 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.585970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.587679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.587997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.588276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.588950 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.590336 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:41.606820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:41.607938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:16:41.610197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:41.611906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 412/813] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:41.612937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.704711 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cf2e5-6e59-4eda-b3ad-f34e5b5de614 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.731681 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99de55-625c-49c3-b31b-bb2f0db3b970 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.743825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.744854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.745139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.745412 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.746208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:41.746519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.747976 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.765073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 402/814] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:41.765073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.771872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f4419-96a2-4655-8b88-12d30b4680a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.772666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4419-96a2-4655-8b88-12d30b4680a5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.773264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4419-96a2-4655-8b88-12d30b4680a5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.773545 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f4419-96a2-4655-8b88-12d30b4680a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.782214 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f4419-96a2-4655-8b88-12d30b4680a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.783643 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f4419-96a2-4655-8b88-12d30b4680a5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-aa4f4419-96a2-4655-8b88-12d30b4680a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:41.798206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:41.799423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:41.800498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 413/815] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:41.801144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b57ef-65e3-4d01-9d87-5168fce01098 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.801144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b57ef-65e3-4d01-9d87-5168fce01098 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.801294 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b57ef-65e3-4d01-9d87-5168fce01098 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.806478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 414/816] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:41.806478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b57ef-65e3-4d01-9d87-5168fce01098 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.872204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f58a2-331a-43e3-80a5-adcec017d3a2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.906752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.907422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.907700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.907988 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.908340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b57ef-65e3-4d01-9d87-5168fce01098 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:41.908746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:41.909049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.910497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.914913 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 403/817] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:41.915703 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:41.949362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd359f80-9a06-4d1f-b192-d64db2c74e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:41.950348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd359f80-9a06-4d1f-b192-d64db2c74e4d None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.950631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd359f80-9a06-4d1f-b192-d64db2c74e4d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.950906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd359f80-9a06-4d1f-b192-d64db2c74e4d None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/a8c0147cba5e4243acc460b09031bbad/roles/e56e935653824c0d983483cabd28c5be` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:41.968462 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd359f80-9a06-4d1f-b192-d64db2c74e4d None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=a8c0147cba5e4243acc460b09031bbad, role_id=e56e935653824c0d983483cabd28c5be)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:41.969962 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd359f80-9a06-4d1f-b192-d64db2c74e4d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:41.982800 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 415/818] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:41 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/a8c0147cba5e4243acc460b09031bbad/roles/e56e935653824c0d983483cabd28c5be => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:16:41.984776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552eeb-1d90-4ddf-90db-34f3d83eb8a3 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:41.985070 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552eeb-1d90-4ddf-90db-34f3d83eb8a3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:41.985348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552eeb-1d90-4ddf-90db-34f3d83eb8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.008164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-89552eeb-1d90-4ddf-90db-34f3d83eb8a3 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:42.009454 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-89552eeb-1d90-4ddf-90db-34f3d83eb8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:42.036878 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c92d0-2209-4575-9281-286d9f373bca None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:42.088515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 416/819] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:42.088515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552eeb-1d90-4ddf-90db-34f3d83eb8a3 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.090013 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:42.091580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:42.091580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:42.091580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.091873 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:42.094575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:42.099792 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:42.128676 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 404/820] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:16:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:42.129908 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.211113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552eeb-1d90-4ddf-90db-34f3d83eb8a3 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:42.249946 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:42.250544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:42.250828 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:42.251107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.251856 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:42.252168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:42.253548 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:42.256513 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baa78c-110b-41a1-befa-fe241c9d6766 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:42.258749 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 417/821] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:16:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:42.259900 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.300210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:42.301184 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:42.302325 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:42.302655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] PATH_INFO: `/v3/services/network` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.303321 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:42.304785 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:42.320238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:42.321644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:16:42.322569 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:42.323907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 405/822] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:42 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:42.329236 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.380968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfc459-eb8b-4a4e-8a60-56460b7bdc68 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:42.426500 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755ceb-c416-49c0-91b2-c7447d28c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:42.427508 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755ceb-c416-49c0-91b2-c7447d28c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:42.427890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755ceb-c416-49c0-91b2-c7447d28c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:42.428211 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755ceb-c416-49c0-91b2-c7447d28c2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.434578 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84a890-5dfe-4988-abca-46d59d8c0b90 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:42.471248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a041a-1895-4a7a-a273-463cfac1b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:42.471960 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a041a-1895-4a7a-a273-463cfac1b20a None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:42.472241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a041a-1895-4a7a-a273-463cfac1b20a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:42.472512 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a041a-1895-4a7a-a273-463cfac1b20a None admin] PATH_INFO: `/v3/endpoints` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.473259 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a041a-1895-4a7a-a273-463cfac1b20a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:42.475292 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a041a-1895-4a7a-a273-463cfac1b20a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:42.497567 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 406/823] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:16:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:42.498424 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a041a-1895-4a7a-a273-463cfac1b20a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.514728 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac755ceb-c416-49c0-91b2-c7447d28c2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:42.516790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac755ceb-c416-49c0-91b2-c7447d28c2d6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:42.616513 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a041a-1895-4a7a-a273-463cfac1b20a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:42.627631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 418/824] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:16:42.634099 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755ceb-c416-49c0-91b2-c7447d28c2d6 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.653679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:42.654554 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:42.654686 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:42.655433 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.656333 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] RBAC: Adding query filter params (name=network) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:42.656640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:42.658050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:42.663807 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 407/825] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:42.671304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.756771 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755ceb-c416-49c0-91b2-c7447d28c2d6 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:42.830574 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7bf8cd-620e-4aa6-9590-2e0490b9ef38 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:42.833503 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:42.834303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:42.834578 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:42.834847 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.854375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:42.855852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:42.877970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:42.879086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:42.880094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:42.880094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:42.880094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:42.880094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:42.880094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 419/826] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:42.884738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:42.885693 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:42.885809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.886404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:42.886921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:42.887865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] RBAC: Adding query filter params (type=network) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:42.888605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:42.892119 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:42.898783 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 408/827] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:42.904144 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:42.996363 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293596a-01bd-4158-b9ac-70e2f4010ac3 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:43.022265 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998bb0a-1f8a-4f5c-85c5-da70871934ff None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:43.032925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:43.033611 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:43.033892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:43.034161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:43.034889 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:43.035190 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:43.036586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:43.049796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 420/828] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:43.059799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:43.074167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831980f7-2229-444e-8f90-306c4bfe90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:43.075366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831980f7-2229-444e-8f90-306c4bfe90fa None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:43.075867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831980f7-2229-444e-8f90-306c4bfe90fa None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:43.076394 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831980f7-2229-444e-8f90-306c4bfe90fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:43.079817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831980f7-2229-444e-8f90-306c4bfe90fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:43.084283 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831980f7-2229-444e-8f90-306c4bfe90fa None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:43.133175 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 409/829] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:16:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:43.225923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49b7fb-fa41-4d58-9920-0432c3b9b657 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:43.276640 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:43.277470 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:43.277750 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:43.278018 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:43.286615 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:43.288125 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:43.307804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:43.310092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:43.313331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 421/830] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:43.320390 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831980f7-2229-444e-8f90-306c4bfe90fa None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:43.441017 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831980f7-2229-444e-8f90-306c4bfe90fa None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:43.490358 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab900c3d-3d69-40f7-b0c8-750c34b4d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:43.491027 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900c3d-3d69-40f7-b0c8-750c34b4d772 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:43.491308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900c3d-3d69-40f7-b0c8-750c34b4d772 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:43.491582 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab900c3d-3d69-40f7-b0c8-750c34b4d772 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:43.492411 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab900c3d-3d69-40f7-b0c8-750c34b4d772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:43.492716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab900c3d-3d69-40f7-b0c8-750c34b4d772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:43.494149 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab900c3d-3d69-40f7-b0c8-750c34b4d772 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:43.507720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 410/831] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:43.513649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:43.537806 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f96b62-377a-4202-aa4f-7a009f74f0c5 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:43.538127 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f96b62-377a-4202-aa4f-7a009f74f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:43.538363 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f96b62-377a-4202-aa4f-7a009f74f0c5 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:43.539998 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 411/832] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:16:43.546543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cebfd-fe55-49c0-8862-021a22677f7f None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:43.546976 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cebfd-fe55-49c0-8862-021a22677f7f None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:43.547374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cebfd-fe55-49c0-8862-021a22677f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:43.575355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-7b7cebfd-fe55-49c0-8862-021a22677f7f None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:43.575355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-7b7cebfd-fe55-49c0-8862-021a22677f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:43.644496 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbea9bb-8410-4405-a7b7-96d06a63d987 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:43.671087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 412/833] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:43.689533 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:43.690478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:43.690972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:43.691491 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:43.692574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=865e4a29d11c4000988326f5ce35b25b) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:43.693097 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:43.695660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cebfd-fe55-49c0-8862-021a22677f7f None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:43.696065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:43.710480 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 422/834] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:43 2022] GET /identity/v3/role_assignments?user.id=865e4a29d11c4000988326f5ce35b25b&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:43.815525 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cebfd-fe55-49c0-8862-021a22677f7f None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:43.854247 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8860-ba24-40da-98d8-85745126b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:43.856012 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8860-ba24-40da-98d8-85745126b33b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:43.856596 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8860-ba24-40da-98d8-85745126b33b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:43.857369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8860-ba24-40da-98d8-85745126b33b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:43.876435 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca8860-ba24-40da-98d8-85745126b33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-54ca8860-ba24-40da-98d8-85745126b33b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:43.886078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:43.887356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:16:43.888420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:43.891277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 413/835] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:43.897090 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:44.008220 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58445e-706a-4f72-9023-31262fd1f4ec None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:44.042061 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:44.042725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.043047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.043322 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:44.044099 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:44.044403 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:44.045895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:44.054485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 423/836] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:16:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:44.060010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8860-ba24-40da-98d8-85745126b33b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:44.161841 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8860-ba24-40da-98d8-85745126b33b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:44.200910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:44.201791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.202582 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.202864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:44.214723 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:44.216221 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:44.234541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:44.235640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:44.236745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:44.236745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:44.236745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:44.236745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:44.236745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 414/837] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:44.243146 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:44.347499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afdc2-3082-431b-a529-84da13171cfd None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:44.384515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dd5fd-5bb8-4596-8c1c-81e55b640764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:44.385208 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dd5fd-5bb8-4596-8c1c-81e55b640764 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.385495 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dd5fd-5bb8-4596-8c1c-81e55b640764 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.385774 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dd5fd-5bb8-4596-8c1c-81e55b640764 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:44.386535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dd5fd-5bb8-4596-8c1c-81e55b640764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:44.386846 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dd5fd-5bb8-4596-8c1c-81e55b640764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:44.388317 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dd5fd-5bb8-4596-8c1c-81e55b640764 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:44.402523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 424/838] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:44.408993 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:44.515641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091780-8465-42bb-bca8-61013c86947e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:44.549795 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:44.550605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.550888 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.551162 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:44.558994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:44.560470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:44.576133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:44.577882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:44.578981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 415/839] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:16:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:44.587207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865eeb6-f892-4771-96df-727818725dfa None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.587207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865eeb6-f892-4771-96df-727818725dfa None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.587207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865eeb6-f892-4771-96df-727818725dfa None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:44.588425 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 425/840] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:44.592566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:44.596401 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551412a-25ac-4acf-bec2-7a827060f6d5 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.596940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551412a-25ac-4acf-bec2-7a827060f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.597461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551412a-25ac-4acf-bec2-7a827060f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:44.614006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-5551412a-25ac-4acf-bec2-7a827060f6d5 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:44.615483 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-5551412a-25ac-4acf-bec2-7a827060f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:44.696269 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 426/841] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:44.713068 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056a697-2528-45ef-ae57-ea7369ad96bb None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:44.724393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551412a-25ac-4acf-bec2-7a827060f6d5 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:44.753629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:44.754316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.754742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.755028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:44.756233 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:44.756547 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:44.758289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:44.783082 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 416/842] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:16:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:44.788102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:44.840140 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551412a-25ac-4acf-bec2-7a827060f6d5 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:44.876518 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33ba1-0d77-4159-ab14-9c5b12263ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:44.877267 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33ba1-0d77-4159-ab14-9c5b12263ef9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.877605 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33ba1-0d77-4159-ab14-9c5b12263ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.877883 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33ba1-0d77-4159-ab14-9c5b12263ef9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:44.891207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d33ba1-0d77-4159-ab14-9c5b12263ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-a4d33ba1-0d77-4159-ab14-9c5b12263ef9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:44.899653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:44.900730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:16:44.901652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:44.906086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 427/843] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:44.907084 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33ba1-0d77-4159-ab14-9c5b12263ef9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:44.915039 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a1b07-c976-4f53-84a9-4775d0da83a6 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:44.960832 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab3182-c6c9-4aea-9deb-e147afc1e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:44.962134 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab3182-c6c9-4aea-9deb-e147afc1e71e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:44.962627 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab3182-c6c9-4aea-9deb-e147afc1e71e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:44.963240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab3182-c6c9-4aea-9deb-e147afc1e71e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.016991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33ba1-0d77-4159-ab14-9c5b12263ef9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.052728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab3182-c6c9-4aea-9deb-e147afc1e71e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.054304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.054764 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab3182-c6c9-4aea-9deb-e147afc1e71e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.054965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.055250 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.055523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.056316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:45.056618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.058135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 428/844] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:45.073792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.178476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 417/845] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:16:45.179529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab3182-c6c9-4aea-9deb-e147afc1e71e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.200315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ea5c7-d097-4ff1-a4a8-46b9e9b1e95b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.244241 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.245317 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.245598 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.245874 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.260322 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.262043 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:45.283152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:45.284217 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:45.285193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:45.285193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:45.285193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:45.285193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:45.285193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 429/846] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:45.290981 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.299277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab3182-c6c9-4aea-9deb-e147afc1e71e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.346510 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d49e6-0daf-4f31-a89f-29d21cf23f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.347949 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d49e6-0daf-4f31-a89f-29d21cf23f74 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.348344 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d49e6-0daf-4f31-a89f-29d21cf23f74 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.348726 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d49e6-0daf-4f31-a89f-29d21cf23f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.363003 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d49e6-0daf-4f31-a89f-29d21cf23f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.364788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d49e6-0daf-4f31-a89f-29d21cf23f74 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-801d49e6-0daf-4f31-a89f-29d21cf23f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:45.386970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:45.388291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:45.389864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:45.389864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:45.389864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:45.389864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:45.389864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 418/847] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:45.390384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5334a4-a26b-4524-bfb3-5ccf15ac02b9 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.390580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5334a4-a26b-4524-bfb3-5ccf15ac02b9 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.390863 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5334a4-a26b-4524-bfb3-5ccf15ac02b9 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.392419 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 419/848] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:45.395049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5334a4-a26b-4524-bfb3-5ccf15ac02b9 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.400517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ba122-3f41-48f8-b62e-43e7a761835a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.436821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59838170-2daa-45f6-b4a1-5365407545f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.437406 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838170-2daa-45f6-b4a1-5365407545f8 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.437697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838170-2daa-45f6-b4a1-5365407545f8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.437971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838170-2daa-45f6-b4a1-5365407545f8 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.438697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59838170-2daa-45f6-b4a1-5365407545f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:45.439004 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59838170-2daa-45f6-b4a1-5365407545f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.440403 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59838170-2daa-45f6-b4a1-5365407545f8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.457516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 430/849] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:45.457516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb0b7-957a-4e12-841a-74b4fb39efca None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.457516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb0b7-957a-4e12-841a-74b4fb39efca None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.457516 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb0b7-957a-4e12-841a-74b4fb39efca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.471896 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-a1ccb0b7-957a-4e12-841a-74b4fb39efca None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:45.473080 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-a1ccb0b7-957a-4e12-841a-74b4fb39efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:45.500436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5334a4-a26b-4524-bfb3-5ccf15ac02b9 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.534420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.535380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.535665 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.535974 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.536701 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:45.537011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.538385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.541915 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 431/850] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:45.543037 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccb0b7-957a-4e12-841a-74b4fb39efca None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.556111 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 420/851] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:45.560034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.657256 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccb0b7-957a-4e12-841a-74b4fb39efca None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.664539 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977388d-8da5-449f-b439-492bd97d7844 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.692301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.693031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.693314 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.693595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.698767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.699560 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.699874 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.700151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.701069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.702651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.707273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.708740 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:45.718436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:45.719497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 432/852] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:45.721484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:45.727069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:45.728298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:45.729526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:45.729526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:45.729526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:45.729526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:45.729526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:45.729526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:45.729526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:45.729526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:45.736248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 421/853] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:45.736248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.829406 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29230e68-6016-4fc7-a53f-b9c848fa9668 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.835115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651735-96d2-4e64-b45a-cb244c9b8b62 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:45.863968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.864876 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.865225 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.865575 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.866303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.867752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.872171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:45.872920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:45.873279 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:45.873661 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:45.874580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:45.874966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:45.876503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:45.880460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:45.881595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:45.882560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 433/854] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:45.883434 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.903502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 422/855] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:45.903502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:45.992641 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b8ff-9270-4dda-aae9-9065f0a7d3cf None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.003722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6774-1fd9-44b7-97c1-fcca2647ebe1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.026228 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.026892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.027178 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.027462 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.028320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:46.028604 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.030641 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.039046 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.040018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.040506 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.040988 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.041883 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:46.042391 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.042514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 434/856] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:46.043302 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.044372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.050323 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 423/857] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:46.051270 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.150675 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec6f38-2124-4c2e-be99-380066d28733 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.153059 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b1d4-6dba-45d5-865f-5071ebb0b59d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.185339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.186515 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.186806 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.187167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.188036 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=6fa1a77cf42a46f092b7c5894761dfb9) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:46.188351 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.189785 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.193300 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58ced6-cf9c-4150-b358-445c398bd0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.193958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58ced6-cf9c-4150-b358-445c398bd0c1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.194238 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58ced6-cf9c-4150-b358-445c398bd0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.194512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58ced6-cf9c-4150-b358-445c398bd0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.196094 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 424/858] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/role_assignments?user.id=6fa1a77cf42a46f092b7c5894761dfb9&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:46.196932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.273331 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58ced6-cf9c-4150-b358-445c398bd0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.274720 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58ced6-cf9c-4150-b358-445c398bd0c1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.305993 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef8819-a4dd-4729-839d-868100c702eb None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.345104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c8ce6-c453-45c2-8154-129c72181df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.345792 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c8ce6-c453-45c2-8154-129c72181df5 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.346078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c8ce6-c453-45c2-8154-129c72181df5 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.346348 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c8ce6-c453-45c2-8154-129c72181df5 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.347069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c8ce6-c453-45c2-8154-129c72181df5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:46.347379 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c8ce6-c453-45c2-8154-129c72181df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.348810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c8ce6-c453-45c2-8154-129c72181df5 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.353712 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 425/859] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:46.355065 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb829-9372-4256-853e-8e18f72b5e98 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.355357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb829-9372-4256-853e-8e18f72b5e98 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.355636 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb829-9372-4256-853e-8e18f72b5e98 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.357248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 426/860] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:46.374785 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106dba6-6b90-4d57-968f-0b2d66936a81 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.375086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106dba6-6b90-4d57-968f-0b2d66936a81 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.375421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106dba6-6b90-4d57-968f-0b2d66936a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.393153 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 435/861] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:16:46.397126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-2106dba6-6b90-4d57-968f-0b2d66936a81 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:46.398339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-2106dba6-6b90-4d57-968f-0b2d66936a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:46.398534 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58ced6-cf9c-4150-b358-445c398bd0c1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.500076 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 427/862] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:46.526537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106dba6-6b90-4d57-968f-0b2d66936a81 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.527293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58ced6-cf9c-4150-b358-445c398bd0c1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.567360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.568236 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.568522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.568798 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.586035 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.587514 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:46.611709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:46.612803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:46.613759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:46.613759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:46.613759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:46.613759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:46.613759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 436/863] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:46.619114 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.671392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106dba6-6b90-4d57-968f-0b2d66936a81 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.706505 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.707233 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.707520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.708008 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.708676 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.710062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:46.723050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:46.724189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:46.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:46.729338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 428/864] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:46.730798 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.737981 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6165-f72e-441a-ad41-7ec49cac139f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.777116 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.778098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.778633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.779144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.780872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:46.781363 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.782974 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.795893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 437/865] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:46.801367 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.849078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7fd085-325a-4c8e-9beb-0cfad141ea22 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.887793 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.888484 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.888772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.889074 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.890273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:46.890596 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.892721 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:46.901589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 429/866] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:46.903613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:46.931064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381780c7-2bcb-4f75-a016-02abb8aa878e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:46.967052 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:46.973586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:46.973875 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:46.974161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:46.981759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:46.984437 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:47.004426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:47.005519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:47.006486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:47.006486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:47.006486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:47.006486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:47.006486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:47.006486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:47.006486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:47.006486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:47.012080 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 438/867] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:47.013030 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:47.035092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50986b8-98fe-498b-bb70-41547d4a3078 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:47.079595 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:47.081159 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:47.081608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:47.082071 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:47.083396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:47.084177 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:47.085731 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:47.100407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 430/868] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:47.128496 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2e5eb-076c-45ac-92eb-ce16d78a4f98 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:47.173317 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d11e38-4474-4929-8d1a-33a59c5d8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:47.173998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d11e38-4474-4929-8d1a-33a59c5d8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:47.174279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d11e38-4474-4929-8d1a-33a59c5d8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:47.174558 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d11e38-4474-4929-8d1a-33a59c5d8cc1 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:47.175366 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d11e38-4474-4929-8d1a-33a59c5d8cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:47.175672 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d11e38-4474-4929-8d1a-33a59c5d8cc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:47.177502 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d11e38-4474-4929-8d1a-33a59c5d8cc1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:47.198454 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 439/869] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:47.211228 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:47.354422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffedf99-1ca4-4aa5-9aa9-00768b037904 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:47.395157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1d12d-68c9-4784-b5c7-784518de2413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:47.395850 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1d12d-68c9-4784-b5c7-784518de2413 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:47.396135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1d12d-68c9-4784-b5c7-784518de2413 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:47.396409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1d12d-68c9-4784-b5c7-784518de2413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:47.397247 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1d12d-68c9-4784-b5c7-784518de2413 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=a8c0147cba5e4243acc460b09031bbad) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:47.397560 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1d12d-68c9-4784-b5c7-784518de2413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:47.398993 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1d12d-68c9-4784-b5c7-784518de2413 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:47.406431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 431/870] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:47 2022] GET /identity/v3/role_assignments?user.id=a8c0147cba5e4243acc460b09031bbad&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:48.636716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10392003-067d-4edb-a791-8b830556e738 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:48.637286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10392003-067d-4edb-a791-8b830556e738 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:48.637286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10392003-067d-4edb-a791-8b830556e738 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:48.638972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 440/871] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:48.645098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db028a49-5bd0-4eca-875a-1b6e2d804316 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:48.645673 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db028a49-5bd0-4eca-875a-1b6e2d804316 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:48.645673 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db028a49-5bd0-4eca-875a-1b6e2d804316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:48.664087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-db028a49-5bd0-4eca-875a-1b6e2d804316 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:48.665301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-db028a49-5bd0-4eca-875a-1b6e2d804316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:48.734522 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 432/872] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:48.757613 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10392003-067d-4edb-a791-8b830556e738 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:48.858631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66fc56-e0cc-464b-844f-f64b3ad7d993 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:48.858631 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66fc56-e0cc-464b-844f-f64b3ad7d993 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:48.858919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66fc56-e0cc-464b-844f-f64b3ad7d993 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:48.865168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 433/873] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:48.871579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ce68-81e4-4fe1-8741-657d19f008e3 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:48.871734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10392003-067d-4edb-a791-8b830556e738 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:48.872277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ce68-81e4-4fe1-8741-657d19f008e3 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:48.872778 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ce68-81e4-4fe1-8741-657d19f008e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:48.894722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-cdf8ce68-81e4-4fe1-8741-657d19f008e3 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:48.896998 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-cdf8ce68-81e4-4fe1-8741-657d19f008e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:48.909624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:48.910809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:48.911095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:48.911375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:48.912068 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:48.914178 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:48.930574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:48.931715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:48.932658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 441/874] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:48.943948 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:48.983899 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 434/875] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:49.001502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8ce68-81e4-4fe1-8741-657d19f008e3 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:49.044496 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c5646-6734-4fb2-942a-3b045f345379 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:49.080003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:49.080936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:49.081404 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:49.081840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:49.082730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:49.083196 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:49.084769 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:49.095216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 442/876] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:16:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:49.096436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:49.103676 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8ce68-81e4-4fe1-8741-657d19f008e3 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:49.140510 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741420-1c3b-4a08-9158-434e9a4783b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:49.141112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741420-1c3b-4a08-9158-434e9a4783b6 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:49.141403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741420-1c3b-4a08-9158-434e9a4783b6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:49.141684 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741420-1c3b-4a08-9158-434e9a4783b6 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:49.142548 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741420-1c3b-4a08-9158-434e9a4783b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:49.144079 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741420-1c3b-4a08-9158-434e9a4783b6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:49.163863 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 435/877] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:16:49 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:49.213785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f8a60-04b2-4cf1-91c6-04301656e460 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:49.260487 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f3fee-2f9c-47df-b6f1-53db12bec2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:49.261513 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3fee-2f9c-47df-b6f1-53db12bec2fb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:49.262019 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3fee-2f9c-47df-b6f1-53db12bec2fb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:49.262465 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f3fee-2f9c-47df-b6f1-53db12bec2fb None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:49.263392 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f3fee-2f9c-47df-b6f1-53db12bec2fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:49.293392 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f3fee-2f9c-47df-b6f1-53db12bec2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:49.293392 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f3fee-2f9c-47df-b6f1-53db12bec2fb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:49.293764 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 443/878] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:16:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:49.577489 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2a65-72cc-44a3-aa14-ad96bc7beec7 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:49.577915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2a65-72cc-44a3-aa14-ad96bc7beec7 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:49.578307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2a65-72cc-44a3-aa14-ad96bc7beec7 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:49.580494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 436/879] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:49.588011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0c0b6-dbc9-442c-9f54-8effe4c826b4 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:49.588301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0c0b6-dbc9-442c-9f54-8effe4c826b4 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:49.588580 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0c0b6-dbc9-442c-9f54-8effe4c826b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:49.607142 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-94e0c0b6-dbc9-442c-9f54-8effe4c826b4 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:49.609164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-94e0c0b6-dbc9-442c-9f54-8effe4c826b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:49.680252 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 444/880] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:49.703078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a2a65-72cc-44a3-aa14-ad96bc7beec7 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:49.812601 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a2a65-72cc-44a3-aa14-ad96bc7beec7 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:49.847414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7bfda-ca31-4587-acfc-e9416474f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:49.848445 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7bfda-ca31-4587-acfc-e9416474f462 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:49.848927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7bfda-ca31-4587-acfc-e9416474f462 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:49.849397 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7bfda-ca31-4587-acfc-e9416474f462 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:49.850313 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7bfda-ca31-4587-acfc-e9416474f462 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:49.851959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7bfda-ca31-4587-acfc-e9416474f462 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:49.869408 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 437/881] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:16:49 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:49.908578 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c7ee-c736-49c7-964b-db39098b19ff None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:49.908878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c7ee-c736-49c7-964b-db39098b19ff None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:49.909302 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c7ee-c736-49c7-964b-db39098b19ff None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:49.911024 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 445/882] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:49.916875 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149ae7-cb24-4ffb-8fb7-f7051e8a8860 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:49.917204 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149ae7-cb24-4ffb-8fb7-f7051e8a8860 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:49.917418 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53149ae7-cb24-4ffb-8fb7-f7051e8a8860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:49.943925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-53149ae7-cb24-4ffb-8fb7-f7051e8a8860 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:49.946102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-53149ae7-cb24-4ffb-8fb7-f7051e8a8860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:50.036217 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 438/883] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:50.060164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2c7ee-c736-49c7-964b-db39098b19ff None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:50.165343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2c7ee-c736-49c7-964b-db39098b19ff None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:50.200207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60514b-151a-4960-8e4a-549f4403baa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:50.201017 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60514b-151a-4960-8e4a-549f4403baa4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:50.201295 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60514b-151a-4960-8e4a-549f4403baa4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:50.202164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60514b-151a-4960-8e4a-549f4403baa4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:50.212344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60514b-151a-4960-8e4a-549f4403baa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-8a60514b-151a-4960-8e4a-549f4403baa4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:50.220473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:50.221305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:50.221986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 446/884] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:16:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:50.227847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53149ae7-cb24-4ffb-8fb7-f7051e8a8860 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:50.340055 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53149ae7-cb24-4ffb-8fb7-f7051e8a8860 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:50.375603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:50.376608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:50.377105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:50.377576 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:50.378518 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:50.379900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:50.381487 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:50.390297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 439/885] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:16:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:50.397112 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60514b-151a-4960-8e4a-549f4403baa4 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:50.503542 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60514b-151a-4960-8e4a-549f4403baa4 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:50.538057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:50.538889 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:50.539175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:50.539449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:50.550364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:50.551832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:50.573942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:50.574743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:50.575471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:50.575471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:50.575471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:50.575471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:50.575667 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 447/886] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:50.581762 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:50.687854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eef3fe-66a0-4b53-819e-c919f23db7fe None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:50.723094 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:50.724572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:50.724868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:50.725158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:50.725915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:50.726231 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:50.727615 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:50.743230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 440/887] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:50.749211 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:50.855308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59943ad-e84f-4fe6-8ad0-6fe7879895c1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:50.891473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:50.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:50.892598 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:50.892912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:50.900573 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:50.902007 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:50.917180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:50.917971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:50.918742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 448/888] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:16:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:50.924343 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:51.028023 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b3a9d-4061-4921-bda6-b6738f511249 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:51.063153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:51.064193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.064672 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.065167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.066193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:51.066712 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:51.068363 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:51.087473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 441/889] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:16:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:51.099788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:51.205219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f526ac-aabc-4434-973f-9ad46942b3d7 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:51.241613 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8dc52-7f6c-46f3-8c60-2b9483c83d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:51.242485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8dc52-7f6c-46f3-8c60-2b9483c83d65 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.242903 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8dc52-7f6c-46f3-8c60-2b9483c83d65 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.243337 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8dc52-7f6c-46f3-8c60-2b9483c83d65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.314028 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8dc52-7f6c-46f3-8c60-2b9483c83d65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:51.315700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8dc52-7f6c-46f3-8c60-2b9483c83d65 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:51.420888 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 449/890] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:16:51 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:16:51.431794 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:51.533568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efda4ce-4d1d-432f-b2ab-81bd56071919 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:51.567689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65913f38-64d9-489a-b5cf-86877b2053ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:51.568534 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913f38-64d9-489a-b5cf-86877b2053ff None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.568817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913f38-64d9-489a-b5cf-86877b2053ff None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.569095 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913f38-64d9-489a-b5cf-86877b2053ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.580048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65913f38-64d9-489a-b5cf-86877b2053ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:51.581521 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65913f38-64d9-489a-b5cf-86877b2053ff None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-65913f38-64d9-489a-b5cf-86877b2053ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:51.600698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:51.601455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:51.602178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:51.602178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:51.602178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:51.602178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:51.602374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 442/891] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:51.607849 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8dc52-7f6c-46f3-8c60-2b9483c83d65 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:51.615402 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c0cd-7fef-4cde-bc60-9dca7dfc4939 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.615695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c0cd-7fef-4cde-bc60-9dca7dfc4939 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.616008 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496c0cd-7fef-4cde-bc60-9dca7dfc4939 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.618741 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 443/892] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:16:51.622703 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b3b5-30b6-46c3-b4ff-2c1103b4c690 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.622992 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b3b5-30b6-46c3-b4ff-2c1103b4c690 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.623819 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b3b5-30b6-46c3-b4ff-2c1103b4c690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.640699 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-0e98b3b5-30b6-46c3-b4ff-2c1103b4c690 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:51.641869 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-0e98b3b5-30b6-46c3-b4ff-2c1103b4c690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:51.710543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 444/893] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:51.712018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7933698-6705-4be0-8e30-906b576b7c13 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.712200 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7933698-6705-4be0-8e30-906b576b7c13 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.712480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7933698-6705-4be0-8e30-906b576b7c13 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.716213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8dc52-7f6c-46f3-8c60-2b9483c83d65 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:51.718171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 445/894] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:51.719797 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63b9c-d50b-4726-b922-bd96b7f4b01d None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.719797 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63b9c-d50b-4726-b922-bd96b7f4b01d None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.719976 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63b9c-d50b-4726-b922-bd96b7f4b01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.736670 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-48f63b9c-d50b-4726-b922-bd96b7f4b01d None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:51.737898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-48f63b9c-d50b-4726-b922-bd96b7f4b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:51.753303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:51.753976 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.754246 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.754518 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.755243 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:51.755549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:51.756937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:51.768766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 450/895] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:51.769575 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:51.806277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 446/896] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:51.807417 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f63b9c-d50b-4726-b922-bd96b7f4b01d None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:51.880000 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cd680-f364-4f48-9ea0-2fd2310dba50 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:51.905850 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f63b9c-d50b-4726-b922-bd96b7f4b01d None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:51.914123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5622cf-8237-44c3-877a-21af544132ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:51.914784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5622cf-8237-44c3-877a-21af544132ae None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.915065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5622cf-8237-44c3-877a-21af544132ae None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.915351 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5622cf-8237-44c3-877a-21af544132ae None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.916076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5622cf-8237-44c3-877a-21af544132ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:51.917424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5622cf-8237-44c3-877a-21af544132ae None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:51.933695 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 451/897] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:16:51 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:51.937133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5622cf-8237-44c3-877a-21af544132ae None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:51.957605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:51.958749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:51.959042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:51.959319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:51.969108 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:51.971481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:51.991866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:51.992691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:51.993441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:51.993441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:51.993441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:51.993441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:51.993441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:51.993441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:51.993441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:51.993441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:51.993897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 447/898] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:51.999257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.067138 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5622cf-8237-44c3-877a-21af544132ae None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.108022 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.109205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.109691 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.110161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.110736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca3006-2565-4023-972c-7a491e3c0d6e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.111283 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.112910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:52.127794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:52.128692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:52.129411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:52.131967 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 452/899] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:52.138938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.157251 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.157945 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.158224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.158902 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.159301 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:52.159609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.161195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.177945 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 448/900] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:52.183966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.265335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20429087-8bcf-4467-b638-be5e1d759544 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.306754 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf28ea6-c4b0-4919-9518-cd0bbd3f0b7f None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.307635 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.308342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.308892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.309767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:52.310075 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.312958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.322955 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 453/901] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:52.329734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.348734 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e77b8-2169-4b13-b631-5941dceeef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.349918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e77b8-2169-4b13-b631-5941dceeef6f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.350786 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e77b8-2169-4b13-b631-5941dceeef6f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.351262 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e77b8-2169-4b13-b631-5941dceeef6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.352619 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e77b8-2169-4b13-b631-5941dceeef6f None admin] RBAC: Adding query filter params (role.id=80470f642b064584a5365cba7ab413db, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=a8c0147cba5e4243acc460b09031bbad) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:52.353404 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e77b8-2169-4b13-b631-5941dceeef6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.355341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e77b8-2169-4b13-b631-5941dceeef6f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.362584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 449/902] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:16:52 2022] GET /identity/v3/role_assignments?user.id=a8c0147cba5e4243acc460b09031bbad&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=80470f642b064584a5365cba7ab413db => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:52.364250 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc546b-c8b9-48c1-ab2c-ba2e6042e6bf None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.364752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc546b-c8b9-48c1-ab2c-ba2e6042e6bf None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.365225 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc546b-c8b9-48c1-ab2c-ba2e6042e6bf None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.366700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 450/903] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:52.373619 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724729df-4cb2-463a-ae57-287ca065f03a None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.374180 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724729df-4cb2-463a-ae57-287ca065f03a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.374636 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724729df-4cb2-463a-ae57-287ca065f03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.395115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-724729df-4cb2-463a-ae57-287ca065f03a None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:52.396698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-724729df-4cb2-463a-ae57-287ca065f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:52.470831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bec85a-ff08-4117-8bae-9ba39a5ee09d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.480223 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 451/904] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:52.499314 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724729df-4cb2-463a-ae57-287ca065f03a None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.511477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.512295 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.512917 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.513266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.514875 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:52.515284 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.517568 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.524750 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 454/905] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:52.531749 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.616110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724729df-4cb2-463a-ae57-287ca065f03a None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.651599 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.652583 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.652930 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.653270 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.654019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.656334 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.667629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12d409-e9a2-4a22-a9be-6641231b8007 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:52.669153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:52.670852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:52.671884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:52.674306 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 452/906] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:16:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:52.683791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.727122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.727794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.728104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.728381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.729182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] RBAC: Adding query filter params (interface=public, service_id=8dc2d13d57b1401a88e93653dc41fccb, region_id=RegionOne) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:52.729498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.730870 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.736945 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 455/907] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:16:52 2022] GET /identity/v3/endpoints?service_id=8dc2d13d57b1401a88e93653dc41fccb&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:52.742205 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.807619 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50a75-d74f-4593-937c-0139f89acc05 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.846375 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.846982 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.847269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.847548 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.848191 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60911f64-6a2f-4dee-8904-0dfe8b8fae4f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:52.848640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:52.848640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.849978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.865003 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 453/908] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:52.866080 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:52.895199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04415695-cb6d-42fa-988d-36b4f1594312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:52.895917 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415695-cb6d-42fa-988d-36b4f1594312 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:52.896444 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415695-cb6d-42fa-988d-36b4f1594312 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:52.896732 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415695-cb6d-42fa-988d-36b4f1594312 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:52.897732 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04415695-cb6d-42fa-988d-36b4f1594312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:52.899604 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04415695-cb6d-42fa-988d-36b4f1594312 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:52.908510 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 456/909] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:16:52 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:16:52.986996 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216109b-9f7a-41b6-9718-2f0f50d6c44e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:53.024863 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:53.025910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:53.026408 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:53.026875 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:53.027810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:53.028312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:53.030788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:53.036985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 454/910] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:53.043323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04415695-cb6d-42fa-988d-36b4f1594312 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:53.157905 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04415695-cb6d-42fa-988d-36b4f1594312 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:53.195280 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a5495-3f81-4923-9ddd-1a8c309a1afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:53.196232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5495-3f81-4923-9ddd-1a8c309a1afa None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:53.196513 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5495-3f81-4923-9ddd-1a8c309a1afa None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:53.196786 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a5495-3f81-4923-9ddd-1a8c309a1afa None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:53.197582 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5495-3f81-4923-9ddd-1a8c309a1afa None admin] RBAC: Adding query filter params (interface=public, service_id=96143c8b4a6b4c12ae8c2004ce17b15c, region_id=RegionOne) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:53.197892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5495-3f81-4923-9ddd-1a8c309a1afa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:53.199257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a5495-3f81-4923-9ddd-1a8c309a1afa None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:53.205543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 457/911] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:16:53 2022] GET /identity/v3/endpoints?service_id=96143c8b4a6b4c12ae8c2004ce17b15c&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:53.210868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:53.314772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bda91-e775-4777-9dea-aa2743474643 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:53.349743 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fb8f1-ea18-4827-a772-12645ff7ba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:53.350746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb8f1-ea18-4827-a772-12645ff7ba6c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:53.351220 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb8f1-ea18-4827-a772-12645ff7ba6c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:53.351680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb8f1-ea18-4827-a772-12645ff7ba6c None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:53.352568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fb8f1-ea18-4827-a772-12645ff7ba6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:53.354117 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fb8f1-ea18-4827-a772-12645ff7ba6c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:53.360694 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 455/912] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:16:53 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:16:54.310532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215232-588b-4521-881a-6556c12d5ed4 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:54.311051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215232-588b-4521-881a-6556c12d5ed4 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:54.311338 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4215232-588b-4521-881a-6556c12d5ed4 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:54.312814 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 458/913] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:54.318318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55fa82-53ff-4bf7-956e-3b25fb1fff57 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:54.318709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55fa82-53ff-4bf7-956e-3b25fb1fff57 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:54.318870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55fa82-53ff-4bf7-956e-3b25fb1fff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:54.336769 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-7a55fa82-53ff-4bf7-956e-3b25fb1fff57 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:54.337956 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-7a55fa82-53ff-4bf7-956e-3b25fb1fff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:54.407431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 456/914] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:54.430437 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4215232-588b-4521-881a-6556c12d5ed4 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:54.541901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4215232-588b-4521-881a-6556c12d5ed4 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:54.577807 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b31d40-b4ee-450c-981e-2a8abdef739d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:54.579354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31d40-b4ee-450c-981e-2a8abdef739d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:54.579880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31d40-b4ee-450c-981e-2a8abdef739d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:54.580348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b31d40-b4ee-450c-981e-2a8abdef739d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:54.581192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b31d40-b4ee-450c-981e-2a8abdef739d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:54.582744 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b31d40-b4ee-450c-981e-2a8abdef739d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-d9b31d40-b4ee-450c-981e-2a8abdef739d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:54.596329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:54.597199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:54.598364 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 459/915] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:54.603670 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55fa82-53ff-4bf7-956e-3b25fb1fff57 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:54.704192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053ea7-49be-4d9d-9c1b-b1f50d4b3a15 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:54.704505 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053ea7-49be-4d9d-9c1b-b1f50d4b3a15 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:54.704760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053ea7-49be-4d9d-9c1b-b1f50d4b3a15 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:54.706475 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 460/916] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:54.711469 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48d58-b901-445c-a32b-cd2b6b95cbdf None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:54.711776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48d58-b901-445c-a32b-cd2b6b95cbdf None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:54.712066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48d58-b901-445c-a32b-cd2b6b95cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:54.712430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55fa82-53ff-4bf7-956e-3b25fb1fff57 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:54.729475 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-2de48d58-b901-445c-a32b-cd2b6b95cbdf None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:54.730665 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-2de48d58-b901-445c-a32b-cd2b6b95cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:54.754966 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:54.756010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:54.756502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:54.756977 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:54.757912 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:54.758424 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:54.760039 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:54.765927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 457/917] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:16:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:54.771674 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:54.819850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 461/918] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:54.840873 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de48d58-b901-445c-a32b-cd2b6b95cbdf None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:54.880281 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6c673-ff7f-4c67-be82-999f66756287 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:54.916221 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:54.917327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:54.917862 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:54.918338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:54.919248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:54.919753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:54.922033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:54.927735 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 458/919] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:16:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:54.933850 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:54.947078 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de48d58-b901-445c-a32b-cd2b6b95cbdf None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:54.985330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fefa4-90ca-4870-8aa0-20ca46c027b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:54.986320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fefa4-90ca-4870-8aa0-20ca46c027b9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:54.986663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fefa4-90ca-4870-8aa0-20ca46c027b9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:54.986871 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fefa4-90ca-4870-8aa0-20ca46c027b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.001633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fefa4-90ca-4870-8aa0-20ca46c027b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-eb9fefa4-90ca-4870-8aa0-20ca46c027b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:55.009832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:55.010642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:16:55.011381 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:55.016769 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 462/920] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:16:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:55.017748 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fefa4-90ca-4870-8aa0-20ca46c027b9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.052024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530dfeb-7b86-4111-8121-bf35b11c7332 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.103366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.104581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.104867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.105144 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] PATH_INFO: `/v3/endpoints` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.105980 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] RBAC: Adding query filter params (interface=public, service_id=c14b24f6e3c949a39a3baefe7a5fc84e, region_id=RegionOne) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:55.106298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.107863 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.120257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 459/921] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:16:54 2022] GET /identity/v3/endpoints?service_id=c14b24f6e3c949a39a3baefe7a5fc84e&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:55.122507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.131821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fefa4-90ca-4870-8aa0-20ca46c027b9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.171708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.171708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.172190 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.172353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.173170 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:55.173525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.174947 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.188840 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 463/922] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:55.189759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.258460 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fffde-d1ed-47ee-b874-41d96e4bd65b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.297621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b607e4-d0f6-4f16-a667-a646741dfdb0 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.298646 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f4420-9fc9-4124-a4ce-a510af224ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.299318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f4420-9fc9-4124-a4ce-a510af224ffc None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.299604 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f4420-9fc9-4124-a4ce-a510af224ffc None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.299921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f4420-9fc9-4124-a4ce-a510af224ffc None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.300609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f4420-9fc9-4124-a4ce-a510af224ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.301978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f4420-9fc9-4124-a4ce-a510af224ffc None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.311937 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 460/923] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:16:55.311937 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ca9ea-074f-4625-8aa6-af6b2c18f156 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.311937 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ca9ea-074f-4625-8aa6-af6b2c18f156 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.312185 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ca9ea-074f-4625-8aa6-af6b2c18f156 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.313723 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 461/924] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:55.322856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c6414-9a5c-4823-9e16-fbaf251a0319 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.323877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c6414-9a5c-4823-9e16-fbaf251a0319 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.324299 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c6414-9a5c-4823-9e16-fbaf251a0319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.338994 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.339986 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.340387 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.340760 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.345814 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-484c6414-9a5c-4823-9e16-fbaf251a0319 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:55.347355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-484c6414-9a5c-4823-9e16-fbaf251a0319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:55.353967 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.355523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:55.374811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:55.375678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:55.381776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:55.381776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:55.381776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:55.381776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:55.381776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 464/925] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:55.382185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.443917 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 462/926] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:55.469172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c6414-9a5c-4823-9e16-fbaf251a0319 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.516405 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812377b-ca20-4a41-bc9c-713b01079c38 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.562267 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.563728 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.564252 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.565075 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.566324 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:55.567188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.569657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.586522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 465/927] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:55.593295 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.594748 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c6414-9a5c-4823-9e16-fbaf251a0319 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.634303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.635297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.635648 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.636822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.637564 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.639744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:55.655122 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:55.656097 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:16:55.656817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:55.659842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 463/928] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:55.663654 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.713024 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9938-dc69-4bf0-b84d-8bbdad3032ef None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.749539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc4ed0-d852-4ba7-b842-65191e87ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.750399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4ed0-d852-4ba7-b842-65191e87ab37 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.750619 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4ed0-d852-4ba7-b842-65191e87ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.750894 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4ed0-d852-4ba7-b842-65191e87ab37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.758587 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4ed0-d852-4ba7-b842-65191e87ab37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.760058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4ed0-d852-4ba7-b842-65191e87ab37 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.772039 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc37ef6-bc75-476a-ae55-06184badb028 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-ebbc4ed0-d852-4ba7-b842-65191e87ab37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:16:55.775451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:55.776262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:16:55.777072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:55.780148 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 466/929] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:55.782111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffce5a-624a-4e4d-b508-2a8bd68c5503 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.782394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffce5a-624a-4e4d-b508-2a8bd68c5503 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.782957 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffce5a-624a-4e4d-b508-2a8bd68c5503 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.784153 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 467/930] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:55.784699 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffce5a-624a-4e4d-b508-2a8bd68c5503 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.808848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4faa97-dbb3-484f-af7b-7d21c933f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.809732 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4faa97-dbb3-484f-af7b-7d21c933f440 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.810281 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4faa97-dbb3-484f-af7b-7d21c933f440 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.810621 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4faa97-dbb3-484f-af7b-7d21c933f440 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.811341 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4faa97-dbb3-484f-af7b-7d21c933f440 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:55.811648 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4faa97-dbb3-484f-af7b-7d21c933f440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.813054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4faa97-dbb3-484f-af7b-7d21c933f440 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.823720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 464/931] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:55.823720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d4fe-5b0c-4df3-8eab-217cef227453 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.823720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d4fe-5b0c-4df3-8eab-217cef227453 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.823720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d4fe-5b0c-4df3-8eab-217cef227453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.839475 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-f2a5d4fe-5b0c-4df3-8eab-217cef227453 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:55.840728 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-f2a5d4fe-5b0c-4df3-8eab-217cef227453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:55.892371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffce5a-624a-4e4d-b508-2a8bd68c5503 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:55.910324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 465/932] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:55.911170 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d4fe-5b0c-4df3-8eab-217cef227453 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:55.936085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:55.937239 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:55.937532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:55.937789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:55.938621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:55.938931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:55.940385 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:55.957813 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 468/933] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:55.958696 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.018825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d4fe-5b0c-4df3-8eab-217cef227453 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.055530 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef144d-a74a-4413-8886-8201a2471885 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.056527 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.057408 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.057893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.058276 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.058985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:56.059289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.060988 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.070802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 466/934] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:56.071453 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.089892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.090693 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.090970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.091233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.092700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.094154 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:56.106224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:56.107065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:56.107954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 469/935] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:16:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:56.108666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.174238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd64d5-0c46-4df2-9c00-977156a53601 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.208559 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.208901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c30c-f298-4e7c-b461-d7ac996437eb None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.209354 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.209638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.209915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.220973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.222434 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:16:56.240106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:56.240957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:56.242571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:16:56.242571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:16:56.242571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:16:56.242571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:56.242571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 467/936] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:56.242571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.249374 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7994883-7973-4a26-b5c3-dcd2ca600a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.250041 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7994883-7973-4a26-b5c3-dcd2ca600a8e None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.250325 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7994883-7973-4a26-b5c3-dcd2ca600a8e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.250599 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7994883-7973-4a26-b5c3-dcd2ca600a8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.251347 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7994883-7973-4a26-b5c3-dcd2ca600a8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.252752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7994883-7973-4a26-b5c3-dcd2ca600a8e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.282354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 470/937] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:16:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:56.282354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7994883-7973-4a26-b5c3-dcd2ca600a8e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.366750 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536858b-b249-46bb-b50f-60f3f3844799 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.398799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7994883-7973-4a26-b5c3-dcd2ca600a8e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.405415 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c977-83ab-4990-a790-60849393190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.406244 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c977-83ab-4990-a790-60849393190c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.406609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c977-83ab-4990-a790-60849393190c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.406956 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c977-83ab-4990-a790-60849393190c None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.407753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499c977-83ab-4990-a790-60849393190c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:56.408171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499c977-83ab-4990-a790-60849393190c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.409640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499c977-83ab-4990-a790-60849393190c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.414969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 468/938] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:56.421107 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c977-83ab-4990-a790-60849393190c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.442686 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.443356 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.443637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.451794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.451794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:56.451794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.451794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.465117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 471/939] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:56.473478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.554124 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c977-83ab-4990-a790-60849393190c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.599037 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6167b79-2e69-41c9-9169-8f3309859147 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.605211 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.606014 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.606401 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.606781 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.607832 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:56.608753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.610256 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.617858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 469/940] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:56.623442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.638691 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.640091 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.640772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.641285 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.648780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.650515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:56.665722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:56.666574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:56.667354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:56.667354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:56.667354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:56.667354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:56.667354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:56.667354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:56.667354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:56.667354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:56.670590 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 472/941] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:56.676175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.737759 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459fa4d-8583-42c4-ba35-6a4489c6ba45 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.773931 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83143-ae7e-4cd9-b637-5503c53bd9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.774660 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83143-ae7e-4cd9-b637-5503c53bd9cc None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.774952 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83143-ae7e-4cd9-b637-5503c53bd9cc None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.775229 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83143-ae7e-4cd9-b637-5503c53bd9cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.776235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc83143-ae7e-4cd9-b637-5503c53bd9cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.778248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc83143-ae7e-4cd9-b637-5503c53bd9cc None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.783526 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7361b2d-94da-4e9b-8619-ac78533a959f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:56.804870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 470/942] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:16:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:56.840931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243289-cc9d-48f3-a091-e53b4f2ba43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:56.841964 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243289-cc9d-48f3-a091-e53b4f2ba43c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:56.843063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243289-cc9d-48f3-a091-e53b4f2ba43c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:56.843495 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243289-cc9d-48f3-a091-e53b4f2ba43c None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:56.844598 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243289-cc9d-48f3-a091-e53b4f2ba43c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:56.845063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243289-cc9d-48f3-a091-e53b4f2ba43c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:56.846848 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243289-cc9d-48f3-a091-e53b4f2ba43c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:56.862196 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 473/943] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:56.867638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83143-ae7e-4cd9-b637-5503c53bd9cc None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:56.992031 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83143-ae7e-4cd9-b637-5503c53bd9cc None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:57.034139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a54ac-0eab-4025-b4c4-e18f3a542828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:57.035033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a54ac-0eab-4025-b4c4-e18f3a542828 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:57.035309 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a54ac-0eab-4025-b4c4-e18f3a542828 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:57.035576 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a54ac-0eab-4025-b4c4-e18f3a542828 None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/a8c0147cba5e4243acc460b09031bbad/roles/80470f642b064584a5365cba7ab413db` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:57.039589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a54ac-0eab-4025-b4c4-e18f3a542828 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=a8c0147cba5e4243acc460b09031bbad, role_id=80470f642b064584a5365cba7ab413db)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:57.041137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a54ac-0eab-4025-b4c4-e18f3a542828 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:57.058788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 471/944] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:16:56 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/a8c0147cba5e4243acc460b09031bbad/roles/80470f642b064584a5365cba7ab413db => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:16:57.702589 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd2e3-56ac-4004-a226-60e3ceee75ab None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:57.703122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd2e3-56ac-4004-a226-60e3ceee75ab None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:57.703122 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd2e3-56ac-4004-a226-60e3ceee75ab None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:57.704777 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 474/945] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:57.710410 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685dd32-d1d6-4dd0-9962-7eec0ec7e0dd None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:57.710811 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685dd32-d1d6-4dd0-9962-7eec0ec7e0dd None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:57.710991 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685dd32-d1d6-4dd0-9962-7eec0ec7e0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:57.728064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-5685dd32-d1d6-4dd0-9962-7eec0ec7e0dd None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:57.729255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-5685dd32-d1d6-4dd0-9962-7eec0ec7e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:57.801933 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 472/946] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:57.826616 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dd2e3-56ac-4004-a226-60e3ceee75ab None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:57.929162 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dd2e3-56ac-4004-a226-60e3ceee75ab None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:57.964522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:57.965637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:57.966121 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:57.966618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:57.967994 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:57.969681 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:57.981922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:57.983991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:16:57.984762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:57.987649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 475/947] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:16:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:57.993608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685dd32-d1d6-4dd0-9962-7eec0ec7e0dd None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:58.094440 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685dd32-d1d6-4dd0-9962-7eec0ec7e0dd None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:58.132063 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:58.132742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:58.133028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:58.133304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:58.134025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:58.134334 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:58.135710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:58.141757 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 473/948] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:16:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:58.147718 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:58.261300 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8cee0-7391-4654-bc44-c6d867a35214 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:58.298103 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e347a0-f2b0-4573-8bf9-dc5a620543d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:58.298770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e347a0-f2b0-4573-8bf9-dc5a620543d4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:58.299052 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e347a0-f2b0-4573-8bf9-dc5a620543d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:58.299327 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e347a0-f2b0-4573-8bf9-dc5a620543d4 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:58.300075 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e347a0-f2b0-4573-8bf9-dc5a620543d4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:58.300388 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e347a0-f2b0-4573-8bf9-dc5a620543d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:58.301758 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e347a0-f2b0-4573-8bf9-dc5a620543d4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:58.307305 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 476/949] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:16:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:58.313735 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:58.417473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03b17c-4e0e-43c9-9f1e-1550d6accb1a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:58.453826 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c474a-76df-4582-af01-247b6e5de923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:58.454834 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c474a-76df-4582-af01-247b6e5de923 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:58.455367 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c474a-76df-4582-af01-247b6e5de923 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:58.455893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c474a-76df-4582-af01-247b6e5de923 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:58.456842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c474a-76df-4582-af01-247b6e5de923 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:58.458416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c474a-76df-4582-af01-247b6e5de923 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:58.479198 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 474/950] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:16:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:16:58.692720 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4cdcc-f538-4658-95cc-991bc73ac67e None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:58.693057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4cdcc-f538-4658-95cc-991bc73ac67e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:58.693294 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4cdcc-f538-4658-95cc-991bc73ac67e None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:58.694974 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 477/951] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:58.700757 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491dd00-74c1-4d33-b0fd-64cb7bee45ca None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:58.701588 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491dd00-74c1-4d33-b0fd-64cb7bee45ca None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:58.701874 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491dd00-74c1-4d33-b0fd-64cb7bee45ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:58.719819 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-6491dd00-74c1-4d33-b0fd-64cb7bee45ca None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:58.722287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-6491dd00-74c1-4d33-b0fd-64cb7bee45ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:58.801475 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 475/952] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:16:58.825777 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4cdcc-f538-4658-95cc-991bc73ac67e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:58.934972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4cdcc-f538-4658-95cc-991bc73ac67e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:58.971257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:58.972015 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:58.972354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:58.972635 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:58.973353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:58.974787 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:58.976240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: WARNING keystone.server.flask.common [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:16:58.995713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.sql.core [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:16:58.995713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:16:58.995713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [parameters: {'id': '431f6669e2124691bbcf16df3f8912cb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:16:58.995713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143187) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 431f6669e2124691bbcf16df3f8912cb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 431f6669e2124691bbcf16df3f8912cb. May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application conn.query(q) May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:16:59.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application result.read() May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 15:16:59.005047 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application next(self.gen) May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application yield resource May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application next(self.gen) May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise self.value May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application session.commit() May 09 15:16:59.005893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.session.flush() May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application compat.raise_( May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:16:59.007379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:16:59.009546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application conn.query(q) May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application result.read() May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:16:59.011439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [parameters: {'id': '431f6669e2124691bbcf16df3f8912cb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:59.013577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:59.016521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 431f6669e2124691bbcf16df3f8912cb. May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:59.022242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 478/953] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 9 15:16:58 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:59.031842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491dd00-74c1-4d33-b0fd-64cb7bee45ca None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:59.139187 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491dd00-74c1-4d33-b0fd-64cb7bee45ca None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:59.180722 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb8697-7174-4179-86e4-dd66ad1a4c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:59.181622 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb8697-7174-4179-86e4-dd66ad1a4c3d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.181903 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb8697-7174-4179-86e4-dd66ad1a4c3d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.182207 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb8697-7174-4179-86e4-dd66ad1a4c3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.191251 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb8697-7174-4179-86e4-dd66ad1a4c3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:59.192695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb8697-7174-4179-86e4-dd66ad1a4c3d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-1ddb8697-7174-4179-86e4-dd66ad1a4c3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:16:59.208537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:59.210637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:59.212689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 476/954] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:59.222730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:59.316249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abb8e-4164-4d07-ab07-56bccf7fed54 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.316944 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abb8e-4164-4d07-ab07-56bccf7fed54 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.317238 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abb8e-4164-4d07-ab07-56bccf7fed54 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.319296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 477/955] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:16:59.324776 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9ded-b784-413c-92e8-9a61c6eba9a0 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.325064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9ded-b784-413c-92e8-9a61c6eba9a0 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.325340 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9ded-b784-413c-92e8-9a61c6eba9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.337357 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c00f3-0b87-4b3d-ba1c-9889bc02757d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:59.347675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-fffa9ded-b784-413c-92e8-9a61c6eba9a0 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:59.347675 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-fffa9ded-b784-413c-92e8-9a61c6eba9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:59.376955 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ccde0-ffa7-465a-a03f-c907b6f3c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:59.377618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ccde0-ffa7-465a-a03f-c907b6f3c44e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.377905 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ccde0-ffa7-465a-a03f-c907b6f3c44e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.378183 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ccde0-ffa7-465a-a03f-c907b6f3c44e None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.378947 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ccde0-ffa7-465a-a03f-c907b6f3c44e None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:59.379257 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ccde0-ffa7-465a-a03f-c907b6f3c44e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:59.380921 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ccde0-ffa7-465a-a03f-c907b6f3c44e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:59.401712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 479/956] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:59.403458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989590fd-449b-4622-81bc-0bd58faae0ca None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.403820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989590fd-449b-4622-81bc-0bd58faae0ca None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.404141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989590fd-449b-4622-81bc-0bd58faae0ca None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.406321 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 480/957] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:16:59.411946 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec620af-ba1e-4d5d-a535-2ca5e412b649 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.412253 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec620af-ba1e-4d5d-a535-2ca5e412b649 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.412512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec620af-ba1e-4d5d-a535-2ca5e412b649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.428161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 478/958] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:59.430914 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-6ec620af-ba1e-4d5d-a535-2ca5e412b649 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:16:59.432559 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-6ec620af-ba1e-4d5d-a535-2ca5e412b649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:16:59.452163 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9ded-b784-413c-92e8-9a61c6eba9a0 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:59.512698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 481/959] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:16:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:16:59.537983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec620af-ba1e-4d5d-a535-2ca5e412b649 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:59.564834 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9ded-b784-413c-92e8-9a61c6eba9a0 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:59.610814 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:59.611948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.612362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.612782 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.613572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:59.615086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:59.627416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:59.628431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:16:59.629190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:16:59.631566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 479/960] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:16:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:16:59.639480 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:59.660453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec620af-ba1e-4d5d-a535-2ca5e412b649 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:59.702073 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14124b-4572-4554-aa3e-80641561ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:59.704107 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14124b-4572-4554-aa3e-80641561ae92 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.704325 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14124b-4572-4554-aa3e-80641561ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.704606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14124b-4572-4554-aa3e-80641561ae92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.718716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14124b-4572-4554-aa3e-80641561ae92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-5f14124b-4572-4554-aa3e-80641561ae92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:16:59.728130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:16:59.729189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:16:59.730216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 482/961] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:16:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:16:59.736060 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14124b-4572-4554-aa3e-80641561ae92 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:59.757334 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77292-f165-4c88-bbe6-1e55f7c60bd0 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:59.801712 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:59.802647 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.803010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.803661 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.804774 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] RBAC: Adding query filter params (name=compute) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:59.805162 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:59.806607 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:59.814713 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 480/962] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:16:59.820061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:59.852286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14124b-4572-4554-aa3e-80641561ae92 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:59.890635 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:59.891526 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.892001 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.892411 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.893291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:59.893731 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:59.895224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:59.904731 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 483/963] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:16:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:16:59.910579 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:16:59.933952 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93423f1e-5511-4e7a-827c-9851d0ad0579 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:16:59.970984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:16:59.972115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:16:59.972762 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:16:59.973119 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:16:59.974133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] RBAC: Adding query filter params (type=compute) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:16:59.974524 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:16:59.976608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:16:59.983848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 481/964] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:16:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:00.021559 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c2d46-827e-4138-8d00-72ddafa6a882 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:00.061145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:00.062251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:00.062712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:00.063199 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:00.076525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:00.078661 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:00.098053 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:00.098954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:00.099723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:00.099723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:00.099723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:00.099723 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:00.101829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 484/965] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:00.108708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:00.216410 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e313-29d2-4e73-9fca-1842ae0e823c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:00.255681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:00.256351 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:00.256638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:00.256917 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:00.257649 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:00.257958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:00.259323 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:00.272131 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 482/966] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:00.277565 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:00.383177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9950d9-6cd6-4e16-b5e5-a6f079e7170d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:00.418855 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:00.420128 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:00.420612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:00.421085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:00.429353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:00.431103 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:17:00.446770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:00.447657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:17:00.448532 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:00.451206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 485/967] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:17:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:00.457240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:00.565899 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc154d2-857b-4e99-849d-2ee1b445ad86 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:00.601322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f23dc-86f4-470a-80d4-db4f4681b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:00.601993 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f23dc-86f4-470a-80d4-db4f4681b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:00.602277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f23dc-86f4-470a-80d4-db4f4681b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:00.602549 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f23dc-86f4-470a-80d4-db4f4681b9b4 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:00.603392 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f23dc-86f4-470a-80d4-db4f4681b9b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:00.603700 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f23dc-86f4-470a-80d4-db4f4681b9b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:00.605154 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f23dc-86f4-470a-80d4-db4f4681b9b4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:00.623890 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 483/968] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:17:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:00.629563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:00.736703 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdbcb-6770-4068-909d-8072436d5a39 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:00.775904 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b794c-031b-4834-8ef5-b8c907912020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:00.776624 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b794c-031b-4834-8ef5-b8c907912020 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:00.776909 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b794c-031b-4834-8ef5-b8c907912020 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:00.777178 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b794c-031b-4834-8ef5-b8c907912020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:00.865771 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b794c-031b-4834-8ef5-b8c907912020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:00.867157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b794c-031b-4834-8ef5-b8c907912020 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:00.940102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d069e0f-7300-4e52-b175-655a2b6b0550 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:00.940609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d069e0f-7300-4e52-b175-655a2b6b0550 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:00.940711 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d069e0f-7300-4e52-b175-655a2b6b0550 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:00.942240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 484/969] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:17:00.947690 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17662c-da5c-4906-9c98-42e867893a1b None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:00.948072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17662c-da5c-4906-9c98-42e867893a1b None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:00.948418 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17662c-da5c-4906-9c98-42e867893a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:00.969430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-2c17662c-da5c-4906-9c98-42e867893a1b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:00.970369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 486/970] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:00.970843 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-2c17662c-da5c-4906-9c98-42e867893a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:00.979793 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b794c-031b-4834-8ef5-b8c907912020 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.053454 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 485/971] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:01.076727 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17662c-da5c-4906-9c98-42e867893a1b None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.080961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b794c-031b-4834-8ef5-b8c907912020 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.115088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.115965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.116203 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.116484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.127728 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.129224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:01.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:01.148570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:01.149541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:01.149541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:01.149541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:01.149541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:01.149541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 487/972] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:01.155467 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.183658 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17662c-da5c-4906-9c98-42e867893a1b None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.221599 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.222652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.223082 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.223501 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.224337 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.226033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:01.239168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:01.240328 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:17:01.241192 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:01.248853 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 486/973] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:01.249958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.259317 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44b149-02ac-45d3-b152-91cc578627c9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.296445 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.297223 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.297511 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.297791 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.298523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:01.298983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.300933 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.319870 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 488/974] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:01.322271 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.364788 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d9046-4d9e-40d7-9fd7-80888d33d48c None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.400802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.401481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.401726 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.402010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.402880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:01.403195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.405209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.410312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 487/975] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:01.415932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.429866 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53fde-6b7f-460e-80cc-be1e15b8b2dd None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.464539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.465674 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.466183 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.467209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.494983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.497891 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:17:01.518431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:01.519268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:01.520105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:17:01.520105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:17:01.520105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:17:01.520105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:17:01.520105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:17:01.520105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:17:01.520105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:17:01.520105 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:01.526258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 489/976] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:01.528374 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.539322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91037367-9b06-4cbb-bc34-7e184de3888e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.575148 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.575465 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.575714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.576559 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.578017 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:01.578554 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.580524 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.591036 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 488/977] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:01.592303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.653201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d200d-fe5a-4d3b-80a1-6c4cc28f3c84 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.692344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.693397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.693930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.694410 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.695438 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:01.696236 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.697863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.700762 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcae27-af64-45d2-a3b9-59930e411c2e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.717738 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 490/978] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:01.719301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.737954 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.738545 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.738836 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.739110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.739948 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] RBAC: Adding query filter params (interface=admin, service_id=c14b24f6e3c949a39a3baefe7a5fc84e, region_id=RegionOne) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:01.740264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.741656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.752099 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 489/979] 10.222.0.32 () {56 vars in 1249 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/endpoints?service_id=c14b24f6e3c949a39a3baefe7a5fc84e&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:01.752917 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:01.826559 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b935-0e43-42fe-a1b3-e350d57424de None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.856021 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaa7ef-053a-4199-a4e6-7ddd6f1720c4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:01.861948 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9fa4-b3b8-4c35-9a5e-f0a3e930baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.862952 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9fa4-b3b8-4c35-9a5e-f0a3e930baee None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.863390 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9fa4-b3b8-4c35-9a5e-f0a3e930baee None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.863848 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9fa4-b3b8-4c35-9a5e-f0a3e930baee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.864829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9fa4-b3b8-4c35-9a5e-f0a3e930baee None admin] RBAC: Adding query filter params (role.id=80470f642b064584a5365cba7ab413db, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=a8c0147cba5e4243acc460b09031bbad) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:01.865286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9fa4-b3b8-4c35-9a5e-f0a3e930baee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.866868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9fa4-b3b8-4c35-9a5e-f0a3e930baee None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.879879 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 491/980] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/role_assignments?user.id=a8c0147cba5e4243acc460b09031bbad&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=80470f642b064584a5365cba7ab413db => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:01.881457 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3f4d-2c34-496d-b936-65037cbcdf05 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.881754 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3f4d-2c34-496d-b936-65037cbcdf05 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.882038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec3f4d-2c34-496d-b936-65037cbcdf05 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.885054 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 492/981] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:01.890246 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2214cc-07bf-4943-ad5a-35f66f08b47e None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.890605 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2214cc-07bf-4943-ad5a-35f66f08b47e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.890816 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2214cc-07bf-4943-ad5a-35f66f08b47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.893678 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe315-eed7-469e-9eba-b65f8a7b6aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:01.894366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe315-eed7-469e-9eba-b65f8a7b6aab None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:01.894652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe315-eed7-469e-9eba-b65f8a7b6aab None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:01.894930 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfe315-eed7-469e-9eba-b65f8a7b6aab None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:01.895628 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfe315-eed7-469e-9eba-b65f8a7b6aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:01.897073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfe315-eed7-469e-9eba-b65f8a7b6aab None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:01.908397 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 490/982] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:17:01 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:17:01.909371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-7f2214cc-07bf-4943-ad5a-35f66f08b47e None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:01.910849 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-7f2214cc-07bf-4943-ad5a-35f66f08b47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:01.996692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 493/983] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:02.024089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe315-eed7-469e-9eba-b65f8a7b6aab None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:02.145112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfe315-eed7-469e-9eba-b65f8a7b6aab None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:02.180877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:02.181564 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:02.181853 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:02.182130 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:02.182872 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:02.184363 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:02.186566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: WARNING keystone.server.flask.common [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:17:02.203152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.sql.core [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:17:02.203152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:17:02.203152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [parameters: {'user_id': '7c9f2757317549dbbd7c46cb42894e7a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:17:02.203152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143188) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-3b7b7acc-3822-4077-adf9-2fcc5cfd51a8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application conn.query(q) May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application result.read() May 09 15:17:02.221069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:17:02.221971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application next(self.gen) May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application yield resource May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application next(self.gen) May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise self.value May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application session.commit() May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:17:02.222816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self.session.flush() May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application compat.raise_( May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:17:02.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:17:02.224709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application conn.query(q) May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application result.read() May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:17:02.225457 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [parameters: {'user_id': '7c9f2757317549dbbd7c46cb42894e7a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:02.226193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 15:17:02.226895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 15:17:02.229746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 15:17:02.229746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 15:17:02.229746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:17:02.229746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:17:02.229746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:17:02.229746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:02.229746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 491/984] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:17:02 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:02.237389 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2214cc-07bf-4943-ad5a-35f66f08b47e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:02.342683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2214cc-07bf-4943-ad5a-35f66f08b47e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:02.379902 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3f7e4-0269-446c-a22a-9caa0abe7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:02.380743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3f7e4-0269-446c-a22a-9caa0abe7b42 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:02.381028 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3f7e4-0269-446c-a22a-9caa0abe7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:02.381304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3f7e4-0269-446c-a22a-9caa0abe7b42 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:02.389197 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3f7e4-0269-446c-a22a-9caa0abe7b42 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:02.390632 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3f7e4-0269-446c-a22a-9caa0abe7b42 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:02.399557 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f8fc-b1d1-42ea-8a1a-2c785713e012 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:02.399896 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f8fc-b1d1-42ea-8a1a-2c785713e012 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:02.400185 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64f8fc-b1d1-42ea-8a1a-2c785713e012 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-6cc3f7e4-0269-446c-a22a-9caa0abe7b42 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:17:02.407038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:02.408189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:02.409159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 494/986] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:17:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:02.412528 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 492/986] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:02.412637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbb2f-0f74-41c8-a037-46445895473d None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:02.412637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbb2f-0f74-41c8-a037-46445895473d None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:02.412874 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbb2f-0f74-41c8-a037-46445895473d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:02.414241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64f8fc-b1d1-42ea-8a1a-2c785713e012 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:02.431011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-195dbb2f-0f74-41c8-a037-46445895473d None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:02.432382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-195dbb2f-0f74-41c8-a037-46445895473d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:02.512155 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 495/987] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:02.530689 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dbb2f-0f74-41c8-a037-46445895473d None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:02.551085 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64f8fc-b1d1-42ea-8a1a-2c785713e012 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:02.603529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c932ca9-0aa5-4b27-8b3a-7c68f7ff9881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:02.604235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c932ca9-0aa5-4b27-8b3a-7c68f7ff9881 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:02.604576 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c932ca9-0aa5-4b27-8b3a-7c68f7ff9881 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:02.604797 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c932ca9-0aa5-4b27-8b3a-7c68f7ff9881 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:02.605606 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c932ca9-0aa5-4b27-8b3a-7c68f7ff9881 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:02.605914 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c932ca9-0aa5-4b27-8b3a-7c68f7ff9881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:02.607784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c932ca9-0aa5-4b27-8b3a-7c68f7ff9881 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:02.645239 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 493/988] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:17:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:02.656794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dbb2f-0f74-41c8-a037-46445895473d None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:02.696521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c6ff3-e9d9-41b8-9491-6144fa1d0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:02.697288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6ff3-e9d9-41b8-9491-6144fa1d0af4 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:02.697675 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6ff3-e9d9-41b8-9491-6144fa1d0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:02.698057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6ff3-e9d9-41b8-9491-6144fa1d0af4 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:02.698898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c6ff3-e9d9-41b8-9491-6144fa1d0af4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:02.700423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c6ff3-e9d9-41b8-9491-6144fa1d0af4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:02.716108 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 496/989] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:17:02 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:17:04.301340 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc54b6-bfa1-4d72-9548-23e9e9da357a None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.301856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc54b6-bfa1-4d72-9548-23e9e9da357a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.301930 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc54b6-bfa1-4d72-9548-23e9e9da357a None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.303414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 494/990] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:04.306117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4ad1-a7f4-460c-9e91-525c18ddd675 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.306521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4ad1-a7f4-460c-9e91-525c18ddd675 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.306672 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4ad1-a7f4-460c-9e91-525c18ddd675 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.308175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 497/991] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:04.308478 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1aea-f524-460a-8fb7-e889fa478abb None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.308773 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1aea-f524-460a-8fb7-e889fa478abb None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.309117 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1aea-f524-460a-8fb7-e889fa478abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.313770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829460a-2b6a-4df9-8b5b-04ae8519f8ef None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.314063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829460a-2b6a-4df9-8b5b-04ae8519f8ef None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.314345 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829460a-2b6a-4df9-8b5b-04ae8519f8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.328492 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ffba1aea-f524-460a-8fb7-e889fa478abb None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:04.330030 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ffba1aea-f524-460a-8fb7-e889fa478abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:04.330872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-a829460a-2b6a-4df9-8b5b-04ae8519f8ef None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:04.332051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-a829460a-2b6a-4df9-8b5b-04ae8519f8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:04.406396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 495/992] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:04.420208 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 498/993] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:04.428642 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1aea-f524-460a-8fb7-e889fa478abb None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:04.432209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829460a-2b6a-4df9-8b5b-04ae8519f8ef None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:04.532130 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1aea-f524-460a-8fb7-e889fa478abb None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:04.537023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829460a-2b6a-4df9-8b5b-04ae8519f8ef None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:04.572407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:04.572695 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:04.573137 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.573422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.573536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.573688 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] PATH_INFO: `/v3/services/image` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.573776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.573965 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.574352 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:04.574686 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:04.575732 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:04.576581 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:04.588900 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:04.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:04.596429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 496/994] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:17:04 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:04.597141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:04.597938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:04.598704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 499/995] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:17:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:04.600177 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:04.600345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:04.704573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adab6cb-9f47-4833-980e-d01e92f2dad6 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:04.710595 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cf14f-08b3-4b77-82ec-b34cfa5ac688 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:04.739087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:04.739750 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.740061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.740335 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.741045 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] RBAC: Adding query filter params (name=image) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:04.741351 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:04.742721 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:04.752671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 497/996] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:04.753694 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:04.754585 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:04.755254 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.755539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.755846 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.756570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:04.756888 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:04.758255 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:04.763951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 500/997] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:17:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:04.769606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:04.856906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce9e81-7dea-4c9d-82f1-aa904771cc57 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:04.873264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dd2f3-7050-4049-b724-58e70cb07cd5 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:04.894613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:04.895281 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.895566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.895880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.896597 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] RBAC: Adding query filter params (type=image) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:04.897030 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:04.898438 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:04.912041 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 498/998] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:04.912264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d30bc3-7f7e-4181-a5ab-80387a466745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:04.912264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d30bc3-7f7e-4181-a5ab-80387a466745 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:04.912264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d30bc3-7f7e-4181-a5ab-80387a466745 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:04.912264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d30bc3-7f7e-4181-a5ab-80387a466745 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:04.912575 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d30bc3-7f7e-4181-a5ab-80387a466745 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:04.912575 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d30bc3-7f7e-4181-a5ab-80387a466745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:04.912575 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d30bc3-7f7e-4181-a5ab-80387a466745 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:04.917121 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 501/999] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:17:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:04.922812 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:05.027372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72178613-99ce-44a0-a0f7-876bc4ad816e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:05.038194 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8aafa-6f02-4f86-8342-ab7d9d86d5d6 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:05.038501 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8aafa-6f02-4f86-8342-ab7d9d86d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:05.038752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8aafa-6f02-4f86-8342-ab7d9d86d5d6 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:05.043826 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 502/1000] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:17:05.046971 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f8fee-cfe3-4a32-937a-985fe4a133bf None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:05.047266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f8fee-cfe3-4a32-937a-985fe4a133bf None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:05.047544 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f8fee-cfe3-4a32-937a-985fe4a133bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:05.064879 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-6a7f8fee-cfe3-4a32-937a-985fe4a133bf None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:05.066108 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-6a7f8fee-cfe3-4a32-937a-985fe4a133bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:05.071298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662608a-c13b-4802-826e-da10de6d562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:05.072383 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662608a-c13b-4802-826e-da10de6d562a None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:05.072815 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662608a-c13b-4802-826e-da10de6d562a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:05.073286 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662608a-c13b-4802-826e-da10de6d562a None admin] PATH_INFO: `/v3/endpoints` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:05.074190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662608a-c13b-4802-826e-da10de6d562a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:05.075872 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662608a-c13b-4802-826e-da10de6d562a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:05.093160 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 499/1001] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:17:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:17:05.152979 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 503/1002] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:05.176121 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662608a-c13b-4802-826e-da10de6d562a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:05.281450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662608a-c13b-4802-826e-da10de6d562a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:05.317983 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:05.318782 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:05.319060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:05.319330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] PATH_INFO: `/v3/services/compute` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:05.320092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:05.321732 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:05.333683 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:05.334612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:05.335626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 500/1003] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:17:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:05.343391 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f8fee-cfe3-4a32-937a-985fe4a133bf None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:05.444681 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f8fee-cfe3-4a32-937a-985fe4a133bf None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:05.481712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:05.483215 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:05.483215 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:05.483494 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:05.484190 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] RBAC: Adding query filter params (name=compute) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:05.484500 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:05.485877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:05.490912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 504/1004] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:17:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:05.497286 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:05.604102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920671a-6664-4efb-88ea-53f9b9a98194 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:05.637235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:05.637912 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:05.638200 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:05.639124 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:05.639806 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:05.640120 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:05.642950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:05.652346 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 501/1005] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:17:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:05.654370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:05.755549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684a6b2-9071-4dc4-941f-2b2844f7cd99 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:05.790161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe756208-cc8c-409d-8113-97a0a50e1e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:05.790815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756208-cc8c-409d-8113-97a0a50e1e27 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:05.791098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756208-cc8c-409d-8113-97a0a50e1e27 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:05.791373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe756208-cc8c-409d-8113-97a0a50e1e27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:05.792195 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe756208-cc8c-409d-8113-97a0a50e1e27 None admin] RBAC: Adding query filter params (interface=public, service_id=d53b667a5e5646c9b34a4160afc1e8c9, region_id=RegionOne) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:05.792509 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe756208-cc8c-409d-8113-97a0a50e1e27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:05.793866 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe756208-cc8c-409d-8113-97a0a50e1e27 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:05.804673 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 505/1006] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:17:05 2022] GET /identity/v3/endpoints?service_id=d53b667a5e5646c9b34a4160afc1e8c9&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:05.805930 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:05.904656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025448e-31ee-4429-996c-9355a1e34c80 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:05.937222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d84dda-fd37-4079-a2f5-e7ebc039dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:05.937943 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84dda-fd37-4079-a2f5-e7ebc039dedd None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:05.938232 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84dda-fd37-4079-a2f5-e7ebc039dedd None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:05.938508 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84dda-fd37-4079-a2f5-e7ebc039dedd None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:05.939193 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d84dda-fd37-4079-a2f5-e7ebc039dedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:05.940611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d84dda-fd37-4079-a2f5-e7ebc039dedd None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:05.955245 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 502/1007] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:17:05 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:17:07.245270 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd7b7-78b3-4d88-833e-55fcf6aa278e None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:07.245788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd7b7-78b3-4d88-833e-55fcf6aa278e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:07.245895 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd7b7-78b3-4d88-833e-55fcf6aa278e None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:07.247248 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 506/1008] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:07.253209 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff5f43-301e-461d-a3cb-de62caa3c416 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:07.253613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff5f43-301e-461d-a3cb-de62caa3c416 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:07.253784 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff5f43-301e-461d-a3cb-de62caa3c416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:07.270466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-36ff5f43-301e-461d-a3cb-de62caa3c416 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:07.271656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-36ff5f43-301e-461d-a3cb-de62caa3c416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:07.336964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 503/1009] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:07.360443 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd7b7-78b3-4d88-833e-55fcf6aa278e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:07.389775 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa300f-d2c1-4ac4-8ecc-5871f4cda966 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:07.390074 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa300f-d2c1-4ac4-8ecc-5871f4cda966 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:07.390344 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa300f-d2c1-4ac4-8ecc-5871f4cda966 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:07.391745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 504/1010] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:17:07.396682 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d739d-b117-4e0c-a226-3956272bece9 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:07.396970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d739d-b117-4e0c-a226-3956272bece9 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:07.397248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d739d-b117-4e0c-a226-3956272bece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:07.413473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-000d739d-b117-4e0c-a226-3956272bece9 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:07.414649 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-000d739d-b117-4e0c-a226-3956272bece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:07.463658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd7b7-78b3-4d88-833e-55fcf6aa278e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:07.481045 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 505/1011] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:07.497206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abcb8b-0696-4a2f-aaa0-f6fec1b5fcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:07.498851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abcb8b-0696-4a2f-aaa0-f6fec1b5fcd6 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:07.499359 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abcb8b-0696-4a2f-aaa0-f6fec1b5fcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:07.499867 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abcb8b-0696-4a2f-aaa0-f6fec1b5fcd6 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:07.500806 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abcb8b-0696-4a2f-aaa0-f6fec1b5fcd6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:07.502354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abcb8b-0696-4a2f-aaa0-f6fec1b5fcd6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:07.504291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d739d-b117-4e0c-a226-3956272bece9 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:07.518405 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 507/1012] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:17:07 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:17:07.613477 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d739d-b117-4e0c-a226-3956272bece9 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:07.655586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765274-9bde-4520-a12b-71d4d0b06d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:07.656482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765274-9bde-4520-a12b-71d4d0b06d79 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:07.656767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765274-9bde-4520-a12b-71d4d0b06d79 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:07.657043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765274-9bde-4520-a12b-71d4d0b06d79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:07.658364 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765274-9bde-4520-a12b-71d4d0b06d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:07.659832 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765274-9bde-4520-a12b-71d4d0b06d79 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:07.661739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 506/1013] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:07.667398 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abcb8b-0696-4a2f-aaa0-f6fec1b5fcd6 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:07.769954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abcb8b-0696-4a2f-aaa0-f6fec1b5fcd6 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:07.802997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9adc71-a9dd-4f7b-824f-1eaf2d615411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:07.803658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9adc71-a9dd-4f7b-824f-1eaf2d615411 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:07.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9adc71-a9dd-4f7b-824f-1eaf2d615411 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:07.804252 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9adc71-a9dd-4f7b-824f-1eaf2d615411 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:07.804972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9adc71-a9dd-4f7b-824f-1eaf2d615411 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:07.806407 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9adc71-a9dd-4f7b-824f-1eaf2d615411 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:07.838142 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 508/1014] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:17:07 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:17:08.258370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b50b5d-d71d-4601-97dd-3c66da93acd8 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:08.258918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b50b5d-d71d-4601-97dd-3c66da93acd8 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:08.258918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b50b5d-d71d-4601-97dd-3c66da93acd8 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:08.260477 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 507/1015] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:08.265765 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35745f-2fd1-4907-9953-21990281ff79 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:08.266181 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35745f-2fd1-4907-9953-21990281ff79 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:08.266326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35745f-2fd1-4907-9953-21990281ff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:08.284326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-6a35745f-2fd1-4907-9953-21990281ff79 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:08.285521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-6a35745f-2fd1-4907-9953-21990281ff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:08.353398 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 509/1016] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:08 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:08.377278 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b50b5d-d71d-4601-97dd-3c66da93acd8 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:08.478033 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b50b5d-d71d-4601-97dd-3c66da93acd8 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:08.510530 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:08.511257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:08.511543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:08.511847 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] PATH_INFO: `/v3/services/compute` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:08.512503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:08.514489 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:08.525925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:08.526799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:17:08.527571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:08.532191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 508/1017] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:17:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:08.533822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35745f-2fd1-4907-9953-21990281ff79 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:08.634525 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35745f-2fd1-4907-9953-21990281ff79 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:08.669030 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:08.670254 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:08.670542 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:08.670821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:08.671533 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] RBAC: Adding query filter params (name=compute) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:08.671925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:08.673365 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:08.682888 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 510/1018] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:17:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:08.684604 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:08.789623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933489e-b235-4475-b53b-82a4f25faebc None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:08.822749 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f13b6-2cb7-45dc-8a89-40c21fcc6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:08.823422 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f13b6-2cb7-45dc-8a89-40c21fcc6d7a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:08.823709 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f13b6-2cb7-45dc-8a89-40c21fcc6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:08.824027 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f13b6-2cb7-45dc-8a89-40c21fcc6d7a None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:08.824742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f13b6-2cb7-45dc-8a89-40c21fcc6d7a None admin] RBAC: Adding query filter params (type=compute) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:08.825053 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f13b6-2cb7-45dc-8a89-40c21fcc6d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:08.826555 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f13b6-2cb7-45dc-8a89-40c21fcc6d7a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:08.836156 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 509/1019] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:17:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:08.837592 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:08.934659 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861cebb-1110-4800-8dd2-3da2271ffe4f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:08.968352 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57adef-84cd-4854-9b80-ff4aa46a2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:08.969006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57adef-84cd-4854-9b80-ff4aa46a2f04 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:08.969288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57adef-84cd-4854-9b80-ff4aa46a2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:08.969561 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57adef-84cd-4854-9b80-ff4aa46a2f04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:08.970303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57adef-84cd-4854-9b80-ff4aa46a2f04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:08.971654 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57adef-84cd-4854-9b80-ff4aa46a2f04 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:08.999806 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 511/1020] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:17:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:17:09.849742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af34d-9993-4685-b904-c00502173a56 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:09.850226 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af34d-9993-4685-b904-c00502173a56 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:09.850226 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af34d-9993-4685-b904-c00502173a56 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:09.851588 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 510/1021] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:09.857358 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1edd-2c10-4f59-bf22-50a88a06edea None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:09.857789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1edd-2c10-4f59-bf22-50a88a06edea None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:09.857913 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1edd-2c10-4f59-bf22-50a88a06edea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:09.875683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-ab9a1edd-2c10-4f59-bf22-50a88a06edea None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:09.876891 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-ab9a1edd-2c10-4f59-bf22-50a88a06edea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:09.948856 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 512/1022] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:09.974436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af34d-9993-4685-b904-c00502173a56 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:10.074273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af34d-9993-4685-b904-c00502173a56 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:10.106791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed494b89-48b1-4f81-a5bd-2cec8b406d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:10.108407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed494b89-48b1-4f81-a5bd-2cec8b406d76 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.108694 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed494b89-48b1-4f81-a5bd-2cec8b406d76 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.108969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed494b89-48b1-4f81-a5bd-2cec8b406d76 None admin] PATH_INFO: `/v3/services/image` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.109624 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed494b89-48b1-4f81-a5bd-2cec8b406d76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:10.110994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed494b89-48b1-4f81-a5bd-2cec8b406d76 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-ed494b89-48b1-4f81-a5bd-2cec8b406d76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:10.122765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:10.123687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:10.129516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 511/1023] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:17:09 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:10.131861 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1edd-2c10-4f59-bf22-50a88a06edea None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:10.149062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436496b8-5389-4b9f-9cff-eadf70ff4bee None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.149356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436496b8-5389-4b9f-9cff-eadf70ff4bee None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.149641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436496b8-5389-4b9f-9cff-eadf70ff4bee None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.151023 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 512/1024] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:17:10.156733 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016f9c-03aa-4b03-8f67-48d8f72b3e84 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.157022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016f9c-03aa-4b03-8f67-48d8f72b3e84 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.157300 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016f9c-03aa-4b03-8f67-48d8f72b3e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.174681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-a1016f9c-03aa-4b03-8f67-48d8f72b3e84 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:10.175901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-a1016f9c-03aa-4b03-8f67-48d8f72b3e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:10.231556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1edd-2c10-4f59-bf22-50a88a06edea None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:10.245371 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 513/1025] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:10.265185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:10.265847 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.266126 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.266396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.267097 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] RBAC: Adding query filter params (name=image) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:10.267397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:10.268777 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:10.270886 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016f9c-03aa-4b03-8f67-48d8f72b3e84 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:10.273925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 513/1026] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:10.280336 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:10.375970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016f9c-03aa-4b03-8f67-48d8f72b3e84 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:10.377028 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ba020-1916-4404-8977-fc864ce3c779 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:10.411000 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:10.411395 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3f28-8c51-4d97-8661-e9c87e55abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:10.411651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.411959 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.412217 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3f28-8c51-4d97-8661-e9c87e55abee None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.412311 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.412502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3f28-8c51-4d97-8661-e9c87e55abee None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.412777 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3f28-8c51-4d97-8661-e9c87e55abee None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.412926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] RBAC: Adding query filter params (type=image) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:10.413213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:10.413950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3f28-8c51-4d97-8661-e9c87e55abee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:10.414566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:10.415369 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3f28-8c51-4d97-8661-e9c87e55abee None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:10.417214 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 514/1027] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:10.424392 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 514/1028] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:10.424524 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3f28-8c51-4d97-8661-e9c87e55abee None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:10.425095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:10.521190 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21127481-a95f-469f-b6ff-1b11b95e1bd6 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:10.521528 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3f28-8c51-4d97-8661-e9c87e55abee None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:10.554384 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:10.554865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a507ee-c61b-4053-861c-1004b37c6f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:10.555079 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.555306 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.555531 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a507ee-c61b-4053-861c-1004b37c6f69 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.555628 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.555841 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a507ee-c61b-4053-861c-1004b37c6f69 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.556123 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a507ee-c61b-4053-861c-1004b37c6f69 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.556372 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] RBAC: Adding query filter params (interface=public, service_id=91be7c7debd24e92928658fea66e7d88, region_id=RegionOne) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:10.556677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:10.556842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a507ee-c61b-4053-861c-1004b37c6f69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:10.558022 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:10.558336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a507ee-c61b-4053-861c-1004b37c6f69 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:10.568234 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 515/1029] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:17:10 2022] GET /identity/v3/endpoints?service_id=91be7c7debd24e92928658fea66e7d88&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:10.572462 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:10.584061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 515/1030] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:17:10 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:17:10.683329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf32b1-df69-4f3b-a2a1-50ce7e3d2fc1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:10.720171 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620769e3-c5f7-40cf-b537-223a8f492218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:10.720847 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620769e3-c5f7-40cf-b537-223a8f492218 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:10.721120 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620769e3-c5f7-40cf-b537-223a8f492218 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:10.721389 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620769e3-c5f7-40cf-b537-223a8f492218 None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:10.722089 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620769e3-c5f7-40cf-b537-223a8f492218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:10.723471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620769e3-c5f7-40cf-b537-223a8f492218 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:10.735790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 516/1031] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:17:10 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:17:11.368353 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78a45f-ce76-4d6d-9971-5f65fe590fcf None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:11.368893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78a45f-ce76-4d6d-9971-5f65fe590fcf None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:11.368893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78a45f-ce76-4d6d-9971-5f65fe590fcf None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:11.370327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 516/1032] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:11.376246 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a86be-ba0d-454d-a4b2-360e12cb43cf None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:11.376676 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a86be-ba0d-454d-a4b2-360e12cb43cf None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:11.376815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a86be-ba0d-454d-a4b2-360e12cb43cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:11.393862 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-f82a86be-ba0d-454d-a4b2-360e12cb43cf None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:11.395052 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-f82a86be-ba0d-454d-a4b2-360e12cb43cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:11.461920 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 517/1033] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:11.485659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78a45f-ce76-4d6d-9971-5f65fe590fcf None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:11.586010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78a45f-ce76-4d6d-9971-5f65fe590fcf None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:11.619099 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8f46f-3182-4c38-9a87-5a500ec8413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:11.619858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f46f-3182-4c38-9a87-5a500ec8413e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:11.620145 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f46f-3182-4c38-9a87-5a500ec8413e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:11.620423 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8f46f-3182-4c38-9a87-5a500ec8413e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:11.631356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8f46f-3182-4c38-9a87-5a500ec8413e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-13a8f46f-3182-4c38-9a87-5a500ec8413e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:11.640357 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:11.641173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:17:11.641934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:11.643121 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 517/1034] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:17:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:11.647645 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a86be-ba0d-454d-a4b2-360e12cb43cf None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:11.743193 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a86be-ba0d-454d-a4b2-360e12cb43cf None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:11.777209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:11.778162 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:11.779748 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:11.780209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:11.781104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:11.781571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:11.783062 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:11.791560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 518/1035] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:17:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:11.797810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8f46f-3182-4c38-9a87-5a500ec8413e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:11.898662 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8f46f-3182-4c38-9a87-5a500ec8413e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:11.931575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:11.932393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:11.932673 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:11.932939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:11.942934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:11.944407 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:11.962088 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:11.962898 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:11.969763 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:11.969763 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:11.969763 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:11.969763 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:11.969763 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 518/1036] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:11.970023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:12.066853 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655a361-a79d-4afc-bcc8-377801867f4d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:12.098767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:12.099418 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:12.099696 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:12.099992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:12.100700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:12.101000 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:12.102346 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:12.114975 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 519/1037] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:12.120519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:12.216486 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a619a44-91c2-4879-9fa6-2e322034a564 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:12.253251 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:12.254040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:12.254320 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:12.254591 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] PATH_INFO: `/v3/users/nova` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:12.261926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:12.263929 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:17:12.277608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:12.278437 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:17:12.279297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:12.283795 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 519/1038] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:17:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:12.285164 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:12.381412 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aaa52-4d07-4b7f-b44a-49fb360b463e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:12.414349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:12.415011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:12.415287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:12.415555 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:12.416418 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:12.416722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:12.418136 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:12.436413 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 520/1039] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:17:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:12.441977 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:12.552456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614f5ea-e1c5-490b-afa9-7cd2a42eefcb None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:12.586921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796873fb-d25c-4a95-b116-96beed5718e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:12.587576 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796873fb-d25c-4a95-b116-96beed5718e1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:12.587888 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796873fb-d25c-4a95-b116-96beed5718e1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:12.588164 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796873fb-d25c-4a95-b116-96beed5718e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:12.656902 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796873fb-d25c-4a95-b116-96beed5718e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:12.658365 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796873fb-d25c-4a95-b116-96beed5718e1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:12.756249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 520/1040] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:12.764392 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:12.873045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20145-0188-4a9e-a4f6-e583582ef95d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:12.907477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d816-ef7d-4685-94f9-81df48c5436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:12.908344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d816-ef7d-4685-94f9-81df48c5436e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:12.908628 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d816-ef7d-4685-94f9-81df48c5436e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:12.908901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d816-ef7d-4685-94f9-81df48c5436e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:12.918909 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d816-ef7d-4685-94f9-81df48c5436e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:12.920706 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d816-ef7d-4685-94f9-81df48c5436e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-0769d816-ef7d-4685-94f9-81df48c5436e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:12.938739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:12.939537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:12.940679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:12.940679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:12.940679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:12.940679 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:12.944094 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 521/1041] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:12.946021 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796873fb-d25c-4a95-b116-96beed5718e1 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:12.963473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefdf2a-2775-445b-b79d-6bfa85c09b87 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:12.963788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefdf2a-2775-445b-b79d-6bfa85c09b87 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:12.964059 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefdf2a-2775-445b-b79d-6bfa85c09b87 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:12.965561 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 522/1042] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:17:12.971570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a4181-3524-4f2a-bc88-63872c834db1 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:12.972009 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a4181-3524-4f2a-bc88-63872c834db1 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:12.972372 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a4181-3524-4f2a-bc88-63872c834db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:12.990263 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-3b7a4181-3524-4f2a-bc88-63872c834db1 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:12.991447 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-3b7a4181-3524-4f2a-bc88-63872c834db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:13.049688 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796873fb-d25c-4a95-b116-96beed5718e1 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.057166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 523/1043] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:13.058569 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd970-7d22-4f34-80c5-680753dcc8ac None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.058767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd970-7d22-4f34-80c5-680753dcc8ac None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.059043 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd970-7d22-4f34-80c5-680753dcc8ac None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.060665 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 524/1044] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:13.065817 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443b70-6444-4b9b-b1c8-557e65acfb13 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.066113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443b70-6444-4b9b-b1c8-557e65acfb13 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.066392 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443b70-6444-4b9b-b1c8-557e65acfb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.084022 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-bb443b70-6444-4b9b-b1c8-557e65acfb13 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:13.085218 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-bb443b70-6444-4b9b-b1c8-557e65acfb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:13.086000 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.086661 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.086941 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.087215 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.088032 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:13.088337 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.089714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.102062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 521/1045] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:13.102929 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.152461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 525/1046] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:13.154935 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb443b70-6444-4b9b-b1c8-557e65acfb13 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.200921 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a4de9-6c73-4197-afef-aa1c6ba6a247 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.233243 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffb541-190b-47df-a0c3-2b7b26a0159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.234034 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffb541-190b-47df-a0c3-2b7b26a0159f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.234319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffb541-190b-47df-a0c3-2b7b26a0159f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.234599 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffb541-190b-47df-a0c3-2b7b26a0159f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.244420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffb541-190b-47df-a0c3-2b7b26a0159f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:13.251042 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb443b70-6444-4b9b-b1c8-557e65acfb13 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-a9ffb541-190b-47df-a0c3-2b7b26a0159f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:13.252729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:13.253602 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:13.254345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 522/1047] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:13.256043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffb541-190b-47df-a0c3-2b7b26a0159f None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.283893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.284674 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.284952 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.285222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.291572 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.293029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:17:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:13.307743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:13.308621 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 526/1048] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:13.309104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.354647 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffb541-190b-47df-a0c3-2b7b26a0159f None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.387188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.388140 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.388428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.388706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] PATH_INFO: `/v3/services/image` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.389362 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.390756 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:13.402020 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:13.402959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:13.403802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 523/1049] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:13.404978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.405391 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d237e91-5ea6-4c69-862d-9dcc5fb2b621 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.438954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.439608 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.439924 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.440203 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.440950 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:13.441258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.442623 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.451343 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 527/1050] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:13.452157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.506658 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77126ed2-cd41-4262-867a-37eca9dea9da None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.549824 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.550770 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.551047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.551870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:13.552180 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.553608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.557868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3899-eae6-4fe8-aa6c-079d2d6ee601 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.567270 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 524/1051] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:13.571458 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.593497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.594157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.594439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.594715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.595426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] RBAC: Adding query filter params (name=image) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:13.595731 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.597124 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.601806 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 528/1052] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:13.602570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.665071 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305da14-29dd-4ef4-96a4-79ba5f913211 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.697258 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58e9aa-0756-4229-937b-5cef7e79fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.697581 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab607f8f-7ddc-4133-bb88-d9746576f2ca None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.698113 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58e9aa-0756-4229-937b-5cef7e79fc97 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.698390 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58e9aa-0756-4229-937b-5cef7e79fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.698661 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58e9aa-0756-4229-937b-5cef7e79fc97 None admin] PATH_INFO: `/v3/users/a9d84915ac574f1da13c0252740d0f29` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.711746 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58e9aa-0756-4229-937b-5cef7e79fc97 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d84915ac574f1da13c0252740d0f29)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.713201 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58e9aa-0756-4229-937b-5cef7e79fc97 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.714862 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 525/1053] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/users/a9d84915ac574f1da13c0252740d0f29 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:13.715615 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58e9aa-0756-4229-937b-5cef7e79fc97 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.730513 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.731160 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.731442 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.731798 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.732625 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] RBAC: Adding query filter params (role.id=80470f642b064584a5365cba7ab413db, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=865e4a29d11c4000988326f5ce35b25b) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:13.732941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.734353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.739640 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 529/1054] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/role_assignments?user.id=865e4a29d11c4000988326f5ce35b25b&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=80470f642b064584a5365cba7ab413db => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:13.740435 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.818806 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58e9aa-0756-4229-937b-5cef7e79fc97 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.850189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c57ce2-a4dd-4332-ad5e-20e2e3d88f55 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:13.855537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.856260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.857052 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.857336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.858139 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] RBAC: Adding query filter params (type=image) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:13.858370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.859797 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.869793 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 526/1055] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:13.871222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:13.889677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c86abb-c020-43ea-b171-7cee11d612ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:13.890332 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86abb-c020-43ea-b171-7cee11d612ed None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:13.890620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86abb-c020-43ea-b171-7cee11d612ed None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:13.890899 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86abb-c020-43ea-b171-7cee11d612ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:13.961994 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c86abb-c020-43ea-b171-7cee11d612ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:13.963446 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c86abb-c020-43ea-b171-7cee11d612ed None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:13.979248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911fd80-45e6-4081-bb2a-84c39a4258fa None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:14.015121 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd9ea2-886c-4648-8c68-3f7a4a9c6d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:14.015814 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9ea2-886c-4648-8c68-3f7a4a9c6d33 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:14.016108 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9ea2-886c-4648-8c68-3f7a4a9c6d33 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:14.016384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9ea2-886c-4648-8c68-3f7a4a9c6d33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:14.017126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd9ea2-886c-4648-8c68-3f7a4a9c6d33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:14.018503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd9ea2-886c-4648-8c68-3f7a4a9c6d33 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:14.048224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 527/1056] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:17:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:17:14.067724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 530/1057] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:14.074089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd9ea2-886c-4648-8c68-3f7a4a9c6d33 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:14.188292 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd9ea2-886c-4648-8c68-3f7a4a9c6d33 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:14.224648 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af8564-d751-4817-8a6a-f30b7075eb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:14.225436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8564-d751-4817-8a6a-f30b7075eb10 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:14.225719 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8564-d751-4817-8a6a-f30b7075eb10 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:14.225996 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8564-d751-4817-8a6a-f30b7075eb10 None admin] PATH_INFO: `/v3/projects/c79ef28140d24c9a86f7ad63edbe847b` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:14.227221 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af8564-d751-4817-8a6a-f30b7075eb10 None admin] RBAC: Authorizing `identity:get_project(project_id=c79ef28140d24c9a86f7ad63edbe847b)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:14.228693 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af8564-d751-4817-8a6a-f30b7075eb10 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:14.230418 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 528/1058] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:14 2022] GET /identity/v3/projects/c79ef28140d24c9a86f7ad63edbe847b => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:14.236864 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c86abb-c020-43ea-b171-7cee11d612ed None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:14.338780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c86abb-c020-43ea-b171-7cee11d612ed None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:14.371347 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73855b-6ec8-4280-85ef-90cd4933925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:14.372031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73855b-6ec8-4280-85ef-90cd4933925f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:14.372876 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73855b-6ec8-4280-85ef-90cd4933925f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:14.373158 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73855b-6ec8-4280-85ef-90cd4933925f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:14.373996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73855b-6ec8-4280-85ef-90cd4933925f None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=c79ef28140d24c9a86f7ad63edbe847b, user.id=a9d84915ac574f1da13c0252740d0f29) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:14.374309 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73855b-6ec8-4280-85ef-90cd4933925f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:14.375732 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73855b-6ec8-4280-85ef-90cd4933925f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:14.381399 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 531/1059] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:14 2022] GET /identity/v3/role_assignments?user.id=a9d84915ac574f1da13c0252740d0f29&scope.project.id=c79ef28140d24c9a86f7ad63edbe847b&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:15.988931 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8d55e-5e59-4d36-9613-2b336e1ed956 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:15.989481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8d55e-5e59-4d36-9613-2b336e1ed956 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:15.989481 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8d55e-5e59-4d36-9613-2b336e1ed956 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:15.990996 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 529/1060] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:15.996066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427230d1-0f24-47f6-b580-e04204bac4e1 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:15.996447 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427230d1-0f24-47f6-b580-e04204bac4e1 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:15.996630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427230d1-0f24-47f6-b580-e04204bac4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.014811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-427230d1-0f24-47f6-b580-e04204bac4e1 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:16.016022 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-427230d1-0f24-47f6-b580-e04204bac4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:16.082085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 532/1061] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:16.104572 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8d55e-5e59-4d36-9613-2b336e1ed956 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:16.214372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8d55e-5e59-4d36-9613-2b336e1ed956 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:16.248802 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155176c-c574-4151-9185-89566fb9b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:16.249538 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155176c-c574-4151-9185-89566fb9b918 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.249821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155176c-c574-4151-9185-89566fb9b918 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.250153 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155176c-c574-4151-9185-89566fb9b918 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.260829 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155176c-c574-4151-9185-89566fb9b918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-e155176c-c574-4151-9185-89566fb9b918 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:16.269605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:16.270499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:17:16.271287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:16.272638 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 530/1062] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:16.277036 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427230d1-0f24-47f6-b580-e04204bac4e1 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:16.339470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9867-fc7b-4597-a3a1-9e63343269be None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.339811 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9867-fc7b-4597-a3a1-9e63343269be None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.340057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc9867-fc7b-4597-a3a1-9e63343269be None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.342233 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 531/1063] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:17:16.347339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5df8-d114-4ed2-a6bf-5a2cc3ae275e None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.347622 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5df8-d114-4ed2-a6bf-5a2cc3ae275e None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.347931 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5df8-d114-4ed2-a6bf-5a2cc3ae275e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.364151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-85dc5df8-d114-4ed2-a6bf-5a2cc3ae275e None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:16.365319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-85dc5df8-d114-4ed2-a6bf-5a2cc3ae275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:16.378461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427230d1-0f24-47f6-b580-e04204bac4e1 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:16.413242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:16.413910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.414192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.414602 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.415213 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:16.415523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:16.416923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:16.430579 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 533/1064] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:16.431895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 532/1065] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:16.432003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:16.454403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5df8-d114-4ed2-a6bf-5a2cc3ae275e None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:16.536371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c9eab-5f76-4c58-9185-8f6814e51dca None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:16.553148 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5df8-d114-4ed2-a6bf-5a2cc3ae275e None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:16.572785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:16.573576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.573857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.574131 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.585348 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:16.586810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:16.590319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2649e-ea15-48a8-a57b-a7e35816b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:16.591542 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2649e-ea15-48a8-a57b-a7e35816b426 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.591951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2649e-ea15-48a8-a57b-a7e35816b426 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.592356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2649e-ea15-48a8-a57b-a7e35816b426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:16.605014 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:16.605863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:16.606768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:16.606768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:16.606768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:16.606768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:16.606768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 534/1066] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:16.612325 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:16.660901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2649e-ea15-48a8-a57b-a7e35816b426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:16.662351 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2649e-ea15-48a8-a57b-a7e35816b426 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:16.708229 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559c470-c33c-4ddc-b80c-0f4feec01d65 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:16.740575 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c1bcc-f05a-4a55-8925-9e75e5bcd535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:16.741219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c1bcc-f05a-4a55-8925-9e75e5bcd535 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.741498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c1bcc-f05a-4a55-8925-9e75e5bcd535 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.741770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c1bcc-f05a-4a55-8925-9e75e5bcd535 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.742480 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c1bcc-f05a-4a55-8925-9e75e5bcd535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:16.742780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c1bcc-f05a-4a55-8925-9e75e5bcd535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:16.744166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c1bcc-f05a-4a55-8925-9e75e5bcd535 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:16.755500 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 535/1067] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:16.757824 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15d96-579d-44a5-b3cb-a4cda3536c0b None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.758095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15d96-579d-44a5-b3cb-a4cda3536c0b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.758211 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 533/1068] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:16.763106 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15d96-579d-44a5-b3cb-a4cda3536c0b None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.763106 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 536/1069] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:16.763307 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2649e-ea15-48a8-a57b-a7e35816b426 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:16.763956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15d96-579d-44a5-b3cb-a4cda3536c0b None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:16.855266 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2649e-ea15-48a8-a57b-a7e35816b426 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:16.862413 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15d96-579d-44a5-b3cb-a4cda3536c0b None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:16.889628 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f098e6-4303-45ab-b334-1c150acc862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:16.890426 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f098e6-4303-45ab-b334-1c150acc862e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.890705 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f098e6-4303-45ab-b334-1c150acc862e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.890975 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f098e6-4303-45ab-b334-1c150acc862e None admin] PATH_INFO: `/v3/users/nova` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.895962 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:16.896741 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.897031 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.897310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.898130 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f098e6-4303-45ab-b334-1c150acc862e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:16.899580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f098e6-4303-45ab-b334-1c150acc862e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:16.907956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:16.909388 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-32f098e6-4303-45ab-b334-1c150acc862e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:17:16.914428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:16.915461 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:16.916429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 534/1070] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:16.918448 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280843-52ea-47a5-bef8-d600f86fcd05 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:16.918738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280843-52ea-47a5-bef8-d600f86fcd05 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:16.919018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab280843-52ea-47a5-bef8-d600f86fcd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:16.927523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:16.928383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:16.929185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:16.929185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:16.929185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:16.929185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:16.929185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 537/1071] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:16.929920 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:16.934450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ab280843-52ea-47a5-bef8-d600f86fcd05 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:16.935651 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ab280843-52ea-47a5-bef8-d600f86fcd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:16.998905 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 535/1072] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:16.999740 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab280843-52ea-47a5-bef8-d600f86fcd05 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.030344 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44098e-1946-40ba-83b0-52d5fd960372 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.063469 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.064157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.064440 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.064714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.065546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:17.065851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.067263 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.084774 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 538/1073] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:17.085567 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.098794 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab280843-52ea-47a5-bef8-d600f86fcd05 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.132140 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.132757 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.133029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.133305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.134027 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:17.134336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.135716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.148104 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 536/1074] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:17.148912 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.190479 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fed591-07f0-4910-a3ce-4466819936e8 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.227208 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b9ad-02b1-4148-8ae3-51582577258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.227811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b9ad-02b1-4148-8ae3-51582577258d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.228102 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b9ad-02b1-4148-8ae3-51582577258d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.228379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b9ad-02b1-4148-8ae3-51582577258d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.240691 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0b9ad-02b1-4148-8ae3-51582577258d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-2da0b9ad-02b1-4148-8ae3-51582577258d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:17.248574 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:17.250050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:17.256145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 539/1075] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:17.256818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b9ad-02b1-4148-8ae3-51582577258d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.270938 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc218c-a544-488f-a6e3-78b1e6d28855 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.310047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.311506 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.311816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.312099 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.322870 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.324400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:17.345100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:17.346089 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:17.346920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:17.346920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:17.346920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:17.346920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:17.351854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 537/1076] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:17.352738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.365708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b9ad-02b1-4148-8ae3-51582577258d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.404636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.405237 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.405521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.405799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.406561 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:17.406869 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.408297 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.417001 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 540/1077] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:17.423501 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.470015 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7149ad-4835-4257-b8ef-c3d34435073e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.505636 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.506305 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.506589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.506867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.507597 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:17.507941 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.509318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.520856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 538/1078] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:17.526319 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.527883 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d2ff0-6abd-4498-9f1e-2ee6c2d612a2 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.566368 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b292-aae2-4bc2-bf90-07ca794ab657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.567240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b292-aae2-4bc2-bf90-07ca794ab657 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.567521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b292-aae2-4bc2-bf90-07ca794ab657 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.568210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999b292-aae2-4bc2-bf90-07ca794ab657 None admin] PATH_INFO: `/v3/users/a9d84915ac574f1da13c0252740d0f29` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.569436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999b292-aae2-4bc2-bf90-07ca794ab657 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d84915ac574f1da13c0252740d0f29)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.571136 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999b292-aae2-4bc2-bf90-07ca794ab657 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.577383 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 541/1079] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:17 2022] GET /identity/v3/users/a9d84915ac574f1da13c0252740d0f29 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:17.578412 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b292-aae2-4bc2-bf90-07ca794ab657 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.627483 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896347f-0fb2-433b-8dbb-83347c0e1d0a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.659864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.660585 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.660866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.661135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.667614 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.669579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.679087 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999b292-aae2-4bc2-bf90-07ca794ab657 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:17:17.683370 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:17.684249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:17.685115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 539/1080] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:17.690338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.712110 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59c78a-9249-4b37-87ac-5c35010cf6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.712982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59c78a-9249-4b37-87ac-5c35010cf6ca None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.713259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59c78a-9249-4b37-87ac-5c35010cf6ca None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.713529 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59c78a-9249-4b37-87ac-5c35010cf6ca None admin] PATH_INFO: `/v3/projects/c79ef28140d24c9a86f7ad63edbe847b` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.714689 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59c78a-9249-4b37-87ac-5c35010cf6ca None admin] RBAC: Authorizing `identity:get_project(project_id=c79ef28140d24c9a86f7ad63edbe847b)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.716752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59c78a-9249-4b37-87ac-5c35010cf6ca None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.718440 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 542/1081] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:17 2022] GET /identity/v3/projects/c79ef28140d24c9a86f7ad63edbe847b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:17.724224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59c78a-9249-4b37-87ac-5c35010cf6ca None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.786052 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b4eb6-1d2c-4de1-91d8-9f4c99347904 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.818045 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59c78a-9249-4b37-87ac-5c35010cf6ca None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.818243 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.818789 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.819074 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.819356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.820181 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:17.820747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.822172 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.834005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 540/1082] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:17.839639 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:17.851115 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978176c4-9ec3-43aa-a3cf-a8314d808fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.852056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978176c4-9ec3-43aa-a3cf-a8314d808fdf None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.852336 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978176c4-9ec3-43aa-a3cf-a8314d808fdf None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.852610 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978176c4-9ec3-43aa-a3cf-a8314d808fdf None admin] PATH_INFO: `/v3/projects/c79ef28140d24c9a86f7ad63edbe847b/users/a9d84915ac574f1da13c0252740d0f29/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.854566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978176c4-9ec3-43aa-a3cf-a8314d808fdf None admin] RBAC: Authorizing `identity:create_grant(project_id=c79ef28140d24c9a86f7ad63edbe847b, user_id=a9d84915ac574f1da13c0252740d0f29, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.856026 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978176c4-9ec3-43aa-a3cf-a8314d808fdf None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.868854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 543/1083] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:17:17 2022] PUT /identity/v3/projects/c79ef28140d24c9a86f7ad63edbe847b/users/a9d84915ac574f1da13c0252740d0f29/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:17:17.942723 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5968a8-eb37-4b50-a077-5558625d6a7e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:17.978670 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dbb49-c67b-429a-9109-9d13d9074f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:17.979581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbb49-c67b-429a-9109-9d13d9074f3f None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:17.979893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbb49-c67b-429a-9109-9d13d9074f3f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:17.980182 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbb49-c67b-429a-9109-9d13d9074f3f None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/865e4a29d11c4000988326f5ce35b25b/roles/80470f642b064584a5365cba7ab413db` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:17.982545 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dbb49-c67b-429a-9109-9d13d9074f3f None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=865e4a29d11c4000988326f5ce35b25b, role_id=80470f642b064584a5365cba7ab413db)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:17.984077 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dbb49-c67b-429a-9109-9d13d9074f3f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:17.998232 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 541/1084] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:17:17 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/865e4a29d11c4000988326f5ce35b25b/roles/80470f642b064584a5365cba7ab413db => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:17:20.114674 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e709-9026-4bd5-8252-28c75e3a5185 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.115304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e709-9026-4bd5-8252-28c75e3a5185 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.115304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e709-9026-4bd5-8252-28c75e3a5185 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.116631 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 544/1085] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:20.121875 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f7ec-1b96-4ede-86d2-e69e56c718d1 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.122896 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f7ec-1b96-4ede-86d2-e69e56c718d1 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.123179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f7ec-1b96-4ede-86d2-e69e56c718d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.140249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-9cc9f7ec-1b96-4ede-86d2-e69e56c718d1 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:20.141505 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-9cc9f7ec-1b96-4ede-86d2-e69e56c718d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:20.205642 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 542/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:20.229159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7e709-9026-4bd5-8252-28c75e3a5185 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:20.279387 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad3bc-028a-4dc1-b2b6-110e8e9ee970 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.279679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad3bc-028a-4dc1-b2b6-110e8e9ee970 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.280143 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad3bc-028a-4dc1-b2b6-110e8e9ee970 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.281522 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 543/1087] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:17:20.286603 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7d2a4-f996-49c4-82a2-233034ebc68b None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.286889 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7d2a4-f996-49c4-82a2-233034ebc68b None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.287167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7d2a4-f996-49c4-82a2-233034ebc68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.303380 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-89e7d2a4-f996-49c4-82a2-233034ebc68b None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:20.304600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-89e7d2a4-f996-49c4-82a2-233034ebc68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:20.328638 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7e709-9026-4bd5-8252-28c75e3a5185 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:20.361051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bfd64-9224-44a0-b74b-ed2889bcef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:20.361820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bfd64-9224-44a0-b74b-ed2889bcef1b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.362095 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bfd64-9224-44a0-b74b-ed2889bcef1b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.362360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bfd64-9224-44a0-b74b-ed2889bcef1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.368872 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 544/1088] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:20.372137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bfd64-9224-44a0-b74b-ed2889bcef1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-073bfd64-9224-44a0-b74b-ed2889bcef1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:20.379801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:20.380868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:20.381724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 545/1089] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:20.386817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7d2a4-f996-49c4-82a2-233034ebc68b None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:20.392524 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bfd64-9224-44a0-b74b-ed2889bcef1b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:20.479579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7d2a4-f996-49c4-82a2-233034ebc68b None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:20.488688 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bfd64-9224-44a0-b74b-ed2889bcef1b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:20.511545 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:20.512231 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.512541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.512810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.513550 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:20.513854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:20.515216 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:20.520805 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053f73c-87fb-4bd5-9aae-e75569ad2657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:20.521607 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053f73c-87fb-4bd5-9aae-e75569ad2657 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.521890 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053f73c-87fb-4bd5-9aae-e75569ad2657 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.522165 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053f73c-87fb-4bd5-9aae-e75569ad2657 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.527901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 545/1090] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:20.529327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:20.532993 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053f73c-87fb-4bd5-9aae-e75569ad2657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-8053f73c-87fb-4bd5-9aae-e75569ad2657 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:20.541143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:20.542151 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:20.542930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 546/1091] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:20.548877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053f73c-87fb-4bd5-9aae-e75569ad2657 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:20.626629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df459a2f-69e0-4f76-a6f6-a432f768e566 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:20.647279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053f73c-87fb-4bd5-9aae-e75569ad2657 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:20.660063 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf0ac-31e0-46cf-ad68-07cacad78d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:20.660934 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf0ac-31e0-46cf-ad68-07cacad78d59 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.661211 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf0ac-31e0-46cf-ad68-07cacad78d59 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.661479 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf0ac-31e0-46cf-ad68-07cacad78d59 None admin] PATH_INFO: `/v3/users/a9d84915ac574f1da13c0252740d0f29` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.662677 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdf0ac-31e0-46cf-ad68-07cacad78d59 None admin] RBAC: Authorizing `identity:get_user(user_id=a9d84915ac574f1da13c0252740d0f29)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:20.664146 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdf0ac-31e0-46cf-ad68-07cacad78d59 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:20.665767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 546/1092] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/users/a9d84915ac574f1da13c0252740d0f29 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:20.671659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf0ac-31e0-46cf-ad68-07cacad78d59 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:20.679688 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:20.680369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.680649 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.680920 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.681669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:20.681979 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:20.683339 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:20.691293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 547/1093] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:20.697234 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:20.767707 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf0ac-31e0-46cf-ad68-07cacad78d59 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:20.792730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8cc97-35f9-4f84-a8c9-da5c8b2a1728 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:20.803608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebcf5b-d139-442b-bd11-c33e58851655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:20.804282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebcf5b-d139-442b-bd11-c33e58851655 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.804563 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebcf5b-d139-442b-bd11-c33e58851655 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.804835 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebcf5b-d139-442b-bd11-c33e58851655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.827189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:20.827987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:20.828268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:20.828540 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:20.838622 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:20.840109 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:20.857069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:20.857930 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:20.859063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:20.859063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:20.859063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:20.859063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:20.859063 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 548/1094] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:20.863874 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:20.869512 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebcf5b-d139-442b-bd11-c33e58851655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:20.870971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebcf5b-d139-442b-bd11-c33e58851655 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:20.970972 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 547/1095] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:17:20.975925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9b204-9af2-4aff-9975-fcbf08e0024b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:20.976741 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebcf5b-d139-442b-bd11-c33e58851655 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:21.008335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:21.009100 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:21.009384 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:21.009715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:21.010434 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:21.010766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:21.012160 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:21.024317 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 549/1096] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:21.029690 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:21.069684 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebcf5b-d139-442b-bd11-c33e58851655 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:21.103359 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8488082-4d97-4998-bcb8-734db7fc5a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:21.104254 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8488082-4d97-4998-bcb8-734db7fc5a36 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:21.104530 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8488082-4d97-4998-bcb8-734db7fc5a36 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:21.104801 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8488082-4d97-4998-bcb8-734db7fc5a36 None admin] PATH_INFO: `/v3/projects/c79ef28140d24c9a86f7ad63edbe847b` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:21.105984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8488082-4d97-4998-bcb8-734db7fc5a36 None admin] RBAC: Authorizing `identity:get_project(project_id=c79ef28140d24c9a86f7ad63edbe847b)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:21.107440 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8488082-4d97-4998-bcb8-734db7fc5a36 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:21.109183 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 548/1097] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:20 2022] GET /identity/v3/projects/c79ef28140d24c9a86f7ad63edbe847b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:21.115124 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8488082-4d97-4998-bcb8-734db7fc5a36 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:21.124901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b67d8-3a71-4762-be7a-78cb62d27329 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:21.158471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:21.159244 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:21.159520 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:21.159804 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] PATH_INFO: `/v3/users/nova` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:21.166610 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:21.168083 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:17:21.182712 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:21.183682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:21.184759 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 550/1098] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:17:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:21.189584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:21.211782 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8488082-4d97-4998-bcb8-734db7fc5a36 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:21.245978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:21.246556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:21.246844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:21.247310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:21.248117 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=c79ef28140d24c9a86f7ad63edbe847b, user.id=a9d84915ac574f1da13c0252740d0f29) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:21.248429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:21.249882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:21.255645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 549/1099] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:21 2022] GET /identity/v3/role_assignments?user.id=a9d84915ac574f1da13c0252740d0f29&scope.project.id=c79ef28140d24c9a86f7ad63edbe847b&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:21.293089 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12524de6-953d-452d-8e51-0da3f3a5f90b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:21.330660 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:21.331335 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:21.331615 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:21.331919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:21.332770 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:21.333078 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:21.334559 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:21.353373 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 551/1100] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:17:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:21.360037 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:21.460240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33527-6ff3-43c8-bb6e-038ad37e2b9b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:21.493623 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de65c91-f550-421e-a1e4-6b220f40afce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:21.494279 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65c91-f550-421e-a1e4-6b220f40afce None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:21.494566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65c91-f550-421e-a1e4-6b220f40afce None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:21.494845 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65c91-f550-421e-a1e4-6b220f40afce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:21.560614 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de65c91-f550-421e-a1e4-6b220f40afce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:21.561958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de65c91-f550-421e-a1e4-6b220f40afce None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:21.656856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 550/1101] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:21.662931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:21.759143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6a9f-585e-41f1-9728-2ca4b7d681aa None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:21.791980 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:21.792756 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:21.793037 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:21.793310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:21.803850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:21.805308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:21.822577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:21.823596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:21.829478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:17:21.829478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:21.829478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:17:21.829478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:21.829478 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 552/1102] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:21.830359 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de65c91-f550-421e-a1e4-6b220f40afce None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:21.924833 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de65c91-f550-421e-a1e4-6b220f40afce None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:21.957893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:21.958552 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:21.958837 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:21.959113 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:21.959867 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:21.960175 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:21.961543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:21.973248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 551/1103] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:21.978766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:22.077240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c570c-f820-4ac0-ba23-ac422b1c8d5f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:22.111300 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:22.112116 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:22.112397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:22.112669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:22.119214 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:22.120676 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:17:22.134123 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:22.135449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:22.136557 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 553/1104] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:17:22.141920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:22.236980 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d273-1013-4dcf-b56f-705a03a763d7 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:22.268596 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b087473-8942-43ad-812c-bd0979ee8b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:22.269244 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b087473-8942-43ad-812c-bd0979ee8b09 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:22.269529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b087473-8942-43ad-812c-bd0979ee8b09 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:22.269805 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b087473-8942-43ad-812c-bd0979ee8b09 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:22.270584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b087473-8942-43ad-812c-bd0979ee8b09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:22.270893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b087473-8942-43ad-812c-bd0979ee8b09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:22.272367 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b087473-8942-43ad-812c-bd0979ee8b09 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:22.284618 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 552/1105] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:22.290567 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:22.386113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfdb1c-f3bb-4ebf-93ef-576833dd25ad None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:22.420753 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddb932-84b9-430a-a5e3-ce8128630d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:22.421396 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb932-84b9-430a-a5e3-ce8128630d75 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:22.421677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb932-84b9-430a-a5e3-ce8128630d75 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:22.421949 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddb932-84b9-430a-a5e3-ce8128630d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:22.422780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddb932-84b9-430a-a5e3-ce8128630d75 None admin] RBAC: Adding query filter params (role.id=80470f642b064584a5365cba7ab413db, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=865e4a29d11c4000988326f5ce35b25b) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:22.423088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddb932-84b9-430a-a5e3-ce8128630d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:22.424563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddb932-84b9-430a-a5e3-ce8128630d75 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:22.430282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 554/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:22 2022] GET /identity/v3/role_assignments?user.id=865e4a29d11c4000988326f5ce35b25b&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=80470f642b064584a5365cba7ab413db => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:23.533601 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3c7d-cb55-4411-93cc-4bbef6d8c388 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:23.534135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3c7d-cb55-4411-93cc-4bbef6d8c388 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:23.534135 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e3c7d-cb55-4411-93cc-4bbef6d8c388 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:23.535500 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 553/1107] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:23.540752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2679-dc13-4fc1-b0ea-1ba1b7dc81d7 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:23.541144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2679-dc13-4fc1-b0ea-1ba1b7dc81d7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:23.541298 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d2679-dc13-4fc1-b0ea-1ba1b7dc81d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:23.557672 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-f74d2679-dc13-4fc1-b0ea-1ba1b7dc81d7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:23.558831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-f74d2679-dc13-4fc1-b0ea-1ba1b7dc81d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:23.631065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 555/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:23.657024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e3c7d-cb55-4411-93cc-4bbef6d8c388 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:23.754361 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e3c7d-cb55-4411-93cc-4bbef6d8c388 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:23.787072 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929565-0f02-48f8-9194-c83efdf6abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:23.787927 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929565-0f02-48f8-9194-c83efdf6abdb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:23.788114 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929565-0f02-48f8-9194-c83efdf6abdb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:23.788390 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929565-0f02-48f8-9194-c83efdf6abdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:23.789582 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01929565-0f02-48f8-9194-c83efdf6abdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:23.791002 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01929565-0f02-48f8-9194-c83efdf6abdb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:23.792637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 554/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:23.798799 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d2679-dc13-4fc1-b0ea-1ba1b7dc81d7 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:23.892825 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d2679-dc13-4fc1-b0ea-1ba1b7dc81d7 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:23.925069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c460e4-f04b-4973-ba87-685748c87673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:23.925717 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c460e4-f04b-4973-ba87-685748c87673 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:23.926002 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c460e4-f04b-4973-ba87-685748c87673 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:23.926276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c460e4-f04b-4973-ba87-685748c87673 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:23.926983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c460e4-f04b-4973-ba87-685748c87673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:23.928439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c460e4-f04b-4973-ba87-685748c87673 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:23.947255 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 556/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:17:23 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:17:26.202347 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be269c-7a94-47fe-a1cd-20d8447201fa None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:26.202871 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be269c-7a94-47fe-a1cd-20d8447201fa None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:26.202871 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be269c-7a94-47fe-a1cd-20d8447201fa None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:26.204295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 555/1111] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:26.209452 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e7ca-6454-4349-bd38-5f7787f7e663 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:26.209875 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e7ca-6454-4349-bd38-5f7787f7e663 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:26.210009 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05e7ca-6454-4349-bd38-5f7787f7e663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:26.226454 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-be05e7ca-6454-4349-bd38-5f7787f7e663 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:26.227633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-be05e7ca-6454-4349-bd38-5f7787f7e663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:26.291630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 557/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:26.315871 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be269c-7a94-47fe-a1cd-20d8447201fa None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:26.411269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be269c-7a94-47fe-a1cd-20d8447201fa None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:26.442866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8af20-0749-4ca0-90b3-1eb4df0e8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:26.443705 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8af20-0749-4ca0-90b3-1eb4df0e8d6b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:26.444014 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8af20-0749-4ca0-90b3-1eb4df0e8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:26.444291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8af20-0749-4ca0-90b3-1eb4df0e8d6b None admin] PATH_INFO: `/v3/roles/db0e2f86b328428ba0dbfe6383deffce` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:26.446011 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8af20-0749-4ca0-90b3-1eb4df0e8d6b None admin] RBAC: Authorizing `identity:get_role(role_id=db0e2f86b328428ba0dbfe6383deffce)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:26.447373 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8af20-0749-4ca0-90b3-1eb4df0e8d6b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:26.448763 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 556/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:26 2022] GET /identity/v3/roles/db0e2f86b328428ba0dbfe6383deffce => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:26.455286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05e7ca-6454-4349-bd38-5f7787f7e663 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:26.547727 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05e7ca-6454-4349-bd38-5f7787f7e663 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:26.581017 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93472b44-b783-42b1-a894-0aa3d7bd103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:26.581872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472b44-b783-42b1-a894-0aa3d7bd103c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:26.582152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472b44-b783-42b1-a894-0aa3d7bd103c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:26.582425 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472b44-b783-42b1-a894-0aa3d7bd103c None admin] PATH_INFO: `/v3/users/518baff66bb9442bb29749321dc237f7` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:26.595962 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93472b44-b783-42b1-a894-0aa3d7bd103c None admin] RBAC: Authorizing `identity:get_user(user_id=518baff66bb9442bb29749321dc237f7)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:26.597380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93472b44-b783-42b1-a894-0aa3d7bd103c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:26.599023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 558/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:26 2022] GET /identity/v3/users/518baff66bb9442bb29749321dc237f7 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:26.604756 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8af20-0749-4ca0-90b3-1eb4df0e8d6b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:26.699456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8af20-0749-4ca0-90b3-1eb4df0e8d6b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:26.730829 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5831be2-4536-4622-9e6a-8a620d354bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:26.732151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831be2-4536-4622-9e6a-8a620d354bc2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:26.732428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831be2-4536-4622-9e6a-8a620d354bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:26.732703 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5831be2-4536-4622-9e6a-8a620d354bc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:26.795844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5831be2-4536-4622-9e6a-8a620d354bc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:26.797281 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5831be2-4536-4622-9e6a-8a620d354bc2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:26.889112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 557/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:26.894953 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93472b44-b783-42b1-a894-0aa3d7bd103c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:26.987302 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93472b44-b783-42b1-a894-0aa3d7bd103c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:27.019052 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a6ae-3a6a-4f7a-b748-2e3b091f3fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:27.019896 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a6ae-3a6a-4f7a-b748-2e3b091f3fe5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:27.020176 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a6ae-3a6a-4f7a-b748-2e3b091f3fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:27.020443 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a6ae-3a6a-4f7a-b748-2e3b091f3fe5 None admin] PATH_INFO: `/v3/projects/c79ef28140d24c9a86f7ad63edbe847b` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:27.021594 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1a6ae-3a6a-4f7a-b748-2e3b091f3fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=c79ef28140d24c9a86f7ad63edbe847b)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:27.022995 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1a6ae-3a6a-4f7a-b748-2e3b091f3fe5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:27.024683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 559/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:26 2022] GET /identity/v3/projects/c79ef28140d24c9a86f7ad63edbe847b => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:27.031191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5831be2-4536-4622-9e6a-8a620d354bc2 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:27.124799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5831be2-4536-4622-9e6a-8a620d354bc2 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:27.157964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c711595-0834-44b5-beb6-993e990468f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:27.158612 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711595-0834-44b5-beb6-993e990468f9 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:27.158895 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711595-0834-44b5-beb6-993e990468f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:27.159171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c711595-0834-44b5-beb6-993e990468f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:27.160026 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c711595-0834-44b5-beb6-993e990468f9 None admin] RBAC: Adding query filter params (role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=c79ef28140d24c9a86f7ad63edbe847b, user.id=518baff66bb9442bb29749321dc237f7) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:27.160337 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c711595-0834-44b5-beb6-993e990468f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:27.161767 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c711595-0834-44b5-beb6-993e990468f9 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:27.166967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 558/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:27 2022] GET /identity/v3/role_assignments?user.id=518baff66bb9442bb29749321dc237f7&scope.project.id=c79ef28140d24c9a86f7ad63edbe847b&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:29.375144 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9ec4-3477-4757-a62d-ade81f8f4ee3 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:29.375701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9ec4-3477-4757-a62d-ade81f8f4ee3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:29.375701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f9ec4-3477-4757-a62d-ade81f8f4ee3 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:29.377088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 560/1118] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:29.382409 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe258-2d05-4816-abf6-ba3fd6a8abef None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:29.382799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe258-2d05-4816-abf6-ba3fd6a8abef None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:29.382969 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe258-2d05-4816-abf6-ba3fd6a8abef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:29.399099 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-93ebe258-2d05-4816-abf6-ba3fd6a8abef None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:29.400324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-93ebe258-2d05-4816-abf6-ba3fd6a8abef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:29.462629 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 559/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:29.486033 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9ec4-3477-4757-a62d-ade81f8f4ee3 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:29.584329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f9ec4-3477-4757-a62d-ade81f8f4ee3 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:29.624831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dc990-bea0-42cb-80fe-fdd0cc0a0f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:29.625720 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dc990-bea0-42cb-80fe-fdd0cc0a0f55 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:29.625955 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dc990-bea0-42cb-80fe-fdd0cc0a0f55 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:29.626228 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dc990-bea0-42cb-80fe-fdd0cc0a0f55 None admin] PATH_INFO: `/v3/roles/db0e2f86b328428ba0dbfe6383deffce` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:29.627722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dc990-bea0-42cb-80fe-fdd0cc0a0f55 None admin] RBAC: Authorizing `identity:get_role(role_id=db0e2f86b328428ba0dbfe6383deffce)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:29.629128 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dc990-bea0-42cb-80fe-fdd0cc0a0f55 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:29.630510 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 561/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:29 2022] GET /identity/v3/roles/db0e2f86b328428ba0dbfe6383deffce => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:29.636733 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebe258-2d05-4816-abf6-ba3fd6a8abef None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:29.741874 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebe258-2d05-4816-abf6-ba3fd6a8abef None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:29.776559 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aaf62e-55ec-4818-8ec2-bb476f175fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:29.777440 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaf62e-55ec-4818-8ec2-bb476f175fde None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:29.777726 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaf62e-55ec-4818-8ec2-bb476f175fde None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:29.778901 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaf62e-55ec-4818-8ec2-bb476f175fde None admin] PATH_INFO: `/v3/users/518baff66bb9442bb29749321dc237f7` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:29.779842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aaf62e-55ec-4818-8ec2-bb476f175fde None admin] RBAC: Authorizing `identity:get_user(user_id=518baff66bb9442bb29749321dc237f7)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:29.781318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aaf62e-55ec-4818-8ec2-bb476f175fde None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:29.782967 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 560/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:29 2022] GET /identity/v3/users/518baff66bb9442bb29749321dc237f7 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:29.788766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dc990-bea0-42cb-80fe-fdd0cc0a0f55 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:29.888286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dc990-bea0-42cb-80fe-fdd0cc0a0f55 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:29.920687 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f461e-c965-4ff7-8649-af1e6491bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:29.921523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f461e-c965-4ff7-8649-af1e6491bf85 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:29.921806 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f461e-c965-4ff7-8649-af1e6491bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:29.922080 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f461e-c965-4ff7-8649-af1e6491bf85 None admin] PATH_INFO: `/v3/projects/c79ef28140d24c9a86f7ad63edbe847b` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:29.923247 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f461e-c965-4ff7-8649-af1e6491bf85 None admin] RBAC: Authorizing `identity:get_project(project_id=c79ef28140d24c9a86f7ad63edbe847b)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:29.924747 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f461e-c965-4ff7-8649-af1e6491bf85 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:29.926444 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 562/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:29 2022] GET /identity/v3/projects/c79ef28140d24c9a86f7ad63edbe847b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:29.932354 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aaf62e-55ec-4818-8ec2-bb476f175fde None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:30.027310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aaf62e-55ec-4818-8ec2-bb476f175fde None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:30.060910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5e164-e6b5-46ad-9cf0-a91c98f820d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:30.061780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5e164-e6b5-46ad-9cf0-a91c98f820d4 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:30.062064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5e164-e6b5-46ad-9cf0-a91c98f820d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:30.062340 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5e164-e6b5-46ad-9cf0-a91c98f820d4 None admin] PATH_INFO: `/v3/projects/c79ef28140d24c9a86f7ad63edbe847b/users/518baff66bb9442bb29749321dc237f7/roles/db0e2f86b328428ba0dbfe6383deffce` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:30.064568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5e164-e6b5-46ad-9cf0-a91c98f820d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c79ef28140d24c9a86f7ad63edbe847b, user_id=518baff66bb9442bb29749321dc237f7, role_id=db0e2f86b328428ba0dbfe6383deffce)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:30.066005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5e164-e6b5-46ad-9cf0-a91c98f820d4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:30.080199 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 561/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:17:29 2022] PUT /identity/v3/projects/c79ef28140d24c9a86f7ad63edbe847b/users/518baff66bb9442bb29749321dc237f7/roles/db0e2f86b328428ba0dbfe6383deffce => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:17:32.282191 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7587bf-215d-47e9-8d8b-12254cef32e5 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:32.282746 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7587bf-215d-47e9-8d8b-12254cef32e5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:32.282746 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7587bf-215d-47e9-8d8b-12254cef32e5 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:32.284154 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 563/1124] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:32.289304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0dc4-fa48-4cb7-a7c2-9243b8bb6597 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:32.289716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0dc4-fa48-4cb7-a7c2-9243b8bb6597 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:32.289864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0dc4-fa48-4cb7-a7c2-9243b8bb6597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:32.306618 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-374e0dc4-fa48-4cb7-a7c2-9243b8bb6597 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:32.307810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-374e0dc4-fa48-4cb7-a7c2-9243b8bb6597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:32.372819 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 562/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:32.396572 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7587bf-215d-47e9-8d8b-12254cef32e5 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:32.494003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7587bf-215d-47e9-8d8b-12254cef32e5 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:32.526584 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084724a1-1cfc-4eff-b870-cac4a0b669ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:32.527424 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084724a1-1cfc-4eff-b870-cac4a0b669ee None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:32.527860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084724a1-1cfc-4eff-b870-cac4a0b669ee None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:32.528138 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084724a1-1cfc-4eff-b870-cac4a0b669ee None admin] PATH_INFO: `/v3/roles/db0e2f86b328428ba0dbfe6383deffce` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:32.529636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084724a1-1cfc-4eff-b870-cac4a0b669ee None admin] RBAC: Authorizing `identity:get_role(role_id=db0e2f86b328428ba0dbfe6383deffce)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:32.530996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084724a1-1cfc-4eff-b870-cac4a0b669ee None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:32.532454 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 564/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:32 2022] GET /identity/v3/roles/db0e2f86b328428ba0dbfe6383deffce => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:32.538216 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e0dc4-fa48-4cb7-a7c2-9243b8bb6597 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:32.631736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e0dc4-fa48-4cb7-a7c2-9243b8bb6597 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:32.663258 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522c4bc-3c7b-492c-8a1b-688ad909088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:32.664147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c4bc-3c7b-492c-8a1b-688ad909088e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:32.664429 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c4bc-3c7b-492c-8a1b-688ad909088e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:32.664703 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522c4bc-3c7b-492c-8a1b-688ad909088e None admin] PATH_INFO: `/v3/users/518baff66bb9442bb29749321dc237f7` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:32.665881 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522c4bc-3c7b-492c-8a1b-688ad909088e None admin] RBAC: Authorizing `identity:get_user(user_id=518baff66bb9442bb29749321dc237f7)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:32.667304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522c4bc-3c7b-492c-8a1b-688ad909088e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:32.669560 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 563/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:32 2022] GET /identity/v3/users/518baff66bb9442bb29749321dc237f7 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:32.675370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084724a1-1cfc-4eff-b870-cac4a0b669ee None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:32.772877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084724a1-1cfc-4eff-b870-cac4a0b669ee None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:32.805437 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01878-2ac1-46d4-9d7e-ced20c252721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:32.806009 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01878-2ac1-46d4-9d7e-ced20c252721 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:32.806291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01878-2ac1-46d4-9d7e-ced20c252721 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:32.806566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d01878-2ac1-46d4-9d7e-ced20c252721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:32.869663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d01878-2ac1-46d4-9d7e-ced20c252721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:32.871093 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d01878-2ac1-46d4-9d7e-ced20c252721 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:32.964435 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 565/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:32.970984 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522c4bc-3c7b-492c-8a1b-688ad909088e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:33.066062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522c4bc-3c7b-492c-8a1b-688ad909088e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:33.100345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6882b-95b3-4547-a9c1-0bf2d4c1e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:33.101194 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6882b-95b3-4547-a9c1-0bf2d4c1e36c None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:33.101477 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6882b-95b3-4547-a9c1-0bf2d4c1e36c None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:33.101752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6882b-95b3-4547-a9c1-0bf2d4c1e36c None admin] PATH_INFO: `/v3/projects/c79ef28140d24c9a86f7ad63edbe847b` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:33.102930 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6882b-95b3-4547-a9c1-0bf2d4c1e36c None admin] RBAC: Authorizing `identity:get_project(project_id=c79ef28140d24c9a86f7ad63edbe847b)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:33.104406 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6882b-95b3-4547-a9c1-0bf2d4c1e36c None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:33.106792 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 564/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:32 2022] GET /identity/v3/projects/c79ef28140d24c9a86f7ad63edbe847b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:33.113072 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01878-2ac1-46d4-9d7e-ced20c252721 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:33.214130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d01878-2ac1-46d4-9d7e-ced20c252721 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:33.247520 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53f8e1-4b18-434d-8f29-57d9b752a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:33.248185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53f8e1-4b18-434d-8f29-57d9b752a099 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:33.248468 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53f8e1-4b18-434d-8f29-57d9b752a099 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:33.248742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53f8e1-4b18-434d-8f29-57d9b752a099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:33.249571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53f8e1-4b18-434d-8f29-57d9b752a099 None admin] RBAC: Adding query filter params (role.id=db0e2f86b328428ba0dbfe6383deffce, scope.project.id=c79ef28140d24c9a86f7ad63edbe847b, user.id=518baff66bb9442bb29749321dc237f7) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:33.249882 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53f8e1-4b18-434d-8f29-57d9b752a099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:33.251292 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53f8e1-4b18-434d-8f29-57d9b752a099 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:33.256936 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 566/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:33 2022] GET /identity/v3/role_assignments?user.id=518baff66bb9442bb29749321dc237f7&scope.project.id=c79ef28140d24c9a86f7ad63edbe847b&role.id=db0e2f86b328428ba0dbfe6383deffce => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:35.514601 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bcfd9-3f8e-4340-81ea-b968d44e1250 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:35.515160 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bcfd9-3f8e-4340-81ea-b968d44e1250 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:35.515160 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bcfd9-3f8e-4340-81ea-b968d44e1250 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:35.516562 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 565/1131] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:35.521714 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcc87-f597-446c-8f1b-7f6207705ba1 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:35.522130 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcc87-f597-446c-8f1b-7f6207705ba1 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:35.522272 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafcc87-f597-446c-8f1b-7f6207705ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:35.538724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-1dafcc87-f597-446c-8f1b-7f6207705ba1 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:35.539939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-1dafcc87-f597-446c-8f1b-7f6207705ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:35.605312 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 567/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:35.629311 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bcfd9-3f8e-4340-81ea-b968d44e1250 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:35.725201 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bcfd9-3f8e-4340-81ea-b968d44e1250 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:35.757643 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98051b2-d075-489d-a726-f8af30ddaf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:35.758423 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98051b2-d075-489d-a726-f8af30ddaf6b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:35.758706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98051b2-d075-489d-a726-f8af30ddaf6b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:35.758980 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98051b2-d075-489d-a726-f8af30ddaf6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:35.760173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98051b2-d075-489d-a726-f8af30ddaf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:35.761600 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98051b2-d075-489d-a726-f8af30ddaf6b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:35.764845 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 566/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:35.770564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafcc87-f597-446c-8f1b-7f6207705ba1 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:35.864699 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafcc87-f597-446c-8f1b-7f6207705ba1 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:35.896980 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f4af6-02d5-4718-b1cc-c6c6f743064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:35.897623 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f4af6-02d5-4718-b1cc-c6c6f743064d None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:35.897908 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f4af6-02d5-4718-b1cc-c6c6f743064d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:35.898185 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f4af6-02d5-4718-b1cc-c6c6f743064d None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:35.898886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f4af6-02d5-4718-b1cc-c6c6f743064d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:35.900360 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f4af6-02d5-4718-b1cc-c6c6f743064d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:35.925011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 568/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:17:35 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:17:38.188861 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1608-4d9e-48f1-9e62-fd62719d068d None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:38.189390 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1608-4d9e-48f1-9e62-fd62719d068d None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:38.189498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1608-4d9e-48f1-9e62-fd62719d068d None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:38.190777 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 567/1135] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:38.196492 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6cac-6df8-4fc3-a8c2-50521a9a47fb None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:38.196861 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6cac-6df8-4fc3-a8c2-50521a9a47fb None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:38.197057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d6cac-6df8-4fc3-a8c2-50521a9a47fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:38.213654 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-066d6cac-6df8-4fc3-a8c2-50521a9a47fb None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:38.214847 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-066d6cac-6df8-4fc3-a8c2-50521a9a47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:38.278813 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 569/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:38.303819 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e1608-4d9e-48f1-9e62-fd62719d068d None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:38.400627 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e1608-4d9e-48f1-9e62-fd62719d068d None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:38.432130 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31fa1e-0445-4fc7-ae61-74d9d407e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:38.432905 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31fa1e-0445-4fc7-ae61-74d9d407e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:38.433191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31fa1e-0445-4fc7-ae61-74d9d407e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:38.433466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31fa1e-0445-4fc7-ae61-74d9d407e8a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:38.435288 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31fa1e-0445-4fc7-ae61-74d9d407e8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:38.436745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31fa1e-0445-4fc7-ae61-74d9d407e8a4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:38.438352 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 568/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:17:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:38.444023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d6cac-6df8-4fc3-a8c2-50521a9a47fb None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:38.536802 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d6cac-6df8-4fc3-a8c2-50521a9a47fb None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:38.568618 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27121457-97b4-43f6-863a-336a434330bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:38.569270 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121457-97b4-43f6-863a-336a434330bd None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:38.569549 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121457-97b4-43f6-863a-336a434330bd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:38.569820 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121457-97b4-43f6-863a-336a434330bd None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:38.570789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27121457-97b4-43f6-863a-336a434330bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:38.572237 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27121457-97b4-43f6-863a-336a434330bd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:38.592357 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 570/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:17:38 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:17:40.877241 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf45273-c074-4ec8-a5b5-770c4b8bafb6 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:40.877739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf45273-c074-4ec8-a5b5-770c4b8bafb6 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:40.877739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf45273-c074-4ec8-a5b5-770c4b8bafb6 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:40.879084 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 569/1139] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:40.884610 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dcecc-442c-4778-9fc4-f4ee6466e75e None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:40.884997 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dcecc-442c-4778-9fc4-f4ee6466e75e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:40.885163 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dcecc-442c-4778-9fc4-f4ee6466e75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:40.903433 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-1c9dcecc-442c-4778-9fc4-f4ee6466e75e None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:40.904620 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-1c9dcecc-442c-4778-9fc4-f4ee6466e75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:40.966912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 571/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:17:40.989891 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf45273-c074-4ec8-a5b5-770c4b8bafb6 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:41.085078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf45273-c074-4ec8-a5b5-770c4b8bafb6 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:41.116940 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a0f8b-6a86-4c7c-a8cf-35aeb6ffe14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:41.117715 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a0f8b-6a86-4c7c-a8cf-35aeb6ffe14d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:41.117997 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a0f8b-6a86-4c7c-a8cf-35aeb6ffe14d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:41.118276 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a0f8b-6a86-4c7c-a8cf-35aeb6ffe14d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:41.128504 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a0f8b-6a86-4c7c-a8cf-35aeb6ffe14d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-cf1a0f8b-6a86-4c7c-a8cf-35aeb6ffe14d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:41.136019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:41.137224 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:41.138222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 570/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:17:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:41.143596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dcecc-442c-4778-9fc4-f4ee6466e75e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:41.237666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dcecc-442c-4778-9fc4-f4ee6466e75e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:41.276888 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:41.278169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:41.278448 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:41.278724 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:41.279469 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:41.279803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:41.281170 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:41.288946 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 572/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:41.295589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a0f8b-6a86-4c7c-a8cf-35aeb6ffe14d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:41.390326 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a0f8b-6a86-4c7c-a8cf-35aeb6ffe14d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:41.423275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041653f-00bf-4ba0-ab8c-24e22c4acac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:41.424157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041653f-00bf-4ba0-ab8c-24e22c4acac3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:41.424442 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041653f-00bf-4ba0-ab8c-24e22c4acac3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:41.424718 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041653f-00bf-4ba0-ab8c-24e22c4acac3 None admin] PATH_INFO: `/v3/users/3067d20da73e4c32970cc19283fb76e3` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:41.437620 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041653f-00bf-4ba0-ab8c-24e22c4acac3 None admin] RBAC: Authorizing `identity:get_user(user_id=3067d20da73e4c32970cc19283fb76e3)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:41.439060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041653f-00bf-4ba0-ab8c-24e22c4acac3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:41.440711 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 571/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:41 2022] GET /identity/v3/users/3067d20da73e4c32970cc19283fb76e3 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:41.446628 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:41.542395 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231db2c-53a7-4e5c-8255-5d20228dd2b5 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:41.575291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9268ee-73ab-4308-9e42-95c6143b9823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:41.575956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9268ee-73ab-4308-9e42-95c6143b9823 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:41.576242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9268ee-73ab-4308-9e42-95c6143b9823 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:41.576524 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9268ee-73ab-4308-9e42-95c6143b9823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:41.641541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9268ee-73ab-4308-9e42-95c6143b9823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:41.642921 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9268ee-73ab-4308-9e42-95c6143b9823 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:41.737577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 573/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:41.743469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041653f-00bf-4ba0-ab8c-24e22c4acac3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:41.838439 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041653f-00bf-4ba0-ab8c-24e22c4acac3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:41.870562 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b97c6f-dbaf-44a4-9058-8174dbb192b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:41.871503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97c6f-dbaf-44a4-9058-8174dbb192b8 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:41.871846 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97c6f-dbaf-44a4-9058-8174dbb192b8 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:41.872129 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97c6f-dbaf-44a4-9058-8174dbb192b8 None admin] PATH_INFO: `/v3/projects/c2a5ba5b30ab498fb58c88e7f98dc736` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:41.873312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b97c6f-dbaf-44a4-9058-8174dbb192b8 None admin] RBAC: Authorizing `identity:get_project(project_id=c2a5ba5b30ab498fb58c88e7f98dc736)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:41.874739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b97c6f-dbaf-44a4-9058-8174dbb192b8 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:41.876462 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 572/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:41 2022] GET /identity/v3/projects/c2a5ba5b30ab498fb58c88e7f98dc736 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:41.882534 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9268ee-73ab-4308-9e42-95c6143b9823 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:41.977085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9268ee-73ab-4308-9e42-95c6143b9823 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:42.009255 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a27750-6f9b-48cf-9a72-93656120cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:42.009893 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a27750-6f9b-48cf-9a72-93656120cafc None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:42.010179 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a27750-6f9b-48cf-9a72-93656120cafc None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:42.010453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a27750-6f9b-48cf-9a72-93656120cafc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:42.011277 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a27750-6f9b-48cf-9a72-93656120cafc None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=c2a5ba5b30ab498fb58c88e7f98dc736, user.id=3067d20da73e4c32970cc19283fb76e3) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:42.011639 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a27750-6f9b-48cf-9a72-93656120cafc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:42.013647 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a27750-6f9b-48cf-9a72-93656120cafc None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:42.018899 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 574/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:41 2022] GET /identity/v3/role_assignments?user.id=3067d20da73e4c32970cc19283fb76e3&scope.project.id=c2a5ba5b30ab498fb58c88e7f98dc736&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:44.203283 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639e0d3-d5a1-4573-9d7a-176b856d8740 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:44.203899 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639e0d3-d5a1-4573-9d7a-176b856d8740 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:44.203899 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639e0d3-d5a1-4573-9d7a-176b856d8740 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:44.205335 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 573/1147] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:44.210464 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9567250-50e7-4dc2-b2fc-e26c5c518fd1 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:44.210892 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9567250-50e7-4dc2-b2fc-e26c5c518fd1 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:44.211022 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9567250-50e7-4dc2-b2fc-e26c5c518fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:44.227605 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-a9567250-50e7-4dc2-b2fc-e26c5c518fd1 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:44.228814 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-a9567250-50e7-4dc2-b2fc-e26c5c518fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:44.294480 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 575/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:44.316714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639e0d3-d5a1-4573-9d7a-176b856d8740 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:44.411453 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639e0d3-d5a1-4573-9d7a-176b856d8740 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:44.443565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5359e2-e241-4998-8559-f0277afcfe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:44.444359 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5359e2-e241-4998-8559-f0277afcfe5e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:44.444640 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5359e2-e241-4998-8559-f0277afcfe5e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:44.445177 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5359e2-e241-4998-8559-f0277afcfe5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:44.455492 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5359e2-e241-4998-8559-f0277afcfe5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-ca5359e2-e241-4998-8559-f0277afcfe5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:44.462864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:44.463932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:44.465565 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 574/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:44.470168 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9567250-50e7-4dc2-b2fc-e26c5c518fd1 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:44.563740 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9567250-50e7-4dc2-b2fc-e26c5c518fd1 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:44.596708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:44.597370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:44.597652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:44.597926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:44.598670 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:44.598974 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:44.600374 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:44.608852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 576/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:44.614662 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5359e2-e241-4998-8559-f0277afcfe5e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:44.709175 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5359e2-e241-4998-8559-f0277afcfe5e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:44.740775 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dded-7693-4a8e-a74c-4b8a48fbf9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:44.741626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dded-7693-4a8e-a74c-4b8a48fbf9bc None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:44.741906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dded-7693-4a8e-a74c-4b8a48fbf9bc None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:44.742180 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dded-7693-4a8e-a74c-4b8a48fbf9bc None admin] PATH_INFO: `/v3/users/3067d20da73e4c32970cc19283fb76e3` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:44.743355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10dded-7693-4a8e-a74c-4b8a48fbf9bc None admin] RBAC: Authorizing `identity:get_user(user_id=3067d20da73e4c32970cc19283fb76e3)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:44.744816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10dded-7693-4a8e-a74c-4b8a48fbf9bc None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:44.747101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 575/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:44 2022] GET /identity/v3/users/3067d20da73e4c32970cc19283fb76e3 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:44.752768 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:44.860619 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c731-2287-4d8d-b65d-1174a4983161 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:44.892139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111f9b9-ed9d-400e-ac77-fef713bfeb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:44.892977 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111f9b9-ed9d-400e-ac77-fef713bfeb71 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:44.893256 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111f9b9-ed9d-400e-ac77-fef713bfeb71 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:44.893528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111f9b9-ed9d-400e-ac77-fef713bfeb71 None admin] PATH_INFO: `/v3/projects/c2a5ba5b30ab498fb58c88e7f98dc736` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:44.894684 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111f9b9-ed9d-400e-ac77-fef713bfeb71 None admin] RBAC: Authorizing `identity:get_project(project_id=c2a5ba5b30ab498fb58c88e7f98dc736)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:44.896133 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111f9b9-ed9d-400e-ac77-fef713bfeb71 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:44.897808 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 577/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:44 2022] GET /identity/v3/projects/c2a5ba5b30ab498fb58c88e7f98dc736 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:44.904062 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dded-7693-4a8e-a74c-4b8a48fbf9bc None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:44.998373 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dded-7693-4a8e-a74c-4b8a48fbf9bc None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:45.030004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e2f93-3b9f-44d8-92b1-d28c3528ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:45.030874 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2f93-3b9f-44d8-92b1-d28c3528ae16 None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:45.031162 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2f93-3b9f-44d8-92b1-d28c3528ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:45.031441 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2f93-3b9f-44d8-92b1-d28c3528ae16 None admin] PATH_INFO: `/v3/projects/c2a5ba5b30ab498fb58c88e7f98dc736/users/3067d20da73e4c32970cc19283fb76e3/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:45.033439 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e2f93-3b9f-44d8-92b1-d28c3528ae16 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a5ba5b30ab498fb58c88e7f98dc736, user_id=3067d20da73e4c32970cc19283fb76e3, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:45.034865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e2f93-3b9f-44d8-92b1-d28c3528ae16 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:45.048769 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 576/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:17:44 2022] PUT /identity/v3/projects/c2a5ba5b30ab498fb58c88e7f98dc736/users/3067d20da73e4c32970cc19283fb76e3/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:17:47.269935 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1b3f-2de4-4de7-bc58-897a3be1a6ec None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:47.270465 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1b3f-2de4-4de7-bc58-897a3be1a6ec None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:47.270465 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac1b3f-2de4-4de7-bc58-897a3be1a6ec None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:47.271876 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 578/1154] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:47.277729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d113a-8e3d-4d44-a7b0-ff95c8ab63b0 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:47.278160 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d113a-8e3d-4d44-a7b0-ff95c8ab63b0 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:47.278566 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d113a-8e3d-4d44-a7b0-ff95c8ab63b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:47.295421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-246d113a-8e3d-4d44-a7b0-ff95c8ab63b0 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:47.296649 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-246d113a-8e3d-4d44-a7b0-ff95c8ab63b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:47.360866 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 577/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:47.384453 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac1b3f-2de4-4de7-bc58-897a3be1a6ec None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:47.482681 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac1b3f-2de4-4de7-bc58-897a3be1a6ec None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:47.515825 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385562b6-ef1f-4fa6-b840-3bfa8d034b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:47.516596 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385562b6-ef1f-4fa6-b840-3bfa8d034b5a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:47.516882 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385562b6-ef1f-4fa6-b840-3bfa8d034b5a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:47.517160 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385562b6-ef1f-4fa6-b840-3bfa8d034b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:47.526851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385562b6-ef1f-4fa6-b840-3bfa8d034b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-385562b6-ef1f-4fa6-b840-3bfa8d034b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:17:47.534940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:47.535996 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:17:47.536972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 579/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:47.542106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d113a-8e3d-4d44-a7b0-ff95c8ab63b0 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:47.635049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d113a-8e3d-4d44-a7b0-ff95c8ab63b0 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:47.667287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:47.668086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:47.668367 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:47.668642 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:47.669381 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:47.669684 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:47.671049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:47.678632 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 578/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:17:47.684576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385562b6-ef1f-4fa6-b840-3bfa8d034b5a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:47.779683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385562b6-ef1f-4fa6-b840-3bfa8d034b5a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:47.812098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af14bd8-1b72-44e2-a34a-357fc50b6543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:47.812958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14bd8-1b72-44e2-a34a-357fc50b6543 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:47.813241 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14bd8-1b72-44e2-a34a-357fc50b6543 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:47.813517 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af14bd8-1b72-44e2-a34a-357fc50b6543 None admin] PATH_INFO: `/v3/users/3067d20da73e4c32970cc19283fb76e3` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:47.814697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af14bd8-1b72-44e2-a34a-357fc50b6543 None admin] RBAC: Authorizing `identity:get_user(user_id=3067d20da73e4c32970cc19283fb76e3)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:47.816152 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af14bd8-1b72-44e2-a34a-357fc50b6543 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:47.817788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 580/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:17:47 2022] GET /identity/v3/users/3067d20da73e4c32970cc19283fb76e3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:47.823935 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:47.918541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a865bb9-b903-46a5-a553-b75369e53b99 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:47.950358 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab8cc-5a26-41dc-adc3-f8ad220aa975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:47.951051 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab8cc-5a26-41dc-adc3-f8ad220aa975 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:47.951336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab8cc-5a26-41dc-adc3-f8ad220aa975 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:47.951613 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab8cc-5a26-41dc-adc3-f8ad220aa975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:48.022755 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ab8cc-5a26-41dc-adc3-f8ad220aa975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:48.024261 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ab8cc-5a26-41dc-adc3-f8ad220aa975 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:48.132421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 579/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:48.139010 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af14bd8-1b72-44e2-a34a-357fc50b6543 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:48.268192 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af14bd8-1b72-44e2-a34a-357fc50b6543 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:48.309322 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6d740-e63d-45e5-bef2-485f2dfaf3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:48.310178 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d740-e63d-45e5-bef2-485f2dfaf3d0 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:48.310463 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d740-e63d-45e5-bef2-485f2dfaf3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:48.310742 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d740-e63d-45e5-bef2-485f2dfaf3d0 None admin] PATH_INFO: `/v3/projects/c2a5ba5b30ab498fb58c88e7f98dc736` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:48.311960 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6d740-e63d-45e5-bef2-485f2dfaf3d0 None admin] RBAC: Authorizing `identity:get_project(project_id=c2a5ba5b30ab498fb58c88e7f98dc736)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:48.313403 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6d740-e63d-45e5-bef2-485f2dfaf3d0 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:48.315126 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 581/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:17:48 2022] GET /identity/v3/projects/c2a5ba5b30ab498fb58c88e7f98dc736 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:48.322494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab8cc-5a26-41dc-adc3-f8ad220aa975 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:48.426194 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab8cc-5a26-41dc-adc3-f8ad220aa975 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:48.462339 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349af2e-be58-444a-a82f-d0b66560133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:48.462998 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349af2e-be58-444a-a82f-d0b66560133f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:48.463281 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349af2e-be58-444a-a82f-d0b66560133f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:48.463557 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349af2e-be58-444a-a82f-d0b66560133f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:48.464467 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349af2e-be58-444a-a82f-d0b66560133f None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=c2a5ba5b30ab498fb58c88e7f98dc736, user.id=3067d20da73e4c32970cc19283fb76e3) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:48.465336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349af2e-be58-444a-a82f-d0b66560133f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:48.466769 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349af2e-be58-444a-a82f-d0b66560133f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:48.472674 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 580/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:17:48 2022] GET /identity/v3/role_assignments?user.id=3067d20da73e4c32970cc19283fb76e3&scope.project.id=c2a5ba5b30ab498fb58c88e7f98dc736&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:50.795286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcf22-69c6-4726-a352-33fbbf6ccf42 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:50.796056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcf22-69c6-4726-a352-33fbbf6ccf42 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:50.796056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dcf22-69c6-4726-a352-33fbbf6ccf42 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:50.797262 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 582/1162] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:50.803618 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc5f40-9b4e-4267-85bf-18eafc705fee None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:50.804179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc5f40-9b4e-4267-85bf-18eafc705fee None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:50.804179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc5f40-9b4e-4267-85bf-18eafc705fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:50.821644 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-08bc5f40-9b4e-4267-85bf-18eafc705fee None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:50.825191 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-08bc5f40-9b4e-4267-85bf-18eafc705fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:50.889530 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 581/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:50.911686 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dcf22-69c6-4726-a352-33fbbf6ccf42 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:51.009788 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dcf22-69c6-4726-a352-33fbbf6ccf42 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:51.041577 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9eead-720d-49e7-8ea4-445f50003f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:51.042207 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9eead-720d-49e7-8ea4-445f50003f34 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:51.043074 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9eead-720d-49e7-8ea4-445f50003f34 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:51.043358 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9eead-720d-49e7-8ea4-445f50003f34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:51.106811 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9eead-720d-49e7-8ea4-445f50003f34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:51.108287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9eead-720d-49e7-8ea4-445f50003f34 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:51.201538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 583/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:17:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:17:51.207528 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc5f40-9b4e-4267-85bf-18eafc705fee None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:51.298973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc5f40-9b4e-4267-85bf-18eafc705fee None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:51.332608 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a122243-065a-4c4e-a6e9-d4e5a67ffa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:51.333399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122243-065a-4c4e-a6e9-d4e5a67ffa27 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:51.333679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122243-065a-4c4e-a6e9-d4e5a67ffa27 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:51.333946 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a122243-065a-4c4e-a6e9-d4e5a67ffa27 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:51.341169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a122243-065a-4c4e-a6e9-d4e5a67ffa27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:51.342609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a122243-065a-4c4e-a6e9-d4e5a67ffa27 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-9a122243-065a-4c4e-a6e9-d4e5a67ffa27 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:17:51.357295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:17:51.358464 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:17:51.359523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 582/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:17:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:17:51.364604 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9eead-720d-49e7-8ea4-445f50003f34 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:51.461719 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9eead-720d-49e7-8ea4-445f50003f34 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:51.493733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f9c49-8bfa-4afc-a9fa-91fe728638c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:51.494376 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9c49-8bfa-4afc-a9fa-91fe728638c0 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:51.494692 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9c49-8bfa-4afc-a9fa-91fe728638c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:51.494980 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f9c49-8bfa-4afc-a9fa-91fe728638c0 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:51.496547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f9c49-8bfa-4afc-a9fa-91fe728638c0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:17:51.496856 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f9c49-8bfa-4afc-a9fa-91fe728638c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:51.498219 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f9c49-8bfa-4afc-a9fa-91fe728638c0 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:51.505169 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 584/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:17:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:53.723371 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2f085-0561-4753-b230-26b2ac4929b7 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:53.723931 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2f085-0561-4753-b230-26b2ac4929b7 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:53.724028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2f085-0561-4753-b230-26b2ac4929b7 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:53.725338 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 583/1167] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:53.730816 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81db70-d458-43f8-8bad-e1ed62362b06 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:53.731215 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81db70-d458-43f8-8bad-e1ed62362b06 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:53.731379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81db70-d458-43f8-8bad-e1ed62362b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:53.747904 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-bb81db70-d458-43f8-8bad-e1ed62362b06 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:53.749096 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-bb81db70-d458-43f8-8bad-e1ed62362b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:53.812669 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 585/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:53.835725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2f085-0561-4753-b230-26b2ac4929b7 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:53.931595 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2f085-0561-4753-b230-26b2ac4929b7 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:53.963302 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55e6b8-2c8e-4ed7-b134-0e600129d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:53.963965 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e6b8-2c8e-4ed7-b134-0e600129d2ab None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:53.964989 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e6b8-2c8e-4ed7-b134-0e600129d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:53.965264 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e6b8-2c8e-4ed7-b134-0e600129d2ab None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:53.966001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55e6b8-2c8e-4ed7-b134-0e600129d2ab None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:53.967348 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55e6b8-2c8e-4ed7-b134-0e600129d2ab None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:53.981132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 584/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Mon May 9 15:17:53 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:17:56.230515 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745825e-a38a-4ffc-84d2-5c3e4832fb55 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:56.231066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745825e-a38a-4ffc-84d2-5c3e4832fb55 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:56.231066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745825e-a38a-4ffc-84d2-5c3e4832fb55 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:56.232488 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 586/1170] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:56.237679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46781-766b-478b-8780-d9c8b0f2507d None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:56.238112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46781-766b-478b-8780-d9c8b0f2507d None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:56.238244 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46781-766b-478b-8780-d9c8b0f2507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:56.255092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-d7f46781-766b-478b-8780-d9c8b0f2507d None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:56.256405 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-d7f46781-766b-478b-8780-d9c8b0f2507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:56.319126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 585/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:56.342872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745825e-a38a-4ffc-84d2-5c3e4832fb55 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:56.441541 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745825e-a38a-4ffc-84d2-5c3e4832fb55 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:56.474967 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace8d08-11b3-48d1-86d7-d22f28b92f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:56.475834 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace8d08-11b3-48d1-86d7-d22f28b92f85 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:56.476119 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace8d08-11b3-48d1-86d7-d22f28b92f85 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:56.476393 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace8d08-11b3-48d1-86d7-d22f28b92f85 None admin] PATH_INFO: `/v3/domains/f39335f6bc504b129964cbd60a33addd` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:56.486375 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace8d08-11b3-48d1-86d7-d22f28b92f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f39335f6bc504b129964cbd60a33addd)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:56.487746 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace8d08-11b3-48d1-86d7-d22f28b92f85 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:56.489397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 587/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 9 15:17:56 2022] GET /identity/v3/domains/f39335f6bc504b129964cbd60a33addd => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:56.495163 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f46781-766b-478b-8780-d9c8b0f2507d None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:56.589100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f46781-766b-478b-8780-d9c8b0f2507d None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:56.621791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e37fe-72a7-4ffd-9940-6098526dbbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:56.622438 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e37fe-72a7-4ffd-9940-6098526dbbd0 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:56.622720 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e37fe-72a7-4ffd-9940-6098526dbbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:56.622994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e37fe-72a7-4ffd-9940-6098526dbbd0 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:56.623708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e37fe-72a7-4ffd-9940-6098526dbbd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:56.625179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e37fe-72a7-4ffd-9940-6098526dbbd0 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:56.649106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 586/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:17:56 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:17:58.912746 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3e77-e6a0-4c67-9b84-9bf939730544 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:58.913266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3e77-e6a0-4c67-9b84-9bf939730544 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:58.913266 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b3e77-e6a0-4c67-9b84-9bf939730544 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:58.914585 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 588/1174] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:17:58.920039 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79fa0-6c69-4df5-a9ff-daa1ca6645d0 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:58.920482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79fa0-6c69-4df5-a9ff-daa1ca6645d0 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:58.920604 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79fa0-6c69-4df5-a9ff-daa1ca6645d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:58.936841 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ede79fa0-6c69-4df5-a9ff-daa1ca6645d0 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:17:58.938025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ede79fa0-6c69-4df5-a9ff-daa1ca6645d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:17:59.001271 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 587/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:17:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:17:59.025593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b3e77-e6a0-4c67-9b84-9bf939730544 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:59.121491 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b3e77-e6a0-4c67-9b84-9bf939730544 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:59.153520 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64f95b-3e22-4723-b232-7f6186875279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:59.154350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f95b-3e22-4723-b232-7f6186875279 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:59.154628 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f95b-3e22-4723-b232-7f6186875279 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:59.154898 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f95b-3e22-4723-b232-7f6186875279 None admin] PATH_INFO: `/v3/domains/f39335f6bc504b129964cbd60a33addd` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:59.156077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64f95b-3e22-4723-b232-7f6186875279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f39335f6bc504b129964cbd60a33addd)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:59.157507 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64f95b-3e22-4723-b232-7f6186875279 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:59.159088 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 589/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 9 15:17:59 2022] GET /identity/v3/domains/f39335f6bc504b129964cbd60a33addd => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:17:59.164834 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79fa0-6c69-4df5-a9ff-daa1ca6645d0 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:17:59.262858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79fa0-6c69-4df5-a9ff-daa1ca6645d0 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:17:59.294227 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd316603-639c-4e6e-b2a8-e86767dffc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:17:59.294883 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316603-639c-4e6e-b2a8-e86767dffc7d None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:59.295161 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316603-639c-4e6e-b2a8-e86767dffc7d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:59.295431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316603-639c-4e6e-b2a8-e86767dffc7d None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:59.296173 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd316603-639c-4e6e-b2a8-e86767dffc7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:17:59.297591 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd316603-639c-4e6e-b2a8-e86767dffc7d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:17:59.316265 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 588/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:17:59 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:18:01.564987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c98d1-8282-4aae-9f94-c87553792b84 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:01.565546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c98d1-8282-4aae-9f94-c87553792b84 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:01.565546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c98d1-8282-4aae-9f94-c87553792b84 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:01.566911 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 590/1178] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:01.572460 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e9c1-7bdd-46d3-a722-e41e9fccbdb0 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:01.572876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e9c1-7bdd-46d3-a722-e41e9fccbdb0 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:01.573025 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e9c1-7bdd-46d3-a722-e41e9fccbdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:01.590230 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-0302e9c1-7bdd-46d3-a722-e41e9fccbdb0 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:01.591428 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-0302e9c1-7bdd-46d3-a722-e41e9fccbdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:01.653317 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 589/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:18:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:18:01.677989 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c98d1-8282-4aae-9f94-c87553792b84 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:01.773567 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c98d1-8282-4aae-9f94-c87553792b84 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:01.804647 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954398e-3793-443d-84ec-d06361eae293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:01.805414 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954398e-3793-443d-84ec-d06361eae293 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:01.805697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954398e-3793-443d-84ec-d06361eae293 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:01.805970 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954398e-3793-443d-84ec-d06361eae293 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:01.817268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954398e-3793-443d-84ec-d06361eae293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-c954398e-3793-443d-84ec-d06361eae293 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:01.825147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:01.826232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:18:01.827222 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 591/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:18:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:01.832580 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302e9c1-7bdd-46d3-a722-e41e9fccbdb0 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:01.924687 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302e9c1-7bdd-46d3-a722-e41e9fccbdb0 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:01.956263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:01.956912 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:01.957190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:01.957460 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:01.958199 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:01.958501 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:01.959884 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:01.969272 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 590/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:18:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:01.974964 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954398e-3793-443d-84ec-d06361eae293 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:02.070795 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954398e-3793-443d-84ec-d06361eae293 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:02.103347 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edab7-f8f6-4a37-852e-dabe2b11c08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:02.104233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edab7-f8f6-4a37-852e-dabe2b11c08c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:02.105167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edab7-f8f6-4a37-852e-dabe2b11c08c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:02.105420 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5edab7-f8f6-4a37-852e-dabe2b11c08c None admin] PATH_INFO: `/v3/users/da99b0169378473bace853651b05a56f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:02.117999 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5edab7-f8f6-4a37-852e-dabe2b11c08c None admin] RBAC: Authorizing `identity:get_user(user_id=da99b0169378473bace853651b05a56f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:02.119441 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5edab7-f8f6-4a37-852e-dabe2b11c08c None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:02.121713 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 592/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:18:01 2022] GET /identity/v3/users/da99b0169378473bace853651b05a56f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:02.127427 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:02.226132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffc767-f2c0-4928-90b9-79c4e4ce4729 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:02.257533 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c540a41-8487-4000-aa5b-9b011809c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:02.258165 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540a41-8487-4000-aa5b-9b011809c5fb None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:02.258443 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540a41-8487-4000-aa5b-9b011809c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:02.258712 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c540a41-8487-4000-aa5b-9b011809c5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:02.320677 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c540a41-8487-4000-aa5b-9b011809c5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:02.322167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c540a41-8487-4000-aa5b-9b011809c5fb None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:02.417959 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 591/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:18:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:18:02.423960 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edab7-f8f6-4a37-852e-dabe2b11c08c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:02.518794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5edab7-f8f6-4a37-852e-dabe2b11c08c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:02.550518 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa088e-36d1-4b32-b575-499ac564feb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:02.551350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa088e-36d1-4b32-b575-499ac564feb2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:02.551628 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa088e-36d1-4b32-b575-499ac564feb2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:02.551926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa088e-36d1-4b32-b575-499ac564feb2 None admin] PATH_INFO: `/v3/projects/96895adf638042ee8ee949f2a1eac473` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:02.553087 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa088e-36d1-4b32-b575-499ac564feb2 None admin] RBAC: Authorizing `identity:get_project(project_id=96895adf638042ee8ee949f2a1eac473)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:02.554494 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa088e-36d1-4b32-b575-499ac564feb2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:02.556202 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 593/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:18:02 2022] GET /identity/v3/projects/96895adf638042ee8ee949f2a1eac473 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:02.562859 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c540a41-8487-4000-aa5b-9b011809c5fb None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:02.656658 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c540a41-8487-4000-aa5b-9b011809c5fb None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:02.689171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ada724-9d55-4cce-9802-cf942ba68522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:02.689815 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ada724-9d55-4cce-9802-cf942ba68522 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:02.690098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ada724-9d55-4cce-9802-cf942ba68522 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:02.690374 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ada724-9d55-4cce-9802-cf942ba68522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:02.691195 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ada724-9d55-4cce-9802-cf942ba68522 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=96895adf638042ee8ee949f2a1eac473, user.id=da99b0169378473bace853651b05a56f) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:02.691504 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ada724-9d55-4cce-9802-cf942ba68522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:02.692949 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ada724-9d55-4cce-9802-cf942ba68522 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:02.698589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 592/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:18:02 2022] GET /identity/v3/role_assignments?user.id=da99b0169378473bace853651b05a56f&scope.project.id=96895adf638042ee8ee949f2a1eac473&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:04.914390 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e006-021d-439a-9c4c-4734b49c30b4 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:04.914910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e006-021d-439a-9c4c-4734b49c30b4 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:04.914910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e006-021d-439a-9c4c-4734b49c30b4 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:04.916287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 594/1186] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:04.922078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53aefb-bddc-4e6a-a2e9-78c585372ce9 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:04.922527 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53aefb-bddc-4e6a-a2e9-78c585372ce9 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:04.922625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53aefb-bddc-4e6a-a2e9-78c585372ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:04.939397 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-bb53aefb-bddc-4e6a-a2e9-78c585372ce9 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:04.940616 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-bb53aefb-bddc-4e6a-a2e9-78c585372ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:05.003880 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 593/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:18:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:18:05.026001 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1e006-021d-439a-9c4c-4734b49c30b4 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:05.123522 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1e006-021d-439a-9c4c-4734b49c30b4 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:05.155622 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edec0-7577-4a5c-b271-0b86b839d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:05.156416 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edec0-7577-4a5c-b271-0b86b839d96e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:05.156699 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edec0-7577-4a5c-b271-0b86b839d96e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:05.156973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047edec0-7577-4a5c-b271-0b86b839d96e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:05.167284 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047edec0-7577-4a5c-b271-0b86b839d96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-047edec0-7577-4a5c-b271-0b86b839d96e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:05.174983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:05.176065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:18:05.176998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 595/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:05.183004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53aefb-bddc-4e6a-a2e9-78c585372ce9 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:05.278037 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53aefb-bddc-4e6a-a2e9-78c585372ce9 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:05.311059 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:05.311715 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:05.312028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:05.312302 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:05.313041 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:05.313345 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:05.314707 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:05.322596 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 594/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:05.329218 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edec0-7577-4a5c-b271-0b86b839d96e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:05.424125 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047edec0-7577-4a5c-b271-0b86b839d96e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:05.457664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4d8e-6287-45f8-815b-043135ef86da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:05.459139 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4d8e-6287-45f8-815b-043135ef86da None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:05.459652 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4d8e-6287-45f8-815b-043135ef86da None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:05.460208 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4d8e-6287-45f8-815b-043135ef86da None admin] PATH_INFO: `/v3/users/da99b0169378473bace853651b05a56f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:05.462324 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca4d8e-6287-45f8-815b-043135ef86da None admin] RBAC: Authorizing `identity:get_user(user_id=da99b0169378473bace853651b05a56f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:05.465157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca4d8e-6287-45f8-815b-043135ef86da None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:05.468338 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 596/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:18:05 2022] GET /identity/v3/users/da99b0169378473bace853651b05a56f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:05.474169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:05.570517 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f58815-fc68-44b5-85d1-9d2fbb2ffab0 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:05.603615 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ba602-e3f9-46fb-89d6-a89424cc046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:05.605524 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba602-e3f9-46fb-89d6-a89424cc046a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:05.605806 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba602-e3f9-46fb-89d6-a89424cc046a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:05.606083 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ba602-e3f9-46fb-89d6-a89424cc046a None admin] PATH_INFO: `/v3/projects/96895adf638042ee8ee949f2a1eac473` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:05.607269 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ba602-e3f9-46fb-89d6-a89424cc046a None admin] RBAC: Authorizing `identity:get_project(project_id=96895adf638042ee8ee949f2a1eac473)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:05.608744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ba602-e3f9-46fb-89d6-a89424cc046a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:05.610450 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 595/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:18:05 2022] GET /identity/v3/projects/96895adf638042ee8ee949f2a1eac473 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:05.616382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4d8e-6287-45f8-815b-043135ef86da None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:05.712340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4d8e-6287-45f8-815b-043135ef86da None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:05.744089 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4daed5-360c-44e5-b154-662a810c044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:05.745575 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4daed5-360c-44e5-b154-662a810c044b None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:05.745857 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4daed5-360c-44e5-b154-662a810c044b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:05.746134 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4daed5-360c-44e5-b154-662a810c044b None admin] PATH_INFO: `/v3/projects/96895adf638042ee8ee949f2a1eac473/users/da99b0169378473bace853651b05a56f/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:05.748131 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4daed5-360c-44e5-b154-662a810c044b None admin] RBAC: Authorizing `identity:create_grant(project_id=96895adf638042ee8ee949f2a1eac473, user_id=da99b0169378473bace853651b05a56f, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:05.749543 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4daed5-360c-44e5-b154-662a810c044b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:05.763161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 597/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:18:05 2022] PUT /identity/v3/projects/96895adf638042ee8ee949f2a1eac473/users/da99b0169378473bace853651b05a56f/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:18:07.968685 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253f73-8f69-4065-9f14-2d05afefb1f2 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:07.969202 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253f73-8f69-4065-9f14-2d05afefb1f2 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:07.969303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253f73-8f69-4065-9f14-2d05afefb1f2 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:07.970595 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 596/1193] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:07.975896 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d006d0-97d8-4e93-9e9a-d33d138a7813 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:07.976340 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d006d0-97d8-4e93-9e9a-d33d138a7813 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:07.976463 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d006d0-97d8-4e93-9e9a-d33d138a7813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:07.993653 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-f8d006d0-97d8-4e93-9e9a-d33d138a7813 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:07.994878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-f8d006d0-97d8-4e93-9e9a-d33d138a7813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:08.059460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 598/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:18:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:18:08.082753 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253f73-8f69-4065-9f14-2d05afefb1f2 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:08.179656 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253f73-8f69-4065-9f14-2d05afefb1f2 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:08.211255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1910a-e5dd-4e10-9f7c-b616397dd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:08.212061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1910a-e5dd-4e10-9f7c-b616397dd398 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:08.212346 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1910a-e5dd-4e10-9f7c-b616397dd398 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:08.212621 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1910a-e5dd-4e10-9f7c-b616397dd398 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:08.222861 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1910a-e5dd-4e10-9f7c-b616397dd398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-3ea1910a-e5dd-4e10-9f7c-b616397dd398 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:08.230979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:08.232047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:18:08.233006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 597/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:18:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:08.238301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d006d0-97d8-4e93-9e9a-d33d138a7813 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:08.332096 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d006d0-97d8-4e93-9e9a-d33d138a7813 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:08.363313 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:08.363987 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:08.364265 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:08.364534 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:08.365272 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:08.365576 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:08.366923 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:08.375064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 599/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:18:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:08.380864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1910a-e5dd-4e10-9f7c-b616397dd398 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:08.475314 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1910a-e5dd-4e10-9f7c-b616397dd398 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:08.507211 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb5cc0-d6e8-4639-b773-183246b28d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:08.508082 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5cc0-d6e8-4639-b773-183246b28d57 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:08.508366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5cc0-d6e8-4639-b773-183246b28d57 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:08.508641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb5cc0-d6e8-4639-b773-183246b28d57 None admin] PATH_INFO: `/v3/users/da99b0169378473bace853651b05a56f` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:08.509819 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb5cc0-d6e8-4639-b773-183246b28d57 None admin] RBAC: Authorizing `identity:get_user(user_id=da99b0169378473bace853651b05a56f)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:08.511471 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb5cc0-d6e8-4639-b773-183246b28d57 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:08.513113 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 598/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:18:08 2022] GET /identity/v3/users/da99b0169378473bace853651b05a56f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:08.518741 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:08.616754 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd16f-169e-4f02-933b-73d2c688a57a None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:08.648778 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af5fb5-6c19-4c82-acdd-b507591bfa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:08.649412 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af5fb5-6c19-4c82-acdd-b507591bfa9d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:08.649693 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af5fb5-6c19-4c82-acdd-b507591bfa9d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:08.649966 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af5fb5-6c19-4c82-acdd-b507591bfa9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:08.714711 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af5fb5-6c19-4c82-acdd-b507591bfa9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:08.716188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af5fb5-6c19-4c82-acdd-b507591bfa9d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:08.808066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 600/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:18:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:18:08.813993 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb5cc0-d6e8-4639-b773-183246b28d57 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:08.907004 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb5cc0-d6e8-4639-b773-183246b28d57 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:08.938098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663fe9b-2897-41f1-bbec-99b83235955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:08.938932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663fe9b-2897-41f1-bbec-99b83235955d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:08.939210 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663fe9b-2897-41f1-bbec-99b83235955d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:08.939482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663fe9b-2897-41f1-bbec-99b83235955d None admin] PATH_INFO: `/v3/projects/96895adf638042ee8ee949f2a1eac473` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:08.940661 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663fe9b-2897-41f1-bbec-99b83235955d None admin] RBAC: Authorizing `identity:get_project(project_id=96895adf638042ee8ee949f2a1eac473)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:08.942081 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663fe9b-2897-41f1-bbec-99b83235955d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:08.943747 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 599/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:18:08 2022] GET /identity/v3/projects/96895adf638042ee8ee949f2a1eac473 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:08.950701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af5fb5-6c19-4c82-acdd-b507591bfa9d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:09.043490 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af5fb5-6c19-4c82-acdd-b507591bfa9d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:09.076368 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a984662-462a-4a6d-bd3a-c775ad230c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:09.076943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984662-462a-4a6d-bd3a-c775ad230c3f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:09.077224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984662-462a-4a6d-bd3a-c775ad230c3f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:09.077497 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a984662-462a-4a6d-bd3a-c775ad230c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:09.078326 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a984662-462a-4a6d-bd3a-c775ad230c3f None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=96895adf638042ee8ee949f2a1eac473, user.id=da99b0169378473bace853651b05a56f) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:09.078636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a984662-462a-4a6d-bd3a-c775ad230c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:09.080079 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a984662-462a-4a6d-bd3a-c775ad230c3f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:09.085648 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 601/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:18:08 2022] GET /identity/v3/role_assignments?user.id=da99b0169378473bace853651b05a56f&scope.project.id=96895adf638042ee8ee949f2a1eac473&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:08.223692 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c4ca-b946-40c9-a2db-35cb8ca884c3 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.224299 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c4ca-b946-40c9-a2db-35cb8ca884c3 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.224299 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18c4ca-b946-40c9-a2db-35cb8ca884c3 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.225811 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 600/1201] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:08.231175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f83e69-6714-461d-9735-5e9ae9c997d8 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.231614 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f83e69-6714-461d-9735-5e9ae9c997d8 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.231810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f83e69-6714-461d-9735-5e9ae9c997d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.249822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-61f83e69-6714-461d-9735-5e9ae9c997d8 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:08.251026 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-61f83e69-6714-461d-9735-5e9ae9c997d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:08.321765 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 602/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:08.345943 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18c4ca-b946-40c9-a2db-35cb8ca884c3 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:08.482239 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18c4ca-b946-40c9-a2db-35cb8ca884c3 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:08.517828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:08.518625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.518910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.519188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.529277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:08.530729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:08.548057 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:08.548978 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:08.550069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:08.550069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:08.550069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:08.550069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:08.550069 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 601/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:08.555720 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f83e69-6714-461d-9735-5e9ae9c997d8 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:08.660719 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f83e69-6714-461d-9735-5e9ae9c997d8 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:08.694297 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0479ba-4329-405d-ab72-6bfdc7815f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:08.694962 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0479ba-4329-405d-ab72-6bfdc7815f6d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.695863 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0479ba-4329-405d-ab72-6bfdc7815f6d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.696147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0479ba-4329-405d-ab72-6bfdc7815f6d None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.696870 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0479ba-4329-405d-ab72-6bfdc7815f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:08.697180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0479ba-4329-405d-ab72-6bfdc7815f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:08.698567 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0479ba-4329-405d-ab72-6bfdc7815f6d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:08.710092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 603/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:08.716609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:08.831496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f040787-2efc-44d5-a544-173c99defe9a None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:08.870536 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b9d2a-cd6b-49b1-841f-fcfd3294adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:08.871400 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9d2a-cd6b-49b1-841f-fcfd3294adb2 None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.871833 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9d2a-cd6b-49b1-841f-fcfd3294adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.872200 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9d2a-cd6b-49b1-841f-fcfd3294adb2 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.873019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b9d2a-cd6b-49b1-841f-fcfd3294adb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:08.874577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b9d2a-cd6b-49b1-841f-fcfd3294adb2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:08.898083 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 602/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:19:08 2022] POST /identity/v3/users => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:11.486519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d283-0134-462b-993a-306f5f24c350 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.487090 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d283-0134-462b-993a-306f5f24c350 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.487090 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d283-0134-462b-993a-306f5f24c350 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.488637 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 604/1206] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:11.494876 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9fc0-cb90-41d3-91ca-fbc7ea0f680a None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.495336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9fc0-cb90-41d3-91ca-fbc7ea0f680a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.495421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9fc0-cb90-41d3-91ca-fbc7ea0f680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.515105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-c60d9fc0-cb90-41d3-91ca-fbc7ea0f680a None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:11.516470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-c60d9fc0-cb90-41d3-91ca-fbc7ea0f680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:11.599017 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 603/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:11.625241 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d283-0134-462b-993a-306f5f24c350 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.748483 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d283-0134-462b-993a-306f5f24c350 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.787825 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf02f-ee42-4559-a41c-187212c67c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.789140 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf02f-ee42-4559-a41c-187212c67c20 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.789431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf02f-ee42-4559-a41c-187212c67c20 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.789709 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf02f-ee42-4559-a41c-187212c67c20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.801387 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edf02f-ee42-4559-a41c-187212c67c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-f3edf02f-ee42-4559-a41c-187212c67c20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:11.810852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:11.811941 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:11.816551 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 605/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:11.818949 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d9fc0-cb90-41d3-91ca-fbc7ea0f680a None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.929399 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d9fc0-cb90-41d3-91ca-fbc7ea0f680a None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.968800 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.969579 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.969935 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.970239 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.971064 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] RBAC: Adding query filter params (name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:11.971376 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:11.973016 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:11.982250 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 604/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:11.987876 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf02f-ee42-4559-a41c-187212c67c20 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.098299 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf02f-ee42-4559-a41c-187212c67c20 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.135610 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.136697 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.137145 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.137420 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.149280 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.150743 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:12.172773 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:12.174521 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:12.175566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:12.175566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:12.175566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:12.175566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:12.175566 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 606/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:12.181643 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.299117 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b09f3-a2e0-4fcc-a1a3-29736f03268e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.339225 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.339945 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.340222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.340529 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.341401 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:12.341744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.345349 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.357281 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 605/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:12.363004 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.483937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450684-a576-41b2-a6e4-9501e3f93f6b None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.527644 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.528593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.528912 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.529190 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] PATH_INFO: `/v3/users/placement` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.542103 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.543803 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:12.562617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:12.563606 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:12.564536 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 607/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:12.570460 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.687388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3905164-4127-419e-ad1f-418094eca0d7 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.725846 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.726527 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.726852 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.727158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.728180 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:12.728545 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.730212 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.750042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 606/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:12.755839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.872666 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ff934-2a42-4e86-a60a-ff2e09cae42d None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.916286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9667c-b526-4ff1-9d00-e87b0d2310cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.917051 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9667c-b526-4ff1-9d00-e87b0d2310cb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.917387 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9667c-b526-4ff1-9d00-e87b0d2310cb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.917706 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9667c-b526-4ff1-9d00-e87b0d2310cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.995539 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9667c-b526-4ff1-9d00-e87b0d2310cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.998293 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9667c-b526-4ff1-9d00-e87b0d2310cb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.110956 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 608/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:19:13.118054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.232376 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb395-be86-43e4-a6b8-863bcec12763 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.270093 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.270815 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.271142 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.271434 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.282375 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.286201 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:13.306725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:13.307655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:13.308525 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:13.308525 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:13.308525 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:13.308525 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:13.308525 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 607/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:13.314951 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9667c-b526-4ff1-9d00-e87b0d2310cb None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.421601 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9667c-b526-4ff1-9d00-e87b0d2310cb None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.459998 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.461564 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.461854 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.462254 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.462957 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:13.463267 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.464683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.481442 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 609/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:13.484526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.598668 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c86e7b-e6d8-4a2f-8c43-9a743ac0ecfe None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.636938 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.637953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.638239 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.638532 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.646347 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.647950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:13.663001 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:13.664738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:13.665985 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 608/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:13.671425 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.789071 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a74e4-157b-4e54-a23c-072299cb780f None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.828121 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c04a39-ae01-44b4-a51b-cbe6afabd5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.828775 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c04a39-ae01-44b4-a51b-cbe6afabd5d1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.829060 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c04a39-ae01-44b4-a51b-cbe6afabd5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.829329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c04a39-ae01-44b4-a51b-cbe6afabd5d1 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.830162 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c04a39-ae01-44b4-a51b-cbe6afabd5d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:13.830443 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c04a39-ae01-44b4-a51b-cbe6afabd5d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.831887 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c04a39-ae01-44b4-a51b-cbe6afabd5d1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.846147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 610/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:13.853904 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.981285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9427a-569c-4ef5-babc-cf1877bacf65 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:14.025550 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4bea5-920c-4773-8b67-371dc8d0aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:14.026240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4bea5-920c-4773-8b67-371dc8d0aa39 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:14.026525 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4bea5-920c-4773-8b67-371dc8d0aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:14.026803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4bea5-920c-4773-8b67-371dc8d0aa39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:14.027696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4bea5-920c-4773-8b67-371dc8d0aa39 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=c1e62aea382644f5ae6946d08a093180) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:14.028047 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4bea5-920c-4773-8b67-371dc8d0aa39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:14.029520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4bea5-920c-4773-8b67-371dc8d0aa39 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:14.035878 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 609/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:19:13 2022] GET /identity/v3/role_assignments?user.id=c1e62aea382644f5ae6946d08a093180&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:16.394023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f0fb8-20c3-4d5b-a0b5-97934ce07cd2 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.394629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f0fb8-20c3-4d5b-a0b5-97934ce07cd2 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.394629 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f0fb8-20c3-4d5b-a0b5-97934ce07cd2 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.395975 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 611/1220] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:16.403627 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dc256-0de9-49b4-af83-1a52d019db01 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.404156 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dc256-0de9-49b4-af83-1a52d019db01 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.404263 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dc256-0de9-49b4-af83-1a52d019db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.422732 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-585dc256-0de9-49b4-af83-1a52d019db01 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:16.424240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-585dc256-0de9-49b4-af83-1a52d019db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:16.496664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 610/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:16.520362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f0fb8-20c3-4d5b-a0b5-97934ce07cd2 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.636370 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f0fb8-20c3-4d5b-a0b5-97934ce07cd2 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:16.679308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e00f3-1112-444d-b31a-19c6bdc6f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:16.679308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e00f3-1112-444d-b31a-19c6bdc6f50c None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.679308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e00f3-1112-444d-b31a-19c6bdc6f50c None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.679308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e00f3-1112-444d-b31a-19c6bdc6f50c None admin] PATH_INFO: `/v3/roles/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.688431 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e00f3-1112-444d-b31a-19c6bdc6f50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-d42e00f3-1112-444d-b31a-19c6bdc6f50c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:16.696657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:16.697570 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:16.698350 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 612/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:19:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:16.705586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dc256-0de9-49b4-af83-1a52d019db01 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.811758 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dc256-0de9-49b4-af83-1a52d019db01 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:16.852573 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:16.853255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.853544 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.854336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.854641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] RBAC: Adding query filter params (name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:16.854887 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:16.856303 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:16.871287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e00f3-1112-444d-b31a-19c6bdc6f50c None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.871735 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 611/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:16.989638 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e00f3-1112-444d-b31a-19c6bdc6f50c None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.026886 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.027842 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.028022 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.028274 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.039865 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.041308 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:17.060852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:17.061901 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:17.063011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:17.063011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:17.063011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:17.063011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:17.063011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 613/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:17.068932 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.180725 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46f3b9-034a-4c30-b000-97b79bb55b97 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.222584 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.223327 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.223610 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.223938 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.224821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:17.225178 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.227521 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.241342 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 612/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:17.247471 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.353325 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50d9a5-8695-4fef-90bb-aaf4ed2dfb87 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.389699 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.390503 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.390780 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.391057 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.399412 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.400942 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:17.415499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:17.416766 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:17.417762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 614/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:17.423291 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.534703 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e373-0235-485f-bc9f-1ca9f0a19978 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.571821 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.572532 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.572822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.573078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.573953 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:17.574258 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.575689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.596220 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 613/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:17.602736 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.716504 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369b790-a8c6-4df0-99c1-6409619074d8 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.753070 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.753966 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.754248 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.754523 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.767349 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.768844 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:17.786919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:17.787944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:17.789642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:17.789642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:17.789642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:17.789642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:17.789642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 615/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:17.793996 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.902456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadc5a5-aa84-4ec5-9e0d-b3f17e445d1b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.941039 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.941708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.941995 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.942273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.943006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:17.943314 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.945075 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.956257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 614/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:17.962547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:18.072397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992b0f9-f4a4-4baa-b9fb-4811cff00ba4 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:18.110022 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:18.110862 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:18.111148 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:18.111422 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:18.118504 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:18.120189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:18.135978 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:18.137046 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:18.138137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 616/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:18.143474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:18.249107 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932150c2-ecbb-4656-acf9-1385465fe5e3 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:18.291586 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb2dc4-3a5b-4f5f-8d7b-df7c7bbb48dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:18.292460 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2dc4-3a5b-4f5f-8d7b-df7c7bbb48dd None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:18.292773 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2dc4-3a5b-4f5f-8d7b-df7c7bbb48dd None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:18.293207 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2dc4-3a5b-4f5f-8d7b-df7c7bbb48dd None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:18.294142 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb2dc4-3a5b-4f5f-8d7b-df7c7bbb48dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:18.294459 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb2dc4-3a5b-4f5f-8d7b-df7c7bbb48dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:18.296106 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb2dc4-3a5b-4f5f-8d7b-df7c7bbb48dd None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:18.312503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 615/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:18.319569 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:18.431113 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d1337-3a8f-4663-aec8-add9b73ea2c0 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:18.466591 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f05af-131c-4a25-a9e1-2e66257d2e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:18.467474 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f05af-131c-4a25-a9e1-2e66257d2e5b None admin] REQUEST_METHOD: `PUT` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:18.467791 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f05af-131c-4a25-a9e1-2e66257d2e5b None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:18.468064 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f05af-131c-4a25-a9e1-2e66257d2e5b None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/c1e62aea382644f5ae6946d08a093180/roles/e56e935653824c0d983483cabd28c5be` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:18.485276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f05af-131c-4a25-a9e1-2e66257d2e5b None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=c1e62aea382644f5ae6946d08a093180, role_id=e56e935653824c0d983483cabd28c5be)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:18.487058 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f05af-131c-4a25-a9e1-2e66257d2e5b None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:18.500081 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 617/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:19:18 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/c1e62aea382644f5ae6946d08a093180/roles/e56e935653824c0d983483cabd28c5be => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:21.051385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7220ebc-d2af-4d22-8cb6-6c1b482a8e13 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.051970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7220ebc-d2af-4d22-8cb6-6c1b482a8e13 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.051970 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7220ebc-d2af-4d22-8cb6-6c1b482a8e13 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.053797 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 616/1233] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:21.060066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa10c-f45e-4098-95df-9c41070ab88e None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.060605 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa10c-f45e-4098-95df-9c41070ab88e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.060691 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa10c-f45e-4098-95df-9c41070ab88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.079739 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-992fa10c-f45e-4098-95df-9c41070ab88e None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:21.081154 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-992fa10c-f45e-4098-95df-9c41070ab88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:21.157937 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 618/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:21.186625 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7220ebc-d2af-4d22-8cb6-6c1b482a8e13 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.294472 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7220ebc-d2af-4d22-8cb6-6c1b482a8e13 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.329262 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8584f-16c4-4de9-bd23-80d1c1e180d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.329816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8584f-16c4-4de9-bd23-80d1c1e180d6 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.330101 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8584f-16c4-4de9-bd23-80d1c1e180d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.330371 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8584f-16c4-4de9-bd23-80d1c1e180d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.341696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8584f-16c4-4de9-bd23-80d1c1e180d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-33b8584f-16c4-4de9-bd23-80d1c1e180d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:21.349695 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:21.351474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:21.352864 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 617/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:21.357556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fa10c-f45e-4098-95df-9c41070ab88e None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.474265 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fa10c-f45e-4098-95df-9c41070ab88e None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.511479 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.512179 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.512615 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.512734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.513475 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] RBAC: Adding query filter params (name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:21.513769 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.515129 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.524545 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 619/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:21.530611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8584f-16c4-4de9-bd23-80d1c1e180d6 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.647171 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8584f-16c4-4de9-bd23-80d1c1e180d6 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.682738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.683555 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.683873 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.684175 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.696419 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.697892 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:21.715541 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:21.716803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:21.717738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:21.717738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:21.717738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:21.717738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:21.717738 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 618/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:21.722918 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.832406 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9630f-2d1d-44fc-b4c6-86101da1ed1e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.869137 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.869797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.870104 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.870449 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.871351 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:21.871665 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.873351 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.887361 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 620/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:21.893499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.003523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beafe10-27ef-43bc-9775-b69d5450b318 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.037919 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.039208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.039520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.039828 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.047311 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.048780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:22.063664 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:22.065208 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:22.066282 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 619/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:22.074224 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.186339 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26709cf-4777-4560-b9eb-7a3a1ded8802 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.231722 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.232413 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.232694 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.232989 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.233873 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:22.234181 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.235604 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.253910 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 621/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:22.261259 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.374201 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89405c-22ae-4d92-984f-9f226f3e99cf None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.410925 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a0e85-dc8a-43b4-88da-b3d03554614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.411577 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0e85-dc8a-43b4-88da-b3d03554614e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.411893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0e85-dc8a-43b4-88da-b3d03554614e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.412169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0e85-dc8a-43b4-88da-b3d03554614e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.484312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a0e85-dc8a-43b4-88da-b3d03554614e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.485706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a0e85-dc8a-43b4-88da-b3d03554614e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.602973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 620/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:19:22.608813 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.714287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ba345-3059-4568-be62-0021a18a0590 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.753466 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.754299 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.754630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.754906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.766011 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.767442 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:22.787268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:22.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:22.789547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:22.789547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:22.789547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:22.789547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:22.789547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 622/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:22.795351 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a0e85-dc8a-43b4-88da-b3d03554614e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.909002 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a0e85-dc8a-43b4-88da-b3d03554614e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.946041 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.946822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.947166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.947444 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.948318 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:22.948676 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.950133 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.962729 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 621/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:22.968992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.079157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ecc9-96b7-4998-9583-7d42b90586d9 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.119318 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.120143 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.120425 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.120700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.127891 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.129439 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:23.144772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:23.145797 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:23.146819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 623/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:23.155526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.276813 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec7c0d-2a2c-4a84-8450-c9b5bae0e54e None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.313937 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462b4d8-51f5-491e-a64a-6f979b09624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.314605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462b4d8-51f5-491e-a64a-6f979b09624b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.314888 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462b4d8-51f5-491e-a64a-6f979b09624b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.315223 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462b4d8-51f5-491e-a64a-6f979b09624b None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.316107 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462b4d8-51f5-491e-a64a-6f979b09624b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:23.316408 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462b4d8-51f5-491e-a64a-6f979b09624b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.318070 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462b4d8-51f5-491e-a64a-6f979b09624b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.338503 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 622/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:23.339717 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.473822 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5ca51-286d-44cc-b7cf-3ff3d8f95cd1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.509727 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa64d8c-f465-4688-9a66-120c5ad09d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.510380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64d8c-f465-4688-9a66-120c5ad09d44 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.510663 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64d8c-f465-4688-9a66-120c5ad09d44 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.510939 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa64d8c-f465-4688-9a66-120c5ad09d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.511792 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa64d8c-f465-4688-9a66-120c5ad09d44 None admin] RBAC: Adding query filter params (role.id=e56e935653824c0d983483cabd28c5be, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=c1e62aea382644f5ae6946d08a093180) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:23.512150 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa64d8c-f465-4688-9a66-120c5ad09d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.514597 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa64d8c-f465-4688-9a66-120c5ad09d44 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.520296 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 624/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:19:23 2022] GET /identity/v3/role_assignments?user.id=c1e62aea382644f5ae6946d08a093180&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=e56e935653824c0d983483cabd28c5be => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:26.169899 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095138fe-2a1b-4a38-a6f7-a24bad59ef49 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:26.170516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095138fe-2a1b-4a38-a6f7-a24bad59ef49 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:26.170712 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095138fe-2a1b-4a38-a6f7-a24bad59ef49 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:26.172499 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 623/1247] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:26.178287 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ed2d-6554-45c1-a4f5-af5098aecbf7 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:26.179473 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ed2d-6554-45c1-a4f5-af5098aecbf7 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:26.179612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ed2d-6554-45c1-a4f5-af5098aecbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:26.199438 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-ee34ed2d-6554-45c1-a4f5-af5098aecbf7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:26.201259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-ee34ed2d-6554-45c1-a4f5-af5098aecbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:26.281077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 625/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:26.308302 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095138fe-2a1b-4a38-a6f7-a24bad59ef49 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:26.428859 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095138fe-2a1b-4a38-a6f7-a24bad59ef49 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:26.465523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf54ed8-32e2-4182-8e7f-078994a8e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:26.466297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54ed8-32e2-4182-8e7f-078994a8e051 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:26.466578 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54ed8-32e2-4182-8e7f-078994a8e051 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:26.466848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf54ed8-32e2-4182-8e7f-078994a8e051 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:26.479050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf54ed8-32e2-4182-8e7f-078994a8e051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-adf54ed8-32e2-4182-8e7f-078994a8e051 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:26.486809 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:26.487950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:26.493324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 624/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:26.496135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34ed2d-6554-45c1-a4f5-af5098aecbf7 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:26.604558 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34ed2d-6554-45c1-a4f5-af5098aecbf7 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:26.645206 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:26.645869 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:26.646167 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:26.646462 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:26.647333 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:26.648550 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:26.649961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:26.659201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 626/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:26.666375 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf54ed8-32e2-4182-8e7f-078994a8e051 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:26.784446 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf54ed8-32e2-4182-8e7f-078994a8e051 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:26.823894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:26.824714 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:26.824997 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:26.825444 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:26.840126 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:26.841688 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:26.863168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:26.864316 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:26.865336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:26.865336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:26.865336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:26.865336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:26.870115 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 625/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:26.870982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:26.988983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e3ca-24e4-43c3-ae69-4ffde8b8bce2 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.027983 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.028678 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.029055 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.029303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.030189 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:27.030519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.032076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.046147 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 627/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:27.052284 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.165680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08e77-2b26-45b9-bf26-7ee293c4f3fd None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.206817 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.207810 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.207964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.208311 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.217609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.219129 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:27.236918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:27.238203 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:27.239377 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 626/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:27.244334 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.354687 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a53b-0970-482d-acfd-a87ff79575b5 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.394309 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.395166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.395493 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.395979 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.397077 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:27.398085 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.399671 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.420707 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 628/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:27.426745 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.540260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb921def-0a0e-4726-8194-5cab19904b8f None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.578494 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e8db8-369c-430d-ac2c-4fa34502a8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8db8-369c-430d-ac2c-4fa34502a8ec None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.580061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8db8-369c-430d-ac2c-4fa34502a8ec None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.580325 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e8db8-369c-430d-ac2c-4fa34502a8ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.661740 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e8db8-369c-430d-ac2c-4fa34502a8ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.663344 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e8db8-369c-430d-ac2c-4fa34502a8ec None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.776056 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 627/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:19:27.782108 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.895839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04e187-861f-4d31-a971-67a42ccffdcd None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.933907 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.934838 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.935129 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.935420 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.948175 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.949651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:27.969583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:27.970938 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:27.972038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:27.972038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:27.972038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:27.972038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:27.972038 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 629/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:27.977152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e8db8-369c-430d-ac2c-4fa34502a8ec None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.086414 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e8db8-369c-430d-ac2c-4fa34502a8ec None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.126578 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.127371 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.127650 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.127955 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.128724 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:28.129063 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.130662 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.143863 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 628/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:28.149925 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.269607 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a35eb4-38cb-4b05-bc91-f96030724579 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.307694 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.308645 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.309056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.309334 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.316762 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.318236 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:28.334563 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:28.335968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:28.342943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 630/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:28.344095 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.454962 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812acf70-176d-44c2-a7ae-c1b68cadb4ec None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.490878 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe2f1e-84c0-4481-99b7-92c53a7227d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.491698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2f1e-84c0-4481-99b7-92c53a7227d2 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.492006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2f1e-84c0-4481-99b7-92c53a7227d2 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.492287 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2f1e-84c0-4481-99b7-92c53a7227d2 None admin] PATH_INFO: `/v3/projects` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.493185 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe2f1e-84c0-4481-99b7-92c53a7227d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:28.493496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe2f1e-84c0-4481-99b7-92c53a7227d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.495190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe2f1e-84c0-4481-99b7-92c53a7227d2 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.508166 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 629/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:28.514290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.623500 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf74d-3ac8-4796-b9a5-4de6e1e472f4 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.661699 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b9a8a-c07e-4c34-a67b-38258694e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.662346 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b9a8a-c07e-4c34-a67b-38258694e09d None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.662630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b9a8a-c07e-4c34-a67b-38258694e09d None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.662992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b9a8a-c07e-4c34-a67b-38258694e09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.663972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b9a8a-c07e-4c34-a67b-38258694e09d None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=c1e62aea382644f5ae6946d08a093180) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:28.664291 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b9a8a-c07e-4c34-a67b-38258694e09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.665853 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b9a8a-c07e-4c34-a67b-38258694e09d None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.671922 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 631/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:19:28 2022] GET /identity/v3/role_assignments?user.id=c1e62aea382644f5ae6946d08a093180&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:30.919036 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8474-1363-4e2b-b09a-256732063ca8 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:30.919550 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8474-1363-4e2b-b09a-256732063ca8 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:30.919550 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8474-1363-4e2b-b09a-256732063ca8 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:30.920918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 630/1261] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:30.926229 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4542f1-ac5a-407c-8fb4-eb9fdc699306 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:30.926617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4542f1-ac5a-407c-8fb4-eb9fdc699306 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:30.926793 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4542f1-ac5a-407c-8fb4-eb9fdc699306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:30.943086 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-7b4542f1-ac5a-407c-8fb4-eb9fdc699306 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:30.944675 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-7b4542f1-ac5a-407c-8fb4-eb9fdc699306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:31.008288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 632/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:31.031471 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8474-1363-4e2b-b09a-256732063ca8 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.127285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8474-1363-4e2b-b09a-256732063ca8 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.159483 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37124318-f8c1-4a7b-84fb-5c47b65e7dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.160285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37124318-f8c1-4a7b-84fb-5c47b65e7dae None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.160574 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37124318-f8c1-4a7b-84fb-5c47b65e7dae None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.160849 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37124318-f8c1-4a7b-84fb-5c47b65e7dae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.171994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37124318-f8c1-4a7b-84fb-5c47b65e7dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-37124318-f8c1-4a7b-84fb-5c47b65e7dae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:31.181167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:31.182235 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:31.183188 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 631/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:31.189055 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4542f1-ac5a-407c-8fb4-eb9fdc699306 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.295646 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4542f1-ac5a-407c-8fb4-eb9fdc699306 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.328850 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.329506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.329790 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.330066 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] PATH_INFO: `/v3/roles` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.330809 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:31.331115 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:31.332537 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:31.340872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 633/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:31.346716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37124318-f8c1-4a7b-84fb-5c47b65e7dae None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.441468 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37124318-f8c1-4a7b-84fb-5c47b65e7dae None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.474568 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.475469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.475873 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.476155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.486962 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:31.488439 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:31.505260 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:31.506248 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:31.507470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:31.507470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:31.507470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:31.507470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:31.507470 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 632/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:31.513499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.609181 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43589172-8fc2-4911-b504-321d9a1e31f7 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.641232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.641878 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.642160 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.642435 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.643156 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:31.643461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:31.644851 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:31.657006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 634/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:31.662606 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.758691 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2573b18-8b6a-47ca-bac3-4402764ddf22 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.801174 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.801974 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.802249 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.802570 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.812797 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:31.814261 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:31.833772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:31.835206 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:31.836155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 633/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:31.842426 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.937560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f564d-2e0a-4a32-a140-fae33e950d35 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.970643 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.971296 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.971578 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.971882 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] PATH_INFO: `/v3/users` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.972715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:31.973020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:31.974436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:31.990969 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 635/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:31.996506 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.090652 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab8aed-ebf7-41a1-8e4a-85e6307d85c7 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.129791 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.131006 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.131534 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.132042 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.144897 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.147466 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:32.166324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:32.167275 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:32.168147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:32.168147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:32.168147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.168147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:32.168147 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 634/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:32.174954 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.280186 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97040733-1ed8-4d38-89e5-92523fe4acd5 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.313973 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.314623 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.314905 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.315180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.315931 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:32.316237 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.317586 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.329486 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 636/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:32.335642 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.437954 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc70a8-8278-44be-9c26-c1fa5f84868d None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.470061 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.470844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.471128 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.471401 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.477873 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.479304 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:32.494040 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:32.495680 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:32.497696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 635/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:32.502665 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.601738 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a8366-22ae-4f88-89d4-1d08bd8676f7 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.633990 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170ee7-f834-406f-900d-0498fa497a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.634636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170ee7-f834-406f-900d-0498fa497a38 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.634921 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170ee7-f834-406f-900d-0498fa497a38 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.635196 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170ee7-f834-406f-900d-0498fa497a38 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.636008 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170ee7-f834-406f-900d-0498fa497a38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:32.636316 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170ee7-f834-406f-900d-0498fa497a38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.637726 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170ee7-f834-406f-900d-0498fa497a38 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.649528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 637/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:32.655456 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.751570 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954478-8e0e-4589-8426-25a9b5d20a2b None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.783593 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acd80b-e6a7-4f7b-bb3c-39177fdb52aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.784556 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acd80b-e6a7-4f7b-bb3c-39177fdb52aa None admin] REQUEST_METHOD: `PUT` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.784843 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acd80b-e6a7-4f7b-bb3c-39177fdb52aa None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.785118 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acd80b-e6a7-4f7b-bb3c-39177fdb52aa None admin] PATH_INFO: `/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/c1e62aea382644f5ae6946d08a093180/roles/d7fd37f44bdd4d578ce45a377558995f` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.787083 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acd80b-e6a7-4f7b-bb3c-39177fdb52aa None admin] RBAC: Authorizing `identity:create_grant(project_id=b4ed5fe17e5745efa75519d20eff72ab, user_id=c1e62aea382644f5ae6946d08a093180, role_id=d7fd37f44bdd4d578ce45a377558995f)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.789112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acd80b-e6a7-4f7b-bb3c-39177fdb52aa None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.801926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 636/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:19:32 2022] PUT /identity/v3/projects/b4ed5fe17e5745efa75519d20eff72ab/users/c1e62aea382644f5ae6946d08a093180/roles/d7fd37f44bdd4d578ce45a377558995f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:19:35.008007 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522c618-aab6-48c1-bfbf-3d46bddbd846 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.008529 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522c618-aab6-48c1-bfbf-3d46bddbd846 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.008633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522c618-aab6-48c1-bfbf-3d46bddbd846 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.009926 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 638/1274] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:35.015234 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0bc3c-c973-4c19-bc18-65ba67605cf1 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.015654 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0bc3c-c973-4c19-bc18-65ba67605cf1 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.015811 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0bc3c-c973-4c19-bc18-65ba67605cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.032507 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-64f0bc3c-c973-4c19-bc18-65ba67605cf1 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:35.033679 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-64f0bc3c-c973-4c19-bc18-65ba67605cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:35.096207 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 637/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:35.119902 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522c618-aab6-48c1-bfbf-3d46bddbd846 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.223785 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522c618-aab6-48c1-bfbf-3d46bddbd846 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.256056 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df6b2-4c60-4de6-bc7d-a97d1e1fc4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.257433 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df6b2-4c60-4de6-bc7d-a97d1e1fc4c1 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.257716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df6b2-4c60-4de6-bc7d-a97d1e1fc4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.257991 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df6b2-4c60-4de6-bc7d-a97d1e1fc4c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.267683 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577df6b2-4c60-4de6-bc7d-a97d1e1fc4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-577df6b2-4c60-4de6-bc7d-a97d1e1fc4c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:35.275279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:35.276341 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:35.277310 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 639/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:35.282524 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0bc3c-c973-4c19-bc18-65ba67605cf1 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.375498 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0bc3c-c973-4c19-bc18-65ba67605cf1 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.407403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.408087 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.408372 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.408706 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.409496 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.409805 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.411167 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.419189 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 638/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.424982 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df6b2-4c60-4de6-bc7d-a97d1e1fc4c1 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.520394 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df6b2-4c60-4de6-bc7d-a97d1e1fc4c1 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.551475 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.552268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.552554 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.552831 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.564286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.565731 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:35.582528 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:35.583362 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:35.585556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:35.585556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:35.585556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:35.585556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:35.585556 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 640/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:35.590212 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.684408 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9de97-116f-4d33-8ff2-2ecde54bb3f4 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.716297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.716949 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.717233 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.717508 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] PATH_INFO: `/v3/domains` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.718229 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.718537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.719926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.731742 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 639/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.737345 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.833776 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343bc81-c626-410d-a4da-6f1a0f31e454 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.866204 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.866992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.867273 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.867547 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] PATH_INFO: `/v3/users/placement` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.874907 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.876402 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:35.890772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:35.891810 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:35.892733 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 641/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:35.897823 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.993014 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e404a-e35c-4ca4-b879-503a054cf290 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.025060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.025723 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.026010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.026289 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] PATH_INFO: `/v3/users` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.027121 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:36.027432 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.028885 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.045078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 640/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:36.050752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.147846 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e611fe3-c846-43f4-8d19-e68264974eaf None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.190837 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e893e5-1be3-4a26-b383-626f3ca0a8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.191689 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e893e5-1be3-4a26-b383-626f3ca0a8cb None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.191962 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e893e5-1be3-4a26-b383-626f3ca0a8cb None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.192448 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e893e5-1be3-4a26-b383-626f3ca0a8cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.261281 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e893e5-1be3-4a26-b383-626f3ca0a8cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.262735 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e893e5-1be3-4a26-b383-626f3ca0a8cb None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.357111 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 642/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:19:36.362894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.460689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbecd0-563d-4711-af50-e523bdc1cedd None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.492050 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.492827 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.493105 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.493376 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.502741 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.504218 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:36.523096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:36.524048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:36.524920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:36.524920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:36.524920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:36.524920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:36.524920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 641/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:36.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e893e5-1be3-4a26-b383-626f3ca0a8cb None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.628359 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e893e5-1be3-4a26-b383-626f3ca0a8cb None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.661612 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.662259 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.662796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.663083 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] PATH_INFO: `/v3/domains` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.663829 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:36.664141 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.665506 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.676233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 643/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:36.682049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.776102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa946-7c56-4224-8bb7-66983c0a2a12 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.808058 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.808830 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.809110 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.809381 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.816140 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.817611 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:36.831973 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application with Lock( May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:36.832947 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: ERROR keystone.server.flask.application May 09 15:19:36.833858 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 642/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:36.839129 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.946398 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bccc37-64fc-4c93-89ff-6ccfbbd7e6c5 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.977730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71db5a0-c582-43d3-871d-acb21ebf89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.978379 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db5a0-c582-43d3-871d-acb21ebf89d6 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.978658 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db5a0-c582-43d3-871d-acb21ebf89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.978929 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db5a0-c582-43d3-871d-acb21ebf89d6 None admin] PATH_INFO: `/v3/projects` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.979704 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71db5a0-c582-43d3-871d-acb21ebf89d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:36.980034 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71db5a0-c582-43d3-871d-acb21ebf89d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.981451 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71db5a0-c582-43d3-871d-acb21ebf89d6 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.993286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 644/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:36.999384 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:37.095326 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ef253-9de1-4772-b5a5-f5e787695ab6 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:37.126964 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55c6ac-304a-422c-a34b-9088d73b1790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:37.127605 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55c6ac-304a-422c-a34b-9088d73b1790 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:37.127933 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55c6ac-304a-422c-a34b-9088d73b1790 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:37.128213 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55c6ac-304a-422c-a34b-9088d73b1790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:37.129043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55c6ac-304a-422c-a34b-9088d73b1790 None admin] RBAC: Adding query filter params (role.id=d7fd37f44bdd4d578ce45a377558995f, scope.project.id=b4ed5fe17e5745efa75519d20eff72ab, user.id=c1e62aea382644f5ae6946d08a093180) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:37.129354 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55c6ac-304a-422c-a34b-9088d73b1790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:37.130782 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55c6ac-304a-422c-a34b-9088d73b1790 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:37.137022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 643/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/role_assignments?user.id=c1e62aea382644f5ae6946d08a093180&scope.project.id=b4ed5fe17e5745efa75519d20eff72ab&role.id=d7fd37f44bdd4d578ce45a377558995f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:39.399821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865434c-26ee-44f5-b84f-f2820eb61b30 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.400353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865434c-26ee-44f5-b84f-f2820eb61b30 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.400353 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865434c-26ee-44f5-b84f-f2820eb61b30 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.401756 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 645/1288] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:39.406943 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62f2c3-80c2-422f-97e4-00955eb1d4d7 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.407366 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62f2c3-80c2-422f-97e4-00955eb1d4d7 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.407506 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62f2c3-80c2-422f-97e4-00955eb1d4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.424906 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-5c62f2c3-80c2-422f-97e4-00955eb1d4d7 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:39.426084 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-5c62f2c3-80c2-422f-97e4-00955eb1d4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:39.487914 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 644/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:19:39.510286 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865434c-26ee-44f5-b84f-f2820eb61b30 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.606889 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865434c-26ee-44f5-b84f-f2820eb61b30 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.639249 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.640061 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.640342 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.640614 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] PATH_INFO: `/v3/services/placement` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.641261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.642616 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:39.654380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:39.655498 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:39.656535 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 646/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:39.661583 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62f2c3-80c2-422f-97e4-00955eb1d4d7 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.755102 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62f2c3-80c2-422f-97e4-00955eb1d4d7 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.787296 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f553ffc-860c-41d5-b529-e88b393e2df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.788255 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553ffc-860c-41d5-b529-e88b393e2df1 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.788546 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553ffc-860c-41d5-b529-e88b393e2df1 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.788825 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f553ffc-860c-41d5-b529-e88b393e2df1 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.789536 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553ffc-860c-41d5-b529-e88b393e2df1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:39.789844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553ffc-860c-41d5-b529-e88b393e2df1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.791216 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f553ffc-860c-41d5-b529-e88b393e2df1 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.795863 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 645/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:39.801546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.905419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f203ad-bf62-4e17-8c70-c3401c4bbb3e None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.938571 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da527d-dd33-4be8-9e71-74be066664ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.939220 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da527d-dd33-4be8-9e71-74be066664ab None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.939504 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da527d-dd33-4be8-9e71-74be066664ab None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.939807 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da527d-dd33-4be8-9e71-74be066664ab None admin] PATH_INFO: `/v3/services` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.940510 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da527d-dd33-4be8-9e71-74be066664ab None admin] RBAC: Adding query filter params (type=placement) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:39.940815 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da527d-dd33-4be8-9e71-74be066664ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.942166 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da527d-dd33-4be8-9e71-74be066664ab None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.947534 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 647/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:42.193558 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb29c0-4f86-45e7-beae-51f3696ed4d4 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.194164 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb29c0-4f86-45e7-beae-51f3696ed4d4 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.194910 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb29c0-4f86-45e7-beae-51f3696ed4d4 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.196915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 646/1293] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:19:42.203472 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d91f9-9353-4774-8e41-c02c05744051 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.204029 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d91f9-9353-4774-8e41-c02c05744051 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.204162 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d91f9-9353-4774-8e41-c02c05744051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.222221 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-db0d91f9-9353-4774-8e41-c02c05744051 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:42.223438 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-db0d91f9-9353-4774-8e41-c02c05744051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:42.292994 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 648/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:42.315750 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb29c0-4f86-45e7-beae-51f3696ed4d4 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.410571 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb29c0-4f86-45e7-beae-51f3696ed4d4 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.442570 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0516171-2235-4b03-934e-e62cab0fe22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.443495 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516171-2235-4b03-934e-e62cab0fe22b None admin] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.443926 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516171-2235-4b03-934e-e62cab0fe22b None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.444155 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0516171-2235-4b03-934e-e62cab0fe22b None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.444856 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0516171-2235-4b03-934e-e62cab0fe22b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.446205 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0516171-2235-4b03-934e-e62cab0fe22b None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.458455 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 647/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:19:42 2022] POST /identity/v3/services => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:44.708694 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a28a8-ee14-453a-bd08-e50aa2d86c86 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:44.709940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a28a8-ee14-453a-bd08-e50aa2d86c86 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:44.709940 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a28a8-ee14-453a-bd08-e50aa2d86c86 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:44.711289 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 649/1296] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:44.716526 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864794-b2c4-4f1b-b6b2-db62e1108bea None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:44.716952 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864794-b2c4-4f1b-b6b2-db62e1108bea None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:44.717083 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35864794-b2c4-4f1b-b6b2-db62e1108bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:44.733849 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-35864794-b2c4-4f1b-b6b2-db62e1108bea None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:44.735015 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-35864794-b2c4-4f1b-b6b2-db62e1108bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:44.805777 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 648/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:44.828827 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a28a8-ee14-453a-bd08-e50aa2d86c86 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:44.925488 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a28a8-ee14-453a-bd08-e50aa2d86c86 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:44.958276 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:44.959593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:44.960084 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:44.960382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:44.961037 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:44.962391 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:44.973784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:44.974860 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:44.975698 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 650/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:19:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:44.981387 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35864794-b2c4-4f1b-b6b2-db62e1108bea None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.075592 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35864794-b2c4-4f1b-b6b2-db62e1108bea None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.107128 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.107793 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.108092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.108371 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.109078 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:45.109385 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:45.110769 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:45.116504 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 649/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:19:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:45.122423 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.219684 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8772472-9136-4f10-b8ee-936e1e7feaa4 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.252323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2e1e3-a3c0-4bc4-9133-a2106423de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.252964 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2e1e3-a3c0-4bc4-9133-a2106423de63 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.253251 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2e1e3-a3c0-4bc4-9133-a2106423de63 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.253530 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2e1e3-a3c0-4bc4-9133-a2106423de63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.254320 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2e1e3-a3c0-4bc4-9133-a2106423de63 None admin] RBAC: Adding query filter params (interface=public, service_id=c56c62f30ca14e8bab80befdbf316130, region_id=RegionOne) {{(pid=143187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:45.254633 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2e1e3-a3c0-4bc4-9133-a2106423de63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:45.256589 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2e1e3-a3c0-4bc4-9133-a2106423de63 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:45.261512 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 651/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:19:45 2022] GET /identity/v3/endpoints?service_id=c56c62f30ca14e8bab80befdbf316130&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:45.267019 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.361024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4f622-00d1-431b-94c1-091c03b84ac7 None admin] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.393637 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f44c-0afe-4cc2-b385-4749c5248f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.394283 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f44c-0afe-4cc2-b385-4749c5248f7a None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.394567 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f44c-0afe-4cc2-b385-4749c5248f7a None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.394842 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f44c-0afe-4cc2-b385-4749c5248f7a None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.395519 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f44c-0afe-4cc2-b385-4749c5248f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:45.397482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12f44c-0afe-4cc2-b385-4749c5248f7a None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:45.404112 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 650/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:19:45 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:19:47.616726 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6e91-73a8-4784-ac38-8f61509b4052 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.617240 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6e91-73a8-4784-ac38-8f61509b4052 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.617338 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b6e91-73a8-4784-ac38-8f61509b4052 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.618644 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 652/1302] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:47.624310 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1a88-2001-409d-b0cf-c53f2089214c None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.624708 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1a88-2001-409d-b0cf-c53f2089214c None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.624862 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1a88-2001-409d-b0cf-c53f2089214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.641186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-86ef1a88-2001-409d-b0cf-c53f2089214c None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:47.642361 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-86ef1a88-2001-409d-b0cf-c53f2089214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:47.704907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 651/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:19:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:19:47.727736 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b6e91-73a8-4784-ac38-8f61509b4052 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.827730 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b6e91-73a8-4784-ac38-8f61509b4052 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:47.861268 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:47.861962 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.862242 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.862513 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.863159 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:47.864560 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:47.877117 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:47.878210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application with Lock( May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: ERROR keystone.server.flask.application May 09 15:19:47.879201 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 653/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:47.887907 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef1a88-2001-409d-b0cf-c53f2089214c None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.982681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef1a88-2001-409d-b0cf-c53f2089214c None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.019862 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90cfa1-a4c7-4d8d-960f-46572ac6d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.020530 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90cfa1-a4c7-4d8d-960f-46572ac6d961 None admin] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.020816 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90cfa1-a4c7-4d8d-960f-46572ac6d961 None admin] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.021096 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90cfa1-a4c7-4d8d-960f-46572ac6d961 None admin] PATH_INFO: `/v3/services` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.022329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90cfa1-a4c7-4d8d-960f-46572ac6d961 None admin] RBAC: Adding query filter params (name=placement) {{(pid=143188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:48.022634 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90cfa1-a4c7-4d8d-960f-46572ac6d961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.024022 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90cfa1-a4c7-4d8d-960f-46572ac6d961 None admin] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.029013 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 652/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:48.034848 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.133278 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f546e4-a2b6-4514-a79e-11f28327fdf7 None admin] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.175879 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a9fd9-598a-41ec-a3cf-626b8c067685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d9969637e5400cad1f18de76cb1fd3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.176708 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9fd9-598a-41ec-a3cf-626b8c067685 None admin] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.177184 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9fd9-598a-41ec-a3cf-626b8c067685 None admin] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.177531 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a9fd9-598a-41ec-a3cf-626b8c067685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.178382 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a9fd9-598a-41ec-a3cf-626b8c067685 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.179972 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a9fd9-598a-41ec-a3cf-626b8c067685 None admin] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.211715 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 654/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:19:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:53.530299 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d9b5-a7aa-4aef-acd8-3e45f004a3d6 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:53.531393 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d9b5-a7aa-4aef-acd8-3e45f004a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:53.531945 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d9b5-a7aa-4aef-acd8-3e45f004a3d6 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:53.533587 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 653/1307] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:53.540943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56371cad-2445-4bb0-8363-b8949302bf34 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:53.541789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56371cad-2445-4bb0-8363-b8949302bf34 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:53.541789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56371cad-2445-4bb0-8363-b8949302bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:53.674330 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-56371cad-2445-4bb0-8363-b8949302bf34 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:53.675875 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-56371cad-2445-4bb0-8363-b8949302bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:53.786419 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 655/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:20:53.838146 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7e658-1c99-4b52-a94a-cf9477113258 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:53.838543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7e658-1c99-4b52-a94a-cf9477113258 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:53.839032 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7e658-1c99-4b52-a94a-cf9477113258 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:53.841013 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 654/1309] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 9 15:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:53.861301 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c845d7-1c8b-402f-998f-220479975094 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:53.861664 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c845d7-1c8b-402f-998f-220479975094 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:53.861944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c845d7-1c8b-402f-998f-220479975094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:54.041388 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-88c845d7-1c8b-402f-998f-220479975094 None None] MFA Rules not processed for user `a14b3bdef9874881aa5008410b4259df`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:54.042630 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-88c845d7-1c8b-402f-998f-220479975094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:54.205868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 656/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 9 15:20:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:20:54.206689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7e658-1c99-4b52-a94a-cf9477113258 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:54.208520 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-24b7e658-1c99-4b52-a94a-cf9477113258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:54.401951 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7e658-1c99-4b52-a94a-cf9477113258 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:54.485531 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b63a0-98d8-44bd-909c-02b0c603c894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:54.486581 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b63a0-98d8-44bd-909c-02b0c603c894 service neutron] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:54.487076 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b63a0-98d8-44bd-909c-02b0c603c894 service neutron] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:54.487562 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b63a0-98d8-44bd-909c-02b0c603c894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:54.489489 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-890b63a0-98d8-44bd-909c-02b0c603c894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:54.622355 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b63a0-98d8-44bd-909c-02b0c603c894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:54.624681 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b63a0-98d8-44bd-909c-02b0c603c894 service neutron] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:54.650158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 655/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:20:57.297794 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67592a-3a9f-4b71-aa0f-36d65bfcbf6c None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:57.298801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67592a-3a9f-4b71-aa0f-36d65bfcbf6c None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:57.299288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67592a-3a9f-4b71-aa0f-36d65bfcbf6c None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:57.306939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70435ee-51ca-4de0-b2c4-0eecdd371c9a None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:57.307939 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70435ee-51ca-4de0-b2c4-0eecdd371c9a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:57.308453 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70435ee-51ca-4de0-b2c4-0eecdd371c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:57.312049 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 657/1312] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:20:57 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:57.404194 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-c70435ee-51ca-4de0-b2c4-0eecdd371c9a None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:57.405868 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-c70435ee-51ca-4de0-b2c4-0eecdd371c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:57.524420 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 656/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:20:57.552092 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67592a-3a9f-4b71-aa0f-36d65bfcbf6c None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:57.554741 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-fe67592a-3a9f-4b71-aa0f-36d65bfcbf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:57.676682 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67592a-3a9f-4b71-aa0f-36d65bfcbf6c None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:57.762216 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf494f47-849b-43da-ac79-400935c89014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:57.763027 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf494f47-849b-43da-ac79-400935c89014 service neutron] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:57.763311 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf494f47-849b-43da-ac79-400935c89014 service neutron] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:57.763583 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf494f47-849b-43da-ac79-400935c89014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:57.765371 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-cf494f47-849b-43da-ac79-400935c89014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:57.886944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf494f47-849b-43da-ac79-400935c89014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:57.888767 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf494f47-849b-43da-ac79-400935c89014 service neutron] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:57.909593 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 658/1314] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:00.572048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484d1ec-79c2-4b9e-a853-1117c88134ef None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.572587 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484d1ec-79c2-4b9e-a853-1117c88134ef None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.572684 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484d1ec-79c2-4b9e-a853-1117c88134ef None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.574037 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 657/1315] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:00.579485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f086101-745d-4cdd-8c3b-911e774e0154 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.579968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f086101-745d-4cdd-8c3b-911e774e0154 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.580142 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f086101-745d-4cdd-8c3b-911e774e0154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.644210 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-2f086101-745d-4cdd-8c3b-911e774e0154 None None] MFA Rules not processed for user `2f8289df6b1c456881b14587b19133f7`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:00.645436 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-2f086101-745d-4cdd-8c3b-911e774e0154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:00.741821 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 659/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:00.781567 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484d1ec-79c2-4b9e-a853-1117c88134ef None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:00.783091 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-7484d1ec-79c2-4b9e-a853-1117c88134ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:00.882915 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484d1ec-79c2-4b9e-a853-1117c88134ef None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:00.950865 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59cec6-293f-4da5-85fd-bcd92070efd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:00.951497 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59cec6-293f-4da5-85fd-bcd92070efd5 service neutron] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.951799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59cec6-293f-4da5-85fd-bcd92070efd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.952086 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59cec6-293f-4da5-85fd-bcd92070efd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.953696 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-6d59cec6-293f-4da5-85fd-bcd92070efd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:01.056257 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59cec6-293f-4da5-85fd-bcd92070efd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:01.057635 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59cec6-293f-4da5-85fd-bcd92070efd5 service neutron] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:01.076094 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 658/1317] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:03.876493 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb7a9-0fa3-435e-b623-c3d1fe80909e None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:03.877006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb7a9-0fa3-435e-b623-c3d1fe80909e None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:03.877006 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edb7a9-0fa3-435e-b623-c3d1fe80909e None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:03.878351 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 660/1318] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:03.884477 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545460-6d87-47fc-a4b9-e95bc3453204 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:03.884918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545460-6d87-47fc-a4b9-e95bc3453204 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:03.885018 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545460-6d87-47fc-a4b9-e95bc3453204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:03.946516 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-e7545460-6d87-47fc-a4b9-e95bc3453204 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:03.947689 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-e7545460-6d87-47fc-a4b9-e95bc3453204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:04.037883 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 659/1319] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:04.092906 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c51a-0f71-4ecd-9f71-7e1573d8aec6 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:04.093188 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c51a-0f71-4ecd-9f71-7e1573d8aec6 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:04.093460 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c51a-0f71-4ecd-9f71-7e1573d8aec6 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:04.094819 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 661/1320] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 9 15:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:04.101711 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905c5f-ece6-41dd-8bc5-b23e49023fb2 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:04.102005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905c5f-ece6-41dd-8bc5-b23e49023fb2 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:04.102285 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2905c5f-ece6-41dd-8bc5-b23e49023fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:04.173950 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-f2905c5f-ece6-41dd-8bc5-b23e49023fb2 None None] MFA Rules not processed for user `a14b3bdef9874881aa5008410b4259df`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:04.175085 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-f2905c5f-ece6-41dd-8bc5-b23e49023fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:04.254330 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 660/1321] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 9 15:21:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:21:04.263727 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1c51a-0f71-4ecd-9f71-7e1573d8aec6 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:04.265290 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-66a1c51a-0f71-4ecd-9f71-7e1573d8aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:04.366463 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1c51a-0f71-4ecd-9f71-7e1573d8aec6 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:04.437757 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8825a0-9c3f-40f9-967b-e147eecc3dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:04.438403 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8825a0-9c3f-40f9-967b-e147eecc3dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:04.438687 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8825a0-9c3f-40f9-967b-e147eecc3dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:04.438962 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8825a0-9c3f-40f9-967b-e147eecc3dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:04.440636 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-dc8825a0-9c3f-40f9-967b-e147eecc3dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:04.545023 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8825a0-9c3f-40f9-967b-e147eecc3dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:04.546445 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8825a0-9c3f-40f9-967b-e147eecc3dd1 service neutron] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:04.563961 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 662/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:07.916222 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e5649-cdac-4b9d-a7ee-0bbcdf66a374 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:07.916752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e5649-cdac-4b9d-a7ee-0bbcdf66a374 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:07.916752 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e5649-cdac-4b9d-a7ee-0bbcdf66a374 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:07.918168 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 661/1323] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:07.923433 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48d215-36cd-4dfa-a025-bc5924837a4f None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:07.923872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48d215-36cd-4dfa-a025-bc5924837a4f None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:07.924146 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48d215-36cd-4dfa-a025-bc5924837a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:07.987622 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-dd48d215-36cd-4dfa-a025-bc5924837a4f None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:07.988866 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-dd48d215-36cd-4dfa-a025-bc5924837a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:08.082469 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 663/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:08.117832 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e5649-cdac-4b9d-a7ee-0bbcdf66a374 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:08.119363 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-321e5649-cdac-4b9d-a7ee-0bbcdf66a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:08.221085 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e5649-cdac-4b9d-a7ee-0bbcdf66a374 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:08.292043 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932661f-8818-4b1a-aaa1-9672f18d168a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:08.292697 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932661f-8818-4b1a-aaa1-9672f18d168a service neutron] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:08.292976 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932661f-8818-4b1a-aaa1-9672f18d168a service neutron] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:08.293246 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932661f-8818-4b1a-aaa1-9672f18d168a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:08.294887 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-8932661f-8818-4b1a-aaa1-9672f18d168a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:08.399979 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932661f-8818-4b1a-aaa1-9672f18d168a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:08.401421 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932661f-8818-4b1a-aaa1-9672f18d168a service neutron] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:08.419035 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 662/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:10.756729 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e759b-e506-4ac5-b971-dbd447a642ad None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:10.757234 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e759b-e506-4ac5-b971-dbd447a642ad None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:10.757234 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e759b-e506-4ac5-b971-dbd447a642ad None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:10.758611 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 664/1326] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:10.763890 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36881-15a2-4095-be4d-bb1a2f06914f None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:10.764324 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36881-15a2-4095-be4d-bb1a2f06914f None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:10.764570 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36881-15a2-4095-be4d-bb1a2f06914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:10.827983 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-5ee36881-15a2-4095-be4d-bb1a2f06914f None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:10.829177 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-5ee36881-15a2-4095-be4d-bb1a2f06914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:10.921308 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 663/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:10.956765 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e759b-e506-4ac5-b971-dbd447a642ad None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:10.958269 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-189e759b-e506-4ac5-b971-dbd447a642ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:11.058466 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e759b-e506-4ac5-b971-dbd447a642ad None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:11.138847 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a628871-c0e6-4b79-bb27-92734014bb80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:11.139485 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628871-c0e6-4b79-bb27-92734014bb80 service neutron] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:11.139789 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628871-c0e6-4b79-bb27-92734014bb80 service neutron] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:11.140069 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a628871-c0e6-4b79-bb27-92734014bb80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:11.141686 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-1a628871-c0e6-4b79-bb27-92734014bb80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:11.248447 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a628871-c0e6-4b79-bb27-92734014bb80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:11.249876 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a628871-c0e6-4b79-bb27-92734014bb80 service neutron] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:11.267288 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 665/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:13.628957 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c420-6eea-4233-b88d-2d57aff53c93 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:13.629430 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c420-6eea-4233-b88d-2d57aff53c93 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:13.629557 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2c420-6eea-4233-b88d-2d57aff53c93 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:13.631535 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 664/1329] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:13.636707 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb10cc-658d-40f0-81bf-98b8b8ec1ec6 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:13.637135 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb10cc-658d-40f0-81bf-98b8b8ec1ec6 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:13.637258 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb10cc-658d-40f0-81bf-98b8b8ec1ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:13.700734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-6beb10cc-658d-40f0-81bf-98b8b8ec1ec6 None None] MFA Rules not processed for user `2f8289df6b1c456881b14587b19133f7`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:13.701933 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-6beb10cc-658d-40f0-81bf-98b8b8ec1ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:13.795839 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 666/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:13.835732 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2c420-6eea-4233-b88d-2d57aff53c93 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:13.837273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-aaa2c420-6eea-4233-b88d-2d57aff53c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:13.939379 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2c420-6eea-4233-b88d-2d57aff53c93 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:14.012197 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c4dda-21a9-4de0-b4b5-e25735add118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:14.012849 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c4dda-21a9-4de0-b4b5-e25735add118 service neutron] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:14.013132 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c4dda-21a9-4de0-b4b5-e25735add118 service neutron] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:14.013406 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c4dda-21a9-4de0-b4b5-e25735add118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:14.015054 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-4d9c4dda-21a9-4de0-b4b5-e25735add118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:14.118736 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c4dda-21a9-4de0-b4b5-e25735add118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:14.120151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c4dda-21a9-4de0-b4b5-e25735add118 service neutron] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:14.138103 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 665/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:21:16.673303 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390d63-46dc-48b0-8773-74f7c01b0bb5 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:16.673852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390d63-46dc-48b0-8773-74f7c01b0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:16.673852 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390d63-46dc-48b0-8773-74f7c01b0bb5 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:16.675215 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 667/1332] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:16.680670 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586918c8-27d1-43b7-bdeb-3f6240cff38c None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:16.681100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586918c8-27d1-43b7-bdeb-3f6240cff38c None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:16.681240 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586918c8-27d1-43b7-bdeb-3f6240cff38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:16.743772 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-586918c8-27d1-43b7-bdeb-3f6240cff38c None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:16.744993 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-586918c8-27d1-43b7-bdeb-3f6240cff38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:16.838049 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 666/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:16.873157 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71390d63-46dc-48b0-8773-74f7c01b0bb5 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:16.874667 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-71390d63-46dc-48b0-8773-74f7c01b0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:16.974883 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71390d63-46dc-48b0-8773-74f7c01b0bb5 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:17.044519 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7366-d2a8-4b8f-989c-a753fdd91d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:17.045148 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7366-d2a8-4b8f-989c-a753fdd91d7e service neutron] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:17.045427 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7366-d2a8-4b8f-989c-a753fdd91d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:17.045700 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7366-d2a8-4b8f-989c-a753fdd91d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:17.047304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-fb2b7366-d2a8-4b8f-989c-a753fdd91d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:17.151968 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7366-d2a8-4b8f-989c-a753fdd91d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:17.153304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7366-d2a8-4b8f-989c-a753fdd91d7e service neutron] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:17.170763 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 668/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:19.452323 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8a3e-19c6-48d8-a71c-8d6453f001bf None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.452894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8a3e-19c6-48d8-a71c-8d6453f001bf None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.452894 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc8a3e-19c6-48d8-a71c-8d6453f001bf None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.454258 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 667/1335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:19.460261 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62283fd-9c6d-4bf4-8a39-3159062f0ee6 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.460686 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62283fd-9c6d-4bf4-8a39-3159062f0ee6 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.460801 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62283fd-9c6d-4bf4-8a39-3159062f0ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.524716 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-b62283fd-9c6d-4bf4-8a39-3159062f0ee6 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:19.525919 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-b62283fd-9c6d-4bf4-8a39-3159062f0ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:19.620282 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 669/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:19.660179 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8a3e-19c6-48d8-a71c-8d6453f001bf None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:19.661765 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-b3dc8a3e-19c6-48d8-a71c-8d6453f001bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:19.761626 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc8a3e-19c6-48d8-a71c-8d6453f001bf None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:19.834329 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3fd4b-0fb2-40af-bb74-ce0951eece9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:19.834981 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3fd4b-0fb2-40af-bb74-ce0951eece9c service neutron] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.835297 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3fd4b-0fb2-40af-bb74-ce0951eece9c service neutron] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.835575 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3fd4b-0fb2-40af-bb74-ce0951eece9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.837277 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-60f3fd4b-0fb2-40af-bb74-ce0951eece9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:19.947152 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3fd4b-0fb2-40af-bb74-ce0951eece9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:19.948645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3fd4b-0fb2-40af-bb74-ce0951eece9c service neutron] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:19.966744 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 668/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:22.593746 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de880e-0c70-417c-b2d7-d245959cee40 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:22.594194 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de880e-0c70-417c-b2d7-d245959cee40 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:22.594284 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de880e-0c70-417c-b2d7-d245959cee40 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:22.595659 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 670/1338] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:22.601482 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bdc7b-d36a-483d-93ba-231f8f14f7bb None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:22.601893 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bdc7b-d36a-483d-93ba-231f8f14f7bb None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:22.602052 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bdc7b-d36a-483d-93ba-231f8f14f7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:22.664848 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-6d7bdc7b-d36a-483d-93ba-231f8f14f7bb None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:22.666075 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-6d7bdc7b-d36a-483d-93ba-231f8f14f7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:22.759186 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 669/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:22.795427 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de880e-0c70-417c-b2d7-d245959cee40 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:22.796988 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-48de880e-0c70-417c-b2d7-d245959cee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:22.896992 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de880e-0c70-417c-b2d7-d245959cee40 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:22.966161 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe2fb1-b803-4960-98a8-beb0f1c5fa9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:22.966798 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2fb1-b803-4960-98a8-beb0f1c5fa9b service neutron] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:22.967081 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2fb1-b803-4960-98a8-beb0f1c5fa9b service neutron] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:22.967354 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe2fb1-b803-4960-98a8-beb0f1c5fa9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:22.969020 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-4cfe2fb1-b803-4960-98a8-beb0f1c5fa9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:23.073880 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe2fb1-b803-4960-98a8-beb0f1c5fa9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:23.075304 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe2fb1-b803-4960-98a8-beb0f1c5fa9b service neutron] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:23.093869 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 671/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:27.341232 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263cb6d-304f-471c-b0b2-42b8de2cc317 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:27.341794 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263cb6d-304f-471c-b0b2-42b8de2cc317 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:27.341794 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263cb6d-304f-471c-b0b2-42b8de2cc317 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:27.343070 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 670/1341] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:27.348367 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd991-9185-4190-89a3-24965be07539 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:27.348796 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd991-9185-4190-89a3-24965be07539 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:27.349162 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd991-9185-4190-89a3-24965be07539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:27.416677 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-92dfd991-9185-4190-89a3-24965be07539 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:27.417772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-92dfd991-9185-4190-89a3-24965be07539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:27.517958 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 672/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:27.556719 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263cb6d-304f-471c-b0b2-42b8de2cc317 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:27.559074 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-3263cb6d-304f-471c-b0b2-42b8de2cc317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:27.655028 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263cb6d-304f-471c-b0b2-42b8de2cc317 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:27.658615 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff34eff-8d57-45c4-88db-76bdfcf698b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:27.659258 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34eff-8d57-45c4-88db-76bdfcf698b1 service neutron] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:27.659538 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34eff-8d57-45c4-88db-76bdfcf698b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:27.659839 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34eff-8d57-45c4-88db-76bdfcf698b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:27.668844 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34eff-8d57-45c4-88db-76bdfcf698b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:27.670190 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34eff-8d57-45c4-88db-76bdfcf698b1 service neutron] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:27.680158 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 671/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:30.496311 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f438-70b9-410c-85e2-c9da9f2b8dda None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:30.496877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f438-70b9-410c-85e2-c9da9f2b8dda None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:30.496877 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f438-70b9-410c-85e2-c9da9f2b8dda None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:30.498233 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 673/1344] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:30.503431 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2a807-6d1c-4bbe-a49c-7ce3f24290de None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:30.503854 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2a807-6d1c-4bbe-a49c-7ce3f24290de None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:30.504048 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2a807-6d1c-4bbe-a49c-7ce3f24290de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:30.531952 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-67a2a807-6d1c-4bbe-a49c-7ce3f24290de None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:30.533060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-67a2a807-6d1c-4bbe-a49c-7ce3f24290de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:30.607877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 672/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:30.644657 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f438-70b9-410c-85e2-c9da9f2b8dda None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:30.656323 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f438-70b9-410c-85e2-c9da9f2b8dda None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:30.660264 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea0f48-c550-473a-b586-d5e49a0f5363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:30.661784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea0f48-c550-473a-b586-d5e49a0f5363 service neutron] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:30.662297 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea0f48-c550-473a-b586-d5e49a0f5363 service neutron] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:30.662872 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea0f48-c550-473a-b586-d5e49a0f5363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:30.672703 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea0f48-c550-473a-b586-d5e49a0f5363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:30.674499 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea0f48-c550-473a-b586-d5e49a0f5363 service neutron] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:30.695336 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 674/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:35.036645 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204595-de9c-4ce0-8f76-a71f5b3c06b9 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:35.037388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204595-de9c-4ce0-8f76-a71f5b3c06b9 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:35.037388 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204595-de9c-4ce0-8f76-a71f5b3c06b9 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:35.038713 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 673/1347] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:35.045232 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6da72a-23a0-4511-a284-9abdcb72296c None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:35.045701 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6da72a-23a0-4511-a284-9abdcb72296c None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:35.045787 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6da72a-23a0-4511-a284-9abdcb72296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:35.064834 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-ca6da72a-23a0-4511-a284-9abdcb72296c None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:35.066034 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-ca6da72a-23a0-4511-a284-9abdcb72296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:35.074866 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 675/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:35.112617 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85204595-de9c-4ce0-8f76-a71f5b3c06b9 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:35.124024 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85204595-de9c-4ce0-8f76-a71f5b3c06b9 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:35.127476 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb15e8-d3cb-40ab-bccd-84414a0e4adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a14b3bdef9874881aa5008410b4259df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:35.128151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb15e8-d3cb-40ab-bccd-84414a0e4adb service neutron] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:35.128436 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb15e8-d3cb-40ab-bccd-84414a0e4adb service neutron] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:35.128739 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb15e8-d3cb-40ab-bccd-84414a0e4adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:35.137801 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb15e8-d3cb-40ab-bccd-84414a0e4adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:35.139228 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb15e8-d3cb-40ab-bccd-84414a0e4adb service neutron] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:35.148813 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 674/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:40.648752 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919057-ca36-4a74-adf7-2ceec0150c0b None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:40.649235 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919057-ca36-4a74-adf7-2ceec0150c0b None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:40.649329 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c919057-ca36-4a74-adf7-2ceec0150c0b None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:40.650748 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 676/1350] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:40.655716 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78419e0-968e-4271-a96b-33b433394438 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:40.656322 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78419e0-968e-4271-a96b-33b433394438 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:40.656609 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78419e0-968e-4271-a96b-33b433394438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:40.729396 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-c78419e0-968e-4271-a96b-33b433394438 None None] MFA Rules not processed for user `c1e62aea382644f5ae6946d08a093180`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:40.731298 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-c78419e0-968e-4271-a96b-33b433394438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:40.827958 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 675/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:21:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:45.253386 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873f28d-18a6-4c53-819d-8a8c55eab879 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:45.255255 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873f28d-18a6-4c53-819d-8a8c55eab879 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:45.255642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873f28d-18a6-4c53-819d-8a8c55eab879 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:45.257083 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 677/1352] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:21:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:45.262169 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1a23-1654-4dbd-9537-37cfa0798e32 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:45.263007 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1a23-1654-4dbd-9537-37cfa0798e32 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:45.263523 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1a23-1654-4dbd-9537-37cfa0798e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:45.283177 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-ccbb1a23-1654-4dbd-9537-37cfa0798e32 None None] MFA Rules not processed for user `c1e62aea382644f5ae6946d08a093180`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:45.284920 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-ccbb1a23-1654-4dbd-9537-37cfa0798e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:45.295005 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 676/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:21:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:46.947461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da023c98-c612-47ea-b1e3-571f69890a3a None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:46.948017 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da023c98-c612-47ea-b1e3-571f69890a3a None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:46.948098 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da023c98-c612-47ea-b1e3-571f69890a3a None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:46.949430 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 678/1354] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:46.954537 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcc36c-11a4-4b35-9dbb-f76821004a32 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:46.954955 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcc36c-11a4-4b35-9dbb-f76821004a32 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:46.955100 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcc36c-11a4-4b35-9dbb-f76821004a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:46.973659 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-dcbcc36c-11a4-4b35-9dbb-f76821004a32 None None] MFA Rules not processed for user `c1e62aea382644f5ae6946d08a093180`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:46.974822 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-dcbcc36c-11a4-4b35-9dbb-f76821004a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:46.984151 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 677/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:21:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:21:50.915579 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19511-9f1a-4c2b-bd3f-a5ef0029861a None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:50.916734 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19511-9f1a-4c2b-bd3f-a5ef0029861a None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:50.917470 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19511-9f1a-4c2b-bd3f-a5ef0029861a None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:50.919868 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 679/1356] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:50.925543 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119215d9-5b82-471f-8c23-0db254db657a None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:50.927971 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119215d9-5b82-471f-8c23-0db254db657a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:50.933803 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119215d9-5b82-471f-8c23-0db254db657a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:50.958474 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-119215d9-5b82-471f-8c23-0db254db657a None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:50.960312 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-119215d9-5b82-471f-8c23-0db254db657a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:50.970036 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 678/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:51.018209 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6263-737d-4019-bce4-382e74710fa5 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:51.018651 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6263-737d-4019-bce4-382e74710fa5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:51.019013 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6263-737d-4019-bce4-382e74710fa5 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:51.021076 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 680/1358] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 9 15:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:51.026891 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5b06c-9c6f-4c00-9c85-c7da037fc700 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:51.027314 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5b06c-9c6f-4c00-9c85-c7da037fc700 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:51.027607 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5b06c-9c6f-4c00-9c85-c7da037fc700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:51.075469 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-87c5b06c-9c6f-4c00-9c85-c7da037fc700 None None] MFA Rules not processed for user `865e4a29d11c4000988326f5ce35b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:51.076698 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-87c5b06c-9c6f-4c00-9c85-c7da037fc700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:51.158923 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 679/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 9 15:21:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:51.167180 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6263-737d-4019-bce4-382e74710fa5 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:51.185254 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6263-737d-4019-bce4-382e74710fa5 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:51.192772 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6a31b-1264-485c-a340-66002548f4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865e4a29d11c4000988326f5ce35b25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:51.193579 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6a31b-1264-485c-a340-66002548f4b6 service nova] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:51.194003 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6a31b-1264-485c-a340-66002548f4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:51.194417 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6a31b-1264-485c-a340-66002548f4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:51.204761 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6a31b-1264-485c-a340-66002548f4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:51.206623 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6a31b-1264-485c-a340-66002548f4b6 service nova] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:51.218334 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 681/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:53.704918 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c71b-3de6-43a1-896a-fe5ea25472ca None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:53.705356 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c71b-3de6-43a1-896a-fe5ea25472ca None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:53.705473 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c71b-3de6-43a1-896a-fe5ea25472ca None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:53.706853 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 680/1361] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:53.712477 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18071e-7071-45f5-8642-0e462f59a9a3 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:53.712913 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18071e-7071-45f5-8642-0e462f59a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:53.713032 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18071e-7071-45f5-8642-0e462f59a9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:53.731617 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-dc18071e-7071-45f5-8642-0e462f59a9a3 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:53.732943 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-dc18071e-7071-45f5-8642-0e462f59a9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:53.741538 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 682/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:53.787092 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c71b-3de6-43a1-896a-fe5ea25472ca None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:53.803170 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c71b-3de6-43a1-896a-fe5ea25472ca None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:53.808845 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe39e46-af2d-4740-ad7d-c4e97238a465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865e4a29d11c4000988326f5ce35b25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:53.809493 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39e46-af2d-4740-ad7d-c4e97238a465 service nova] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:53.809781 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39e46-af2d-4740-ad7d-c4e97238a465 service nova] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:53.810060 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39e46-af2d-4740-ad7d-c4e97238a465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:53.819593 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe39e46-af2d-4740-ad7d-c4e97238a465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:53.821418 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe39e46-af2d-4740-ad7d-c4e97238a465 service nova] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:53.839416 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 681/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:56.389446 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a1d2-7b04-4c67-a5a9-f0019a03e138 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:56.390050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a1d2-7b04-4c67-a5a9-f0019a03e138 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:56.390050 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125a1d2-7b04-4c67-a5a9-f0019a03e138 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:56.391279 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 683/1364] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:56.397245 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363d012-4570-4636-84e5-e2e1f9b5b317 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:56.397710 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363d012-4570-4636-84e5-e2e1f9b5b317 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:56.397831 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363d012-4570-4636-84e5-e2e1f9b5b317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:56.417655 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-b363d012-4570-4636-84e5-e2e1f9b5b317 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:56.419029 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-b363d012-4570-4636-84e5-e2e1f9b5b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:56.431827 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 682/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:56.474369 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6080ca2-0653-4cfa-a829-5a6a3bf7c0c5 None None] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:56.474784 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6080ca2-0653-4cfa-a829-5a6a3bf7c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:56.475165 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6080ca2-0653-4cfa-a829-5a6a3bf7c0c5 None None] PATH_INFO: `/` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:56.476832 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 684/1366] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 9 15:21:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:56.482273 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0454-ab92-4321-aefb-5f37fad77130 None None] REQUEST_METHOD: `POST` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:56.482671 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0454-ab92-4321-aefb-5f37fad77130 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:56.483073 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0454-ab92-4321-aefb-5f37fad77130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:56.501336 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.auth.core [None req-af1a0454-ab92-4321-aefb-5f37fad77130 None None] MFA Rules not processed for user `865e4a29d11c4000988326f5ce35b25b`. Rule list: `[]` (Enabled: `True`). {{(pid=143188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:56.502780 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.fernet_utils [None req-af1a0454-ab92-4321-aefb-5f37fad77130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:56.512799 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 683/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 9 15:21:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:56.521270 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6080ca2-0653-4cfa-a829-5a6a3bf7c0c5 None None] Authenticating user token {{(pid=143187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:56.536380 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6080ca2-0653-4cfa-a829-5a6a3bf7c0c5 None None] Validating token access rules against request {{(pid=143187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:56.542065 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24159f2b-a0ac-4937-a5f0-75b7cca04250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865e4a29d11c4000988326f5ce35b25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:56.542836 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159f2b-a0ac-4937-a5f0-75b7cca04250 service nova] REQUEST_METHOD: `GET` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:56.543124 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159f2b-a0ac-4937-a5f0-75b7cca04250 service nova] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:56.543397 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159f2b-a0ac-4937-a5f0-75b7cca04250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:56.552908 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24159f2b-a0ac-4937-a5f0-75b7cca04250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:56.554484 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24159f2b-a0ac-4937-a5f0-75b7cca04250 service nova] RBAC: Authorization granted {{(pid=143187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:56.564823 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 685/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:21:57.409589 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c42ed-6112-45cd-b614-f2c9eeaec38a None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:57.410070 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c42ed-6112-45cd-b614-f2c9eeaec38a None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:57.410882 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c42ed-6112-45cd-b614-f2c9eeaec38a None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:57.412295 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 684/1369] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:57.418052 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a706e7-a1b5-4b73-b01b-97da6ff542ad None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:57.418546 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a706e7-a1b5-4b73-b01b-97da6ff542ad None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:57.418642 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a706e7-a1b5-4b73-b01b-97da6ff542ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:57.437134 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-a7a706e7-a1b5-4b73-b01b-97da6ff542ad None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:57.438377 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-a7a706e7-a1b5-4b73-b01b-97da6ff542ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:57.448503 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 686/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:58.913325 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ce90-661a-4725-a0e3-9dbec5dee072 None None] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:58.913877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ce90-661a-4725-a0e3-9dbec5dee072 None None] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:58.913877 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6ce90-661a-4725-a0e3-9dbec5dee072 None None] PATH_INFO: `/` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:58.915157 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 685/1371] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:58.920553 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e0e9-eb10-4188-b89e-d1fb8f995ab8 None None] REQUEST_METHOD: `POST` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:58.920963 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e0e9-eb10-4188-b89e-d1fb8f995ab8 None None] SCRIPT_NAME: `/identity` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:58.921118 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e0e9-eb10-4188-b89e-d1fb8f995ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:58.938944 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.auth.core [None req-29b9e0e9-eb10-4188-b89e-d1fb8f995ab8 None None] MFA Rules not processed for user `51d9969637e5400cad1f18de76cb1fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=143187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:58.940182 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: DEBUG keystone.common.fernet_utils [None req-29b9e0e9-eb10-4188-b89e-d1fb8f995ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:58.948818 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: [pid: 143187|app: 0|req: 687/1372] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:21:58.993010 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6ce90-661a-4725-a0e3-9dbec5dee072 None None] Authenticating user token {{(pid=143188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:59.007994 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6ce90-661a-4725-a0e3-9dbec5dee072 None None] Validating token access rules against request {{(pid=143188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:59.013403 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff81e8-f503-4304-b63e-86e942cf6300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865e4a29d11c4000988326f5ce35b25b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4ed5fe17e5745efa75519d20eff72ab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:59.014074 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff81e8-f503-4304-b63e-86e942cf6300 service nova] REQUEST_METHOD: `GET` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:59.014361 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff81e8-f503-4304-b63e-86e942cf6300 service nova] SCRIPT_NAME: `/identity` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:59.014641 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff81e8-f503-4304-b63e-86e942cf6300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:59.023872 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff81e8-f503-4304-b63e-86e942cf6300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:59.025502 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff81e8-f503-4304-b63e-86e942cf6300 service nova] RBAC: Authorization granted {{(pid=143188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:59.035567 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: [pid: 143188|app: 0|req: 686/1373] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:22:20.994749 dv-cinder-841125-1-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 09 15:22:20.994988 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: Mon May 9 15:22:20 2022 - graceful shutdown triggered... May 09 15:22:20.995461 dv-cinder-841125-1-iscsi devstack@keystone.service[143187]: Gracefully killing worker 1 (pid: 143187)... May 09 15:22:20.996098 dv-cinder-841125-1-iscsi devstack@keystone.service[143188]: Gracefully killing worker 2 (pid: 143188)... May 09 15:22:21.996117 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: worker 1 buried after 1 seconds May 09 15:22:21.996117 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: worker 2 buried after 1 seconds May 09 15:22:21.996661 dv-cinder-841125-1-iscsi devstack@keystone.service[143171]: goodbye to uWSGI. May 09 15:22:21.997772 dv-cinder-841125-1-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 09 15:22:21.998307 dv-cinder-841125-1-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 09 15:27:46.009748 dv-cinder-841125-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 15:27:46.019924 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 15:27:46.022822 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 15:27:46 2022] *** May 09 15:27:46.023080 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 15:27:46.023283 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 15:27:46.023452 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: nodename: dv-cinder-841125-1-iscsi May 09 15:27:46.023630 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: machine: x86_64 May 09 15:27:46.023840 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: clock source: unix May 09 15:27:46.024003 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: pcre jit disabled May 09 15:27:46.024164 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: detected number of CPU cores: 4 May 09 15:27:46.024336 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: current working directory: / May 09 15:27:46.024497 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: detected binary path: /usr/bin/uwsgi-core May 09 15:27:46.024664 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: your processes number limit is 47680 May 09 15:27:46.024836 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: your memory page size is 4096 bytes May 09 15:27:46.025006 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: detected max file descriptor number: 2048 May 09 15:27:46.025168 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: lock engine: pthread robust mutexes May 09 15:27:46.025500 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: thunder lock: enabled May 09 15:27:46.025868 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 15:27:46.026117 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 15:27:46.072985 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: Python main interpreter initialized at 0x560be22be9c0 May 09 15:27:46.072985 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: python threads support enabled May 09 15:27:46.072985 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: your server socket listen backlog is limited to 100 connections May 09 15:27:46.072985 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: your mercy for graceful operations on workers is 90 seconds May 09 15:27:46.073458 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: mapped 403077 bytes (393 KB) for 2 cores May 09 15:27:46.073458 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: *** Operational MODE: preforking *** May 09 15:27:46.073853 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: *** uWSGI is running in multiple interpreter mode *** May 09 15:27:46.073853 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: spawned uWSGI master process (pid: 206355) May 09 15:27:46.074020 dv-cinder-841125-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 15:27:46.075726 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: spawned uWSGI worker 1 (pid: 206369, cores: 1) May 09 15:27:46.076071 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: spawned uWSGI worker 2 (pid: 206370, cores: 1) May 09 15:27:46.076303 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 15:27:51.909146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:27:51.909146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: from cryptography.utils import int_from_bytes May 09 15:27:51.910016 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:27:51.910016 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: from cryptography.utils import int_from_bytes May 09 15:27:51.910514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:27:51.910514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: from cryptography.utils import int_from_bytes May 09 15:27:51.911039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:27:51.911039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: from cryptography.utils import int_from_bytes May 09 15:27:51.959975 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:27:51.960267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:27:51.960363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] command line args: [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:27:51.960505 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:27:51.960610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:27:51.960704 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:27:51.960791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ================================================================================ {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:27:51.960879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] command line args: [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:27:51.961000 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] admin_token = **** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.961139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:27:51.961240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] config_dir = [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.961334 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ================================================================================ {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:27:51.961422 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.961562 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] admin_token = **** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.961662 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] config_source = [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.961750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] debug = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.961841 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] config_dir = [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.961929 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] config_source = [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] debug = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] insecure_debug = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.962935 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] insecure_debug = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.963060 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.963176 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] list_limit = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.963291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.963404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] log_config_append = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.963517 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.963629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.963747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] list_limit = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.963903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] log_dir = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.964019 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] log_config_append = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.964650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] log_file = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.964775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.964889 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] log_dir = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965242 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] log_file = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965692 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965692 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.965912 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966262 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966372 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966821 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.966933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967597 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967710 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] notification_format = cadf {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.967995 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.968125 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.968125 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.968348 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.968462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] notification_format = cadf {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.968568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] publish_errors = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.968568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.968776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.968890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.969003 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.969119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.969234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.969389 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] publish_errors = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.969521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.969653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.969784 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] standard_threads = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.969923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] strict_password_check = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970194 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] use_eventlog = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] use_journal = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] use_json = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970838 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] standard_threads = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.970926 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] use_stderr = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971012 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] strict_password_check = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] use_syslog = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971187 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] watch_log_file = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971367 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] use_eventlog = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971461 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.971549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] use_journal = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] use_json = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971715 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.971836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] use_stderr = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.971927 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.972012 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] use_syslog = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.972092 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.972171 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] watch_log_file = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:27:51.972257 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.972349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.972498 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.972593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.972747 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.972842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.972984 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.973093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.973232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.973320 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.973480 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.973575 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.973730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.973829 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.973967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.974055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.974216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.974318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.974450 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.974549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.974696 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.974785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.974933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.975030 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.975169 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.975268 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.975410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.975503 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.975660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.975754 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.975934 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.976034 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.976172 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.976260 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.976426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.976523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.976682 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.976775 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.976932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977173 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977501 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977736 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.977951 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.978102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.978197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.978352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.978445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.978600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.978688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.978829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.978923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.979057 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.979152 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.979300 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.979440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.979583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.979710 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.980424 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.980568 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.980701 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.980834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.980974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.981107 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.981231 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.981368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.981508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.981635 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.981851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.981981 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.982107 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.982238 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.982370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.982502 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.982639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.982766 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.982903 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.983038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.983175 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.983319 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.983462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.983595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.983720 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.983892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.984030 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.984163 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.984300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.984440 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.984572 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.984704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.984830 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.984961 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.985100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.985232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.985364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.985490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.985621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.985747 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.985881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.986013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.986146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.986277 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.986409 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.986547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.986669 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.986776 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.986888 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.987013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.987146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.987286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.987419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.987552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.987678 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.987833 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.987962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.988093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.988227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.988364 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.988503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.988630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.988762 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.988894 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.989026 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.989159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.989296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.989428 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.989565 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.989713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.989840 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.989965 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.990097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.990223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.990350 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.990484 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.990617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.990744 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.990877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.991045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.enabled = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.991177 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.991316 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.991450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.991583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.991715 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.991879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.992013 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.992152 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.992316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.992452 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.992586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.enabled = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.992719 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.992845 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.992983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.993117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.993252 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.993385 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.993519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.993651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.993787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.993921 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.994054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.994180 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.994312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.994444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.994584 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.994717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.994991 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.995125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.995257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.995393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.995526 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.995660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.995800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.995928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.996054 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.996195 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.996329 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.996455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.996588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.996724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.996850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.996988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.997121 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.997257 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.997390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.997516 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.997653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.997792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.997792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998043 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998175 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] auth.external = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998696 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998824 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] auth.mapped = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998955 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.998955 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.999235 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.999235 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.999497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.999631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] auth.password = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.999758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:51.999949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] auth.token = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.000083 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.000228 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.000371 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.000505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] catalog.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.000638 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] auth.external = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.000772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.000905 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] auth.mapped = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.001031 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.001166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.001302 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.001434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.001584 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.001711 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] auth.password = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.001844 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.001982 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] auth.token = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.002110 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] credential.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.002242 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.002369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] credential.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.002495 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] catalog.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.002626 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.002765 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.002899 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.003060 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.003198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.003332 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.003465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.003635 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.003777 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.003917 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.004045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.004184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] credential.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.004311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.004524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] credential.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.004666 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.004794 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.004926 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.005059 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.005192 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.005327 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.005460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.005587 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.005712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.005843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.005983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.006118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.006245 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.006377 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.006509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] federation.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.006642 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.006778 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.006910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.007043 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] federation.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.007170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.007302 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.007436 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.007581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.007713 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.007862 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.008006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.008135 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.008260 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.008400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.008528 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] federation.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.008654 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.008779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.008910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.009042 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] federation.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.009182 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.009324 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.009451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.009582 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.009724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.009857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.009996 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.010113 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.010249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.010377 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.010503 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.010634 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.010773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.010900 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.011041 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.011168 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.011301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.011443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.011583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.011709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.011890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.012017 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.012152 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.012279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.012416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.012543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.012675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.012801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.012933 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.013065 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.013208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.013336 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.013462 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.013594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.013720 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.013852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.013988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.014114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.014240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.014372 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.014501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.014633 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.014768 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.014901 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.015034 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.015161 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.015293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.015432 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.015566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.015699 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.015850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.015850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.016098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.016236 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.016369 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.016504 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.016645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.016771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.016903 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.017038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.017171 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.017298 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.017422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.017549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.017680 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.017819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.017946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.018072 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.018196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.018327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.018459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.018595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.018728 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.018860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.018986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.019118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.password = **** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.019250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.019389 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.019522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.019650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.019814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.019943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.020079 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.020215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.020342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.020467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.020598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.020732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.020865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.021004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.021137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.021270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.021402 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.password = **** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.021528 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.021661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.021801 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.021928 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.022059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.022186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.022317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.022449 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.022584 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.022717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.022851 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.022984 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.023110 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.023239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.023377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.023504 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.023635 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.023781 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.023909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.024034 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.024174 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.024313 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.024446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.024572 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.024704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.024836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.024977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.025103 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.025229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.025361 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.025487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.025614 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.025759 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.025893 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.026033 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.026033 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.026279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.026405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.026542 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.027181 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.027310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.027441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.027568 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.027898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.028035 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.028035 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.028287 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.028414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.028539 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.028679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.028806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.028938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.029065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.029191 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.029332 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.029472 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.029605 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.029605 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.029856 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.029983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.030115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.030323 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.030467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.030594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.030719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.030719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.030969 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] policy.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.030969 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.031234 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.031368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.031494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.031620 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.031751 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.031914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] receipt.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.032042 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.032168 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.032301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.032434 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.032561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.032695 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.032822 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.032947 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.033073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.033204 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.033335 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] policy.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.033473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] resource.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.033606 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.033738 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.033873 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.034000 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] resource.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.034125 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.034272 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.034402 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] receipt.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.034528 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.034660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.034793 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.034934 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.035070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] revoke.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.035203 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.035330 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.035470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.035588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.035695 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.035836 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] role.cache_time = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.035971 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] resource.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.036099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] role.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.036233 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.036360 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] role.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.036487 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] resource.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.036625 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] role.list_limit = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.036758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.036885 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.037010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.037135 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.037267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.037403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.037531 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] revoke.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.037662 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.037794 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.037921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.038053 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.038191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.038319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] role.cache_time = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.038444 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.038720 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] role.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.038855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.038988 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] role.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.039124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.039261 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] role.list_limit = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.039389 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.039515 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.039642 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.039821 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.039968 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.040096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.040232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.040366 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.040498 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.040639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.040773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.040906 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.041033 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.041165 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.041292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.041430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.041563 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.041698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.041824 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.041958 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.042091 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.042276 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.042904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.043154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.043285 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.043414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.043548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.043684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.043829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.043829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.044083 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.044209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.044347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.044483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.044611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.044750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.044879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.045016 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.045142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.045281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.045408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.045540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.045665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.045797 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] token.cache_time = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.045925 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.046059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] token.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.046185 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.046317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.046449 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.046582 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] token.provider = fernet {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.046716 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.046855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.047002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.047129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.047255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.047401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.047540 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.047668 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.047831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.047962 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.048100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.048233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.048371 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.048505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] trust.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.048637 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] token.cache_time = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.048763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.048889 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] token.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.049022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.049160 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.049293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.049431 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] token.provider = fernet {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.049566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.049699 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.049825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.049963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.050104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.050237 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.050369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.050496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.050622 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.050756 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.050882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.connection = **** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.051015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.051154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.051294 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] trust.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.051421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.051547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.051672 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.051838 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.051968 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.052107 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.052242 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.052369 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.052494 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.052626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.052758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.052894 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.053029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.053157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.053306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.053499 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.053635 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.053771 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.connection = **** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.053904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.054040 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.054168 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.054379 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.054522 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.054650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.054776 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.054902 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.055034 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.055173 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.055301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.055428 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.055559 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.055686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.055840 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.055840 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=206369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.056096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.057155 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.057155 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:27:52.057155 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=206370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:27:52.077474 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.077708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.077938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.079068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.079308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.079548 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.086702 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.088410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.116127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.116356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.117923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.118160 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.170179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.170330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.221242 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.221475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.222560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.222802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.287410 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.287640 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.287743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.287891 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.287992 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.288113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.288217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.288319 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.288411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.288533 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.288627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.288810 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.312189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.312414 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.312539 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.312644 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.312776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.312887 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.313009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.313109 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.313234 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.313333 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.313457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.313558 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.313677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.313892 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.325106 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.325499 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.340010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.340301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.340453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.340549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.340676 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.340783 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.340894 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.340984 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.341109 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.341200 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.341324 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=206369) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.341417 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.341560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.341780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=206370) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:27:52.359036 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.359245 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:27:52.359551 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.359643 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.359790 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:27:52.359885 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:27:52.360069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.360177 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.360318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:27:52.360416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.360577 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.360674 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.360835 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.360937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.361095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.361353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.373306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.373306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.373306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.374099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.374179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.374270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.374270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.374270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.381236 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.381727 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.384585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.384867 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.385080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.385267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.385365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.385552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.385750 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.385880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.386574 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.386704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.387050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.387173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.387310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.387410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.387500 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.387644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.387735 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.387944 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.388051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.388304 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.388394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.388576 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.415857 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.416337 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.417528 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.417816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.418110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.418395 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.423174 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.423409 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.423688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.423994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.424279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.424563 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.431049 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.431329 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.432018 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.432303 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.436402 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.436691 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.436973 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.437176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.437270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.437465 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.437571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.437746 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.437838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.438030 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.438126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.438296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.438401 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.438570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.438843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.439114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.458257 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.458531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.459025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.459309 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.463148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.463896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.467594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.467903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.468258 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.468546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.472980 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.473571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.476652 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.477225 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.480505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.480861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.481149 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.481342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.481436 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.481645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.481740 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.481934 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.482029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.482223 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.482507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.482788 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.501283 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.501657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.501931 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.502194 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.502329 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.502577 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.502850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.503119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.510187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.511674 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.512487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.512773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.513649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.513929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.515868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.516151 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.516437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.516717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.516993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.517085 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.517359 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.517648 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.517939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.518219 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.531688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.531998 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.532280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.532573 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.532856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.533131 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.533417 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.533792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.534074 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.534357 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.534657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.534941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.535227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.535508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.551829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.553941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.555140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.557313 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.558620 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.560280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.560827 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.561930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.562208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.562450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.562557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.564135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.564672 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.564970 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.570303 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.571965 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.572681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.574871 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.575797 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.576095 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.576377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.576650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.578174 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.578468 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.578764 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.579043 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.585975 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.586269 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.586554 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.588442 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.588733 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.589026 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.595266 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=206369) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.595544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.595850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.596131 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.596404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.596689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.596961 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.597235 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.597502 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.597781 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.598049 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.598140 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=206370) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:27:52.598326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.598418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.598589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.598689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.598847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=206369) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.598941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.599160 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.599450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.599726 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.600029 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.600300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.600583 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.600856 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.601135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.601400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.601662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=206370) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:27:52.638456 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560be22be9c0 pid: 206369 (default app) May 09 15:27:52.641830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f43c1-a44a-45c4-8f97-01e0f011d74a None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:27:52.641938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560be22be9c0 pid: 206370 (default app) May 09 15:27:52.642139 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f43c1-a44a-45c4-8f97-01e0f011d74a None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:27:52.642428 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f43c1-a44a-45c4-8f97-01e0f011d74a None None] PATH_INFO: `/v3` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:27:52.646642 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Mon May 9 15:27:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:00.769254 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce728-c5e8-4551-8164-ff4d9478a4a3 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:00.769843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce728-c5e8-4551-8164-ff4d9478a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:00.769843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce728-c5e8-4551-8164-ff4d9478a4a3 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:00.774178 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:28:00.779902 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:00.780347 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:00.780451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:00.811756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG oslo_db.sqlalchemy.engines [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=206369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:28:01.009615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG passlib.handlers.bcrypt [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=206369) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:28:01.010029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG passlib.handlers.bcrypt [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=206369) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:28:01.065925 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:01.067493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:01.193740 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 09 15:28:01.217535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ce728-c5e8-4551-8164-ff4d9478a4a3 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:01.252500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG oslo_db.sqlalchemy.engines [None req-6c5ce728-c5e8-4551-8164-ff4d9478a4a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=206370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:28:01.382293 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ce728-c5e8-4551-8164-ff4d9478a4a3 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:01.387508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c842ea4-f9cb-4299-add8-be7069fe5377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feddf1938a742ebac431fd3312cccc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:01.388212 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842ea4-f9cb-4299-add8-be7069fe5377 admin admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:01.388500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842ea4-f9cb-4299-add8-be7069fe5377 admin admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:01.388780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c842ea4-f9cb-4299-add8-be7069fe5377 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:01.397564 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c842ea4-f9cb-4299-add8-be7069fe5377 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:01.449746 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9c842ea4-f9cb-4299-add8-be7069fe5377 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:28:01.450093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c842ea4-f9cb-4299-add8-be7069fe5377 admin admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:01.459784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 9 15:28:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:28:01.466404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:01.480769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0210a-e86b-4931-a5bc-a1992574d226 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:01.485274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d64ee7-5636-4ba1-be06-085c2a6c887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feddf1938a742ebac431fd3312cccc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:01.486397 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64ee7-5636-4ba1-be06-085c2a6c887a admin admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:01.486687 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64ee7-5636-4ba1-be06-085c2a6c887a admin admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:01.486973 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64ee7-5636-4ba1-be06-085c2a6c887a admin admin] PATH_INFO: `/v3/projects/4feddf1938a742ebac431fd3312cccc1` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:01.488555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d64ee7-5636-4ba1-be06-085c2a6c887a admin admin] RBAC: Authorizing `identity:get_project(project_id=4feddf1938a742ebac431fd3312cccc1)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:01.538712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d0d64ee7-5636-4ba1-be06-085c2a6c887a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:28:01.539054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d64ee7-5636-4ba1-be06-085c2a6c887a admin admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:01.543847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Mon May 9 15:28:01 2022] GET /identity/v3/projects/4feddf1938a742ebac431fd3312cccc1 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:03.758251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258cfb-672a-43ee-b1b9-df0d2e6dbc7a None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:03.758806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258cfb-672a-43ee-b1b9-df0d2e6dbc7a None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:03.758806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258cfb-672a-43ee-b1b9-df0d2e6dbc7a None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:03.763513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:03.769981 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7e56-7981-421e-99d0-8e9368898881 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:03.770503 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7e56-7981-421e-99d0-8e9368898881 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:03.771028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc7e56-7981-421e-99d0-8e9368898881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:03.797591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-56cc7e56-7981-421e-99d0-8e9368898881 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:03.799148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-56cc7e56-7981-421e-99d0-8e9368898881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:03.807178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 09 15:28:03.830231 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88258cfb-672a-43ee-b1b9-df0d2e6dbc7a None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:03.843583 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88258cfb-672a-43ee-b1b9-df0d2e6dbc7a None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:03.847923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8e7e0-50cc-433f-b49b-73b072171de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feddf1938a742ebac431fd3312cccc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:03.848565 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e7e0-50cc-433f-b49b-73b072171de3 admin admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:03.848851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e7e0-50cc-433f-b49b-73b072171de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:03.849132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8e7e0-50cc-433f-b49b-73b072171de3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:03.856932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8e7e0-50cc-433f-b49b-73b072171de3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:03.858719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8e7e0-50cc-433f-b49b-73b072171de3 admin admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:03.867474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 9 15:28:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 15:28:03.873027 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc7e56-7981-421e-99d0-8e9368898881 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:03.881964 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc7e56-7981-421e-99d0-8e9368898881 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:03.887280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7362a-03a3-4305-86c7-8fd80ad02d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4feddf1938a742ebac431fd3312cccc1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:03.888179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7362a-03a3-4305-86c7-8fd80ad02d05 admin admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:03.888467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7362a-03a3-4305-86c7-8fd80ad02d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:03.888746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7362a-03a3-4305-86c7-8fd80ad02d05 admin admin] PATH_INFO: `/v3/users/bb7614d8c4184d29a9515f84d7487a48` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:03.890170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7362a-03a3-4305-86c7-8fd80ad02d05 admin admin] RBAC: Authorizing `identity:get_user(user_id=bb7614d8c4184d29a9515f84d7487a48)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:03.892032 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7362a-03a3-4305-86c7-8fd80ad02d05 admin admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:03.893623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Mon May 9 15:28:03 2022] GET /identity/v3/users/bb7614d8c4184d29a9515f84d7487a48 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:06.200660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423602-5600-45ec-83c9-ce48369475e1 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.201223 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423602-5600-45ec-83c9-ce48369475e1 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.201223 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423602-5600-45ec-83c9-ce48369475e1 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:06.202618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:06.207992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3bdc-4791-4a08-a39e-27fa74aae68d None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.208468 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3bdc-4791-4a08-a39e-27fa74aae68d None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.208691 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3bdc-4791-4a08-a39e-27fa74aae68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:06.229614 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aa6cc-8e0d-4abf-8b47-53c4e00022f7 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.229899 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aa6cc-8e0d-4abf-8b47-53c4e00022f7 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.230320 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aa6cc-8e0d-4abf-8b47-53c4e00022f7 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:06.231789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:28:06.237628 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.237917 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.238196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:06.282123 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG passlib.handlers.bcrypt [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=206370) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:28:06.282553 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG passlib.handlers.bcrypt [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=206370) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:28:06.331234 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:06.332886 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:06.335818 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-176d3bdc-4791-4a08-a39e-27fa74aae68d None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:06.337006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-176d3bdc-4791-4a08-a39e-27fa74aae68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:06.419146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:06.442548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d3bdc-4791-4a08-a39e-27fa74aae68d None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:06.444372 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:06.466453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:06.541871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d3bdc-4791-4a08-a39e-27fa74aae68d None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:06.563916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb925bf8-afba-4032-901b-ac09e8008958 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:06.576044 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd24b3d-b694-48eb-b8d1-d01e54b450c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:06.576844 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd24b3d-b694-48eb-b8d1-d01e54b450c0 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.577127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd24b3d-b694-48eb-b8d1-d01e54b450c0 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.577404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd24b3d-b694-48eb-b8d1-d01e54b450c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:06.588564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd24b3d-b694-48eb-b8d1-d01e54b450c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:06.597183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314b0e6-e55c-4bfb-ba5d-dc0b70ad153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:06.598089 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b0e6-e55c-4bfb-ba5d-dc0b70ad153c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.598380 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b0e6-e55c-4bfb-ba5d-dc0b70ad153c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.598662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b0e6-e55c-4bfb-ba5d-dc0b70ad153c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-dcd24b3d-b694-48eb-b8d1-d01e54b450c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:06.600771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:06.601946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:06.603260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 7/14] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:06.608937 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd24b3d-b694-48eb-b8d1-d01e54b450c0 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:06.669943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314b0e6-e55c-4bfb-ba5d-dc0b70ad153c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:06.671870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314b0e6-e55c-4bfb-ba5d-dc0b70ad153c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:06.706302 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd24b3d-b694-48eb-b8d1-d01e54b450c0 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:06.741864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:06.742444 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.742728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.743007 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:06.743802 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:06.744104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:06.745598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:06.757184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 8/15] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:06.763368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:06.780319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:28:06.785786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314b0e6-e55c-4bfb-ba5d-dc0b70ad153c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:06.859030 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b85a8-a48f-4935-be25-c1bd9faa9112 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:06.882618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314b0e6-e55c-4bfb-ba5d-dc0b70ad153c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:06.893158 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ae69-b5fd-4784-b199-264737701813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:06.894028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ae69-b5fd-4784-b199-264737701813 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.894314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ae69-b5fd-4784-b199-264737701813 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.894583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ae69-b5fd-4784-b199-264737701813 None admin] PATH_INFO: `/v3/users/bb7614d8c4184d29a9515f84d7487a48` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:06.895830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ae69-b5fd-4784-b199-264737701813 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7614d8c4184d29a9515f84d7487a48)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:06.897296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ae69-b5fd-4784-b199-264737701813 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:06.898923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 9/17] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:06 2022] GET /identity/v3/users/bb7614d8c4184d29a9515f84d7487a48 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:06.904992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ae69-b5fd-4784-b199-264737701813 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:06.916526 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:06.917353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:06.917629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:06.917893 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:07.008147 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ae69-b5fd-4784-b199-264737701813 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:07.044546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b1ff-9c14-4c11-a5df-6819c5b5bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:07.045347 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b1ff-9c14-4c11-a5df-6819c5b5bfaa None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:07.045630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b1ff-9c14-4c11-a5df-6819c5b5bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:07.045904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b1ff-9c14-4c11-a5df-6819c5b5bfaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:07.047120 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90b1ff-9c14-4c11-a5df-6819c5b5bfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:07.047358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:07.048594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90b1ff-9c14-4c11-a5df-6819c5b5bfaa None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:07.048834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:07.050214 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:07.055946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b1ff-9c14-4c11-a5df-6819c5b5bfaa None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:28:07.070101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:07.071257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:07.072250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:28:07.072250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:28:07.072250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:28:07.072250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:07.072250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:07.077770 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:07.152756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b1ff-9c14-4c11-a5df-6819c5b5bfaa None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:07.175574 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a5190-74ab-486b-b56d-b3414a22f6d5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:07.185692 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74603c-f65a-4841-a6f5-4213a19d3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:07.186357 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74603c-f65a-4841-a6f5-4213a19d3618 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:07.186646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74603c-f65a-4841-a6f5-4213a19d3618 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:07.186924 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74603c-f65a-4841-a6f5-4213a19d3618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:07.187785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74603c-f65a-4841-a6f5-4213a19d3618 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.domain.id=default, user.id=bb7614d8c4184d29a9515f84d7487a48) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:07.188106 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74603c-f65a-4841-a6f5-4213a19d3618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:07.189813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74603c-f65a-4841-a6f5-4213a19d3618 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:07.196469 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 9 15:28:07 2022] GET /identity/v3/role_assignments?user.id=bb7614d8c4184d29a9515f84d7487a48&scope.domain.id=default&role.id=8cf832105b2949f6b11e06b208146326 => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:07.209734 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c0ff4-d155-4079-a82a-601f3f39692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:07.210431 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0ff4-d155-4079-a82a-601f3f39692c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:07.210719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0ff4-d155-4079-a82a-601f3f39692c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:07.211002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c0ff4-d155-4079-a82a-601f3f39692c None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:07.211789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c0ff4-d155-4079-a82a-601f3f39692c None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:07.212107 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c0ff4-d155-4079-a82a-601f3f39692c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:07.213561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c0ff4-d155-4079-a82a-601f3f39692c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:07.235586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:09.806105 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4653-6309-4f91-aa36-1d4b72f82b86 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:09.812985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4653-6309-4f91-aa36-1d4b72f82b86 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:09.812985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab4653-6309-4f91-aa36-1d4b72f82b86 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:09.812985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:09.813916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93da1f-b2f8-4b24-a766-7d0e0ea0ee5f None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:09.814348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93da1f-b2f8-4b24-a766-7d0e0ea0ee5f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:09.814809 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93da1f-b2f8-4b24-a766-7d0e0ea0ee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:09.845210 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-3d93da1f-b2f8-4b24-a766-7d0e0ea0ee5f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:09.846434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-3d93da1f-b2f8-4b24-a766-7d0e0ea0ee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:09.927855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 11/23] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:09.989307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab4653-6309-4f91-aa36-1d4b72f82b86 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:10.094917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab4653-6309-4f91-aa36-1d4b72f82b86 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:10.097941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29652018-14fb-4bd7-9254-50f913ea4aa3 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.098234 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29652018-14fb-4bd7-9254-50f913ea4aa3 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.098508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29652018-14fb-4bd7-9254-50f913ea4aa3 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.101562 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:10.106251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adb2d9-d3d6-4965-a12f-bb8f3adc84d9 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.106701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adb2d9-d3d6-4965-a12f-bb8f3adc84d9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.106986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adb2d9-d3d6-4965-a12f-bb8f3adc84d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.130402 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b09f4-a687-49d3-92a5-a1b4a8b21296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:10.131206 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b09f4-a687-49d3-92a5-a1b4a8b21296 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.131498 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b09f4-a687-49d3-92a5-a1b4a8b21296 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.131807 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b09f4-a687-49d3-92a5-a1b4a8b21296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.144817 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b09f4-a687-49d3-92a5-a1b4a8b21296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-754b09f4-a687-49d3-92a5-a1b4a8b21296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:10.152555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:10.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:10.154538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:10.155251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-a8adb2d9-d3d6-4965-a12f-bb8f3adc84d9 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:10.155251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-a8adb2d9-d3d6-4965-a12f-bb8f3adc84d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:10.155402 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 13/25] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:10.160678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b09f4-a687-49d3-92a5-a1b4a8b21296 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:10.284666 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b09f4-a687-49d3-92a5-a1b4a8b21296 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:10.295939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 13/26] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:10.297313 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9c266-1f40-4215-abe7-75c1d1f92985 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.297607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9c266-1f40-4215-abe7-75c1d1f92985 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.297890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9c266-1f40-4215-abe7-75c1d1f92985 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.304328 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 14/27] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:10.311405 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209956-fee3-43e8-b34c-433423c146c2 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.311689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209956-fee3-43e8-b34c-433423c146c2 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.311983 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209956-fee3-43e8-b34c-433423c146c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.345334 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-5c209956-fee3-43e8-b34c-433423c146c2 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:10.346499 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-5c209956-fee3-43e8-b34c-433423c146c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:10.352652 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:10.353455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.353694 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.353888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.355437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:10.355747 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:10.357220 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:10.381542 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 14/28] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:10.382349 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:10.515170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a9c1-7796-4c8f-bb00-a6932b0fc188 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:10.516620 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 15/29] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:10.517499 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209956-fee3-43e8-b34c-433423c146c2 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:10.572688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:10.574110 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.574656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.574935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.590202 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:10.592183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:28:10.613026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:10.613989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:10.614930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:28:10.614930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:28:10.614930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:28:10.614930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:10.619351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 15/30] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:10.620272 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:10.739836 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f9922-4460-41fb-b590-3d86f1375c00 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:10.745689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209956-fee3-43e8-b34c-433423c146c2 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:10.783294 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa05954-fb47-4cd7-ae92-a7d56cec63de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:10.784391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05954-fb47-4cd7-ae92-a7d56cec63de None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.784695 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05954-fb47-4cd7-ae92-a7d56cec63de None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.784974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05954-fb47-4cd7-ae92-a7d56cec63de None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.785747 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa05954-fb47-4cd7-ae92-a7d56cec63de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:10.787427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa05954-fb47-4cd7-ae92-a7d56cec63de None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:10.788396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b0b08-e990-4b09-b612-6c20dc7c518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:10.789455 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b0b08-e990-4b09-b612-6c20dc7c518a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.790063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b0b08-e990-4b09-b612-6c20dc7c518a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.790514 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b0b08-e990-4b09-b612-6c20dc7c518a None admin] PATH_INFO: `/v3/users/bb7614d8c4184d29a9515f84d7487a48` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.793439 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b0b08-e990-4b09-b612-6c20dc7c518a None admin] RBAC: Authorizing `identity:get_user(user_id=bb7614d8c4184d29a9515f84d7487a48)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:10.795257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b0b08-e990-4b09-b612-6c20dc7c518a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:10.797904 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 16/31] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:10 2022] GET /identity/v3/users/bb7614d8c4184d29a9515f84d7487a48 => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:10.803041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b0b08-e990-4b09-b612-6c20dc7c518a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:10.907703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b0b08-e990-4b09-b612-6c20dc7c518a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:10.921610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 16/32] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:28:10 2022] POST /identity/v3/roles => generated 219 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:10.924281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d569-edc1-4a57-8317-a0083f6260e9 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.924758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d569-edc1-4a57-8317-a0083f6260e9 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.925210 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01d569-edc1-4a57-8317-a0083f6260e9 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.926983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 17/33] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:10.933073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01d569-edc1-4a57-8317-a0083f6260e9 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:10.968606 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f72e9-cc23-410d-a772-6bb13df287f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:10.969311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f72e9-cc23-410d-a772-6bb13df287f1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:10.969577 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f72e9-cc23-410d-a772-6bb13df287f1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:10.969854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f72e9-cc23-410d-a772-6bb13df287f1 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:10.970593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f72e9-cc23-410d-a772-6bb13df287f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:10.970897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f72e9-cc23-410d-a772-6bb13df287f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:10.972438 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f72e9-cc23-410d-a772-6bb13df287f1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:10.999092 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 17/34] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:11.000530 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f1a0-e28c-4c81-9097-e7fe94131c13 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.000823 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f1a0-e28c-4c81-9097-e7fe94131c13 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.001099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f1a0-e28c-4c81-9097-e7fe94131c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.032356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-4d66f1a0-e28c-4c81-9097-e7fe94131c13 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:11.033564 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-4d66f1a0-e28c-4c81-9097-e7fe94131c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:11.054499 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01d569-edc1-4a57-8317-a0083f6260e9 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:11.092998 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436199d-0281-434f-a30b-faccde93aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:11.094213 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436199d-0281-434f-a30b-faccde93aed6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.094667 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436199d-0281-434f-a30b-faccde93aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.095107 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436199d-0281-434f-a30b-faccde93aed6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.096783 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436199d-0281-434f-a30b-faccde93aed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:11.098544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436199d-0281-434f-a30b-faccde93aed6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:11.100464 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 18/35] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:11.101431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436199d-0281-434f-a30b-faccde93aed6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:11.157623 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 18/36] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:11.158601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66f1a0-e28c-4c81-9097-e7fe94131c13 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:11.255538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436199d-0281-434f-a30b-faccde93aed6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:11.279728 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66f1a0-e28c-4c81-9097-e7fe94131c13 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:11.318159 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66621975-2af1-4c92-8d8f-535ce73fd4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:11.319044 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621975-2af1-4c92-8d8f-535ce73fd4dc None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.319323 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621975-2af1-4c92-8d8f-535ce73fd4dc None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.319602 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621975-2af1-4c92-8d8f-535ce73fd4dc None admin] PATH_INFO: `/v3/domains/default/users/bb7614d8c4184d29a9515f84d7487a48/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.325555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd05c4-ba44-4f41-af33-158384fdbb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:11.325967 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66621975-2af1-4c92-8d8f-535ce73fd4dc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bb7614d8c4184d29a9515f84d7487a48, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:11.326203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd05c4-ba44-4f41-af33-158384fdbb11 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.326481 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd05c4-ba44-4f41-af33-158384fdbb11 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.326763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd05c4-ba44-4f41-af33-158384fdbb11 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.327486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd05c4-ba44-4f41-af33-158384fdbb11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:11.328976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd05c4-ba44-4f41-af33-158384fdbb11 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:11.329109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66621975-2af1-4c92-8d8f-535ce73fd4dc None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:11.378819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:28:11 2022] POST /identity/v3/projects => generated 301 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:11.379710 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd05c4-ba44-4f41-af33-158384fdbb11 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:11.470015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 19/38] 10.222.0.32 () {58 vars in 1361 bytes} [Mon May 9 15:28:11 2022] PUT /identity/v3/domains/default/users/bb7614d8c4184d29a9515f84d7487a48/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:11.536898 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d36a0-6361-45d3-8542-5e77c0278a30 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.537624 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d36a0-6361-45d3-8542-5e77c0278a30 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.538239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d36a0-6361-45d3-8542-5e77c0278a30 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.543802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 20/39] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:28:11.551575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d3d7-f0a1-4c85-bdc9-b5e9aa538578 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.552289 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d3d7-f0a1-4c85-bdc9-b5e9aa538578 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.552818 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d3d7-f0a1-4c85-bdc9-b5e9aa538578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.580304 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd05c4-ba44-4f41-af33-158384fdbb11 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:11.588037 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-29e6d3d7-f0a1-4c85-bdc9-b5e9aa538578 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:11.596205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-29e6d3d7-f0a1-4c85-bdc9-b5e9aa538578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:11.649671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f678569-d4be-46ab-8b24-a9fff1088df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:11.650412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f678569-d4be-46ab-8b24-a9fff1088df6 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.650707 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f678569-d4be-46ab-8b24-a9fff1088df6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.650994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f678569-d4be-46ab-8b24-a9fff1088df6 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.652392 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f678569-d4be-46ab-8b24-a9fff1088df6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:11.654127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f678569-d4be-46ab-8b24-a9fff1088df6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:11.676903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 20/40] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:28:11 2022] POST /identity/v3/roles => generated 225 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:11.683819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec8d4-72ff-4cd2-9b2d-125291930631 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.683819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec8d4-72ff-4cd2-9b2d-125291930631 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.683819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec8d4-72ff-4cd2-9b2d-125291930631 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.683819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 21/41] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:11.687565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d531af2-961b-48b8-b0c2-b4ce3faad5a3 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.687865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d531af2-961b-48b8-b0c2-b4ce3faad5a3 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.688154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d531af2-961b-48b8-b0c2-b4ce3faad5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.711233 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 21/42] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:11.717799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-4d531af2-961b-48b8-b0c2-b4ce3faad5a3 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:11.719460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-4d531af2-961b-48b8-b0c2-b4ce3faad5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:11.744200 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d3d7-f0a1-4c85-bdc9-b5e9aa538578 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:11.816660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 22/43] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:11.843133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d531af2-961b-48b8-b0c2-b4ce3faad5a3 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:11.881157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d3d7-f0a1-4c85-bdc9-b5e9aa538578 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:11.920710 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e9f77-9d2e-47b5-b57a-2c24df293e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:11.921413 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e9f77-9d2e-47b5-b57a-2c24df293e26 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:11.921681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e9f77-9d2e-47b5-b57a-2c24df293e26 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:11.921966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e9f77-9d2e-47b5-b57a-2c24df293e26 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:11.922767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e9f77-9d2e-47b5-b57a-2c24df293e26 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:11.924544 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e9f77-9d2e-47b5-b57a-2c24df293e26 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:11.944290 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:28:11 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:28:11.966134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d531af2-961b-48b8-b0c2-b4ce3faad5a3 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:12.005343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a97075-1fc5-4d59-9a6d-0208175fbf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:12.006149 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97075-1fc5-4d59-9a6d-0208175fbf0d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:12.006442 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97075-1fc5-4d59-9a6d-0208175fbf0d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:12.006770 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97075-1fc5-4d59-9a6d-0208175fbf0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:12.008167 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a97075-1fc5-4d59-9a6d-0208175fbf0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:12.009729 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a97075-1fc5-4d59-9a6d-0208175fbf0d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:12.012027 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 23/45] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:12.017679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e9f77-9d2e-47b5-b57a-2c24df293e26 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:12.128863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e9f77-9d2e-47b5-b57a-2c24df293e26 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:12.165697 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a315d51-9e31-43ca-b778-11c0d1f61fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:12.166370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315d51-9e31-43ca-b778-11c0d1f61fc2 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:12.166655 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315d51-9e31-43ca-b778-11c0d1f61fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:12.167460 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315d51-9e31-43ca-b778-11c0d1f61fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:12.168453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a315d51-9e31-43ca-b778-11c0d1f61fc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:12.169924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a315d51-9e31-43ca-b778-11c0d1f61fc2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:12.199563 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:28:12 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:13.817274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37d8d1-31ba-4837-bb86-cd00f29166c2 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:13.817836 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37d8d1-31ba-4837-bb86-cd00f29166c2 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:13.817836 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37d8d1-31ba-4837-bb86-cd00f29166c2 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:13.819197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 24/47] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:13.825487 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df73bae-d9cd-4e45-8c14-da395ba4554c None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:13.825902 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df73bae-d9cd-4e45-8c14-da395ba4554c None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:13.826115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df73bae-d9cd-4e45-8c14-da395ba4554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:13.842967 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-5df73bae-d9cd-4e45-8c14-da395ba4554c None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:13.844186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-5df73bae-d9cd-4e45-8c14-da395ba4554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:13.911118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:13.935506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37d8d1-31ba-4837-bb86-cd00f29166c2 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:14.033250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37d8d1-31ba-4837-bb86-cd00f29166c2 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:14.066115 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8c5cc-1ad8-4400-ba50-a059ef0cd013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:14.066912 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c5cc-1ad8-4400-ba50-a059ef0cd013 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.067195 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c5cc-1ad8-4400-ba50-a059ef0cd013 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.067519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8c5cc-1ad8-4400-ba50-a059ef0cd013 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.077481 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8c5cc-1ad8-4400-ba50-a059ef0cd013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-1fa8c5cc-1ad8-4400-ba50-a059ef0cd013 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:14.085086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:14.086121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:14.087005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 25/49] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:14.092860 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df73bae-d9cd-4e45-8c14-da395ba4554c None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:14.191746 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df73bae-d9cd-4e45-8c14-da395ba4554c None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:14.224368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:14.225031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.225321 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.225600 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.226353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:14.226660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:14.228065 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:14.239410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 25/50] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:14.244924 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8c5cc-1ad8-4400-ba50-a059ef0cd013 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:14.346585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8c5cc-1ad8-4400-ba50-a059ef0cd013 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:14.379695 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73f6ab-26e2-4395-aa77-420f67e014d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:14.380626 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f6ab-26e2-4395-aa77-420f67e014d3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.380917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f6ab-26e2-4395-aa77-420f67e014d3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.381199 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f6ab-26e2-4395-aa77-420f67e014d3 None admin] PATH_INFO: `/v3/users/bb7614d8c4184d29a9515f84d7487a48` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.382425 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73f6ab-26e2-4395-aa77-420f67e014d3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7614d8c4184d29a9515f84d7487a48)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:14.383996 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73f6ab-26e2-4395-aa77-420f67e014d3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:14.390621 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 26/51] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:14 2022] GET /identity/v3/users/bb7614d8c4184d29a9515f84d7487a48 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:14.391868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:14.447632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae603f-6f91-4077-b91f-e973ddad056e None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.448469 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae603f-6f91-4077-b91f-e973ddad056e None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.448753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae603f-6f91-4077-b91f-e973ddad056e None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.450155 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 27/52] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:28:14.455151 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0d31-4743-42f9-92ab-58152398c323 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.455445 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0d31-4743-42f9-92ab-58152398c323 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.455732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab0d31-4743-42f9-92ab-58152398c323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.472893 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-3dab0d31-4743-42f9-92ab-58152398c323 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:14.474115 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-3dab0d31-4743-42f9-92ab-58152398c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:14.491382 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd2f7d-d580-434a-b9f5-b1d2e6b632f1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:14.524755 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686fcf1-cd15-498f-bddf-65f7bd24f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:14.525596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686fcf1-cd15-498f-bddf-65f7bd24f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.525881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686fcf1-cd15-498f-bddf-65f7bd24f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.526246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686fcf1-cd15-498f-bddf-65f7bd24f6c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.527464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686fcf1-cd15-498f-bddf-65f7bd24f6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:14.528946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686fcf1-cd15-498f-bddf-65f7bd24f6c3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:14.530566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:14.536204 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686fcf1-cd15-498f-bddf-65f7bd24f6c3 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:14.539212 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 28/54] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:14.562732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0d31-4743-42f9-92ab-58152398c323 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:14.631634 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686fcf1-cd15-498f-bddf-65f7bd24f6c3 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:14.656859 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab0d31-4743-42f9-92ab-58152398c323 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:14.663750 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:14.664424 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.664704 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.664978 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.665806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.domain.id=default, user.id=bb7614d8c4184d29a9515f84d7487a48) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:14.666116 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:14.667586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:14.675672 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 9 15:28:14 2022] GET /identity/v3/role_assignments?user.id=bb7614d8c4184d29a9515f84d7487a48&scope.domain.id=default&role.id=8cf832105b2949f6b11e06b208146326 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:14.690502 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2391f-6844-4c3d-857c-e2bd153d8019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:14.691330 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2391f-6844-4c3d-857c-e2bd153d8019 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.691614 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2391f-6844-4c3d-857c-e2bd153d8019 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.691927 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2391f-6844-4c3d-857c-e2bd153d8019 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.693218 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2391f-6844-4c3d-857c-e2bd153d8019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:14.694720 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2391f-6844-4c3d-857c-e2bd153d8019 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:14.696688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 29/56] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:14.703209 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:14.808189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c2b8a-aa50-498b-b983-2a5fe3f02e89 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:14.844309 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa8e71-8528-4714-ade4-40820e0c305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:14.845006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8e71-8528-4714-ade4-40820e0c305b None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:14.845266 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8e71-8528-4714-ade4-40820e0c305b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:14.845543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa8e71-8528-4714-ade4-40820e0c305b None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:14.846290 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa8e71-8528-4714-ade4-40820e0c305b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:14.847802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa8e71-8528-4714-ade4-40820e0c305b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:14.875308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 28/57] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 9 15:28:14 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:17.122221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cfadd-06fe-4ce7-a0d5-c5e8ed3cb805 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:17.122758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cfadd-06fe-4ce7-a0d5-c5e8ed3cb805 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:17.122758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cfadd-06fe-4ce7-a0d5-c5e8ed3cb805 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:17.124169 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 30/58] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:17.129383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbb83-1ab2-424e-af7c-c23392e9152c None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:17.129798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbb83-1ab2-424e-af7c-c23392e9152c None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:17.129936 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbb83-1ab2-424e-af7c-c23392e9152c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:17.146385 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-3bacbb83-1ab2-424e-af7c-c23392e9152c None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:17.147586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-3bacbb83-1ab2-424e-af7c-c23392e9152c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:17.212184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 29/59] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:17.236241 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cfadd-06fe-4ce7-a0d5-c5e8ed3cb805 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:17.332223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cfadd-06fe-4ce7-a0d5-c5e8ed3cb805 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:17.364486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a374d-f115-4999-8f91-cf1093d16b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:17.365263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a374d-f115-4999-8f91-cf1093d16b90 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:17.365541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a374d-f115-4999-8f91-cf1093d16b90 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:17.365812 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a374d-f115-4999-8f91-cf1093d16b90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:17.366988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a374d-f115-4999-8f91-cf1093d16b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:17.368490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a374d-f115-4999-8f91-cf1093d16b90 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:17.370932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 31/60] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:17.376752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbb83-1ab2-424e-af7c-c23392e9152c None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:17.472435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbb83-1ab2-424e-af7c-c23392e9152c None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:17.515611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb380874-150a-4115-aebb-fb4fc979d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:17.516323 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb380874-150a-4115-aebb-fb4fc979d897 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:17.516607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb380874-150a-4115-aebb-fb4fc979d897 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:17.516885 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb380874-150a-4115-aebb-fb4fc979d897 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:17.517607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb380874-150a-4115-aebb-fb4fc979d897 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:17.519058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb380874-150a-4115-aebb-fb4fc979d897 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:17.545071 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 30/61] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:28:17 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:28:20.887890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6f95-13a0-46b1-ac70-7db18f3d0f57 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:20.888460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6f95-13a0-46b1-ac70-7db18f3d0f57 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:20.888460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6f95-13a0-46b1-ac70-7db18f3d0f57 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:20.889845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 32/62] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:20.895902 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bc23-068b-4344-b817-2e064a58c383 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:20.896451 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bc23-068b-4344-b817-2e064a58c383 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:20.896451 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381bc23-068b-4344-b817-2e064a58c383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:20.919087 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-3381bc23-068b-4344-b817-2e064a58c383 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:20.920339 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-3381bc23-068b-4344-b817-2e064a58c383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:21.010524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 31/63] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:21.046312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd6f95-13a0-46b1-ac70-7db18f3d0f57 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:21.143961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d494-8201-4c79-81fa-d30d90591f3f None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.144150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d494-8201-4c79-81fa-d30d90591f3f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.144438 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763d494-8201-4c79-81fa-d30d90591f3f None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.145840 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 32/64] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:28:21.150855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e76a80-03d4-4ed3-a3cf-3386e03b1870 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.151204 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e76a80-03d4-4ed3-a3cf-3386e03b1870 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.151462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e76a80-03d4-4ed3-a3cf-3386e03b1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.175683 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-f2e76a80-03d4-4ed3-a3cf-3386e03b1870 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:21.176915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-f2e76a80-03d4-4ed3-a3cf-3386e03b1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:21.203850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd6f95-13a0-46b1-ac70-7db18f3d0f57 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:21.274061 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ea2d-4976-4933-8d13-303e066667ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:21.274874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ea2d-4976-4933-8d13-303e066667ab None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.275161 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ea2d-4976-4933-8d13-303e066667ab None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.275438 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ea2d-4976-4933-8d13-303e066667ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.289001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208ea2d-4976-4933-8d13-303e066667ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:21.290868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 33/65] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:21.292812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055c9d-f94e-40d7-bb94-4aa1991f7013 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.293314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055c9d-f94e-40d7-bb94-4aa1991f7013 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.293765 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0055c9d-f94e-40d7-bb94-4aa1991f7013 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.295276 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 34/66] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-9208ea2d-4976-4933-8d13-303e066667ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:21.302495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:21.303553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:21.304470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:21.307066 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 33/67] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:21.309941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432f34-3534-42d2-8883-de902c00b354 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.310491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432f34-3534-42d2-8883-de902c00b354 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.310986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa432f34-3534-42d2-8883-de902c00b354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.315891 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ea2d-4976-4933-8d13-303e066667ab None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:21.334291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-aa432f34-3534-42d2-8883-de902c00b354 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:21.336639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-aa432f34-3534-42d2-8883-de902c00b354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:21.430170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 35/68] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:21.431519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa432f34-3534-42d2-8883-de902c00b354 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:21.453980 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ea2d-4976-4933-8d13-303e066667ab None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:21.490070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:21.491069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.491515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.491974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.492923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:21.493392 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:21.495743 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:21.505798 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 34/69] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:21.512355 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:21.561689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa432f34-3534-42d2-8883-de902c00b354 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:21.596420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5805ffb-c032-45f4-a8cb-8980d056fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:21.597550 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5805ffb-c032-45f4-a8cb-8980d056fac3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.598020 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5805ffb-c032-45f4-a8cb-8980d056fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.598494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5805ffb-c032-45f4-a8cb-8980d056fac3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.610533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5805ffb-c032-45f4-a8cb-8980d056fac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:21.614585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cd196-96f5-43fb-aec6-f4e6c8512343 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-a5805ffb-c032-45f4-a8cb-8980d056fac3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:21.620068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:21.621150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:21.622222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:21.624369 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 36/70] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:21.625311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5805ffb-c032-45f4-a8cb-8980d056fac3 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:21.658978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f2cd1-7760-4518-a599-51956445f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:21.659647 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f2cd1-7760-4518-a599-51956445f10a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.659948 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f2cd1-7760-4518-a599-51956445f10a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.660140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f2cd1-7760-4518-a599-51956445f10a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.672281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f2cd1-7760-4518-a599-51956445f10a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-9d7f2cd1-7760-4518-a599-51956445f10a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:21.680431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:21.681420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 35/71] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:21.683441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e56b3-b47f-42e1-9b6c-1bc44b97993c None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.685293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e56b3-b47f-42e1-9b6c-1bc44b97993c None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.685293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e56b3-b47f-42e1-9b6c-1bc44b97993c None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.685293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 36/72] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:21.686062 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e56b3-b47f-42e1-9b6c-1bc44b97993c None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:21.734187 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5805ffb-c032-45f4-a8cb-8980d056fac3 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:21.766382 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c16487-a482-48a1-8f26-841ca87eee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:21.767253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c16487-a482-48a1-8f26-841ca87eee48 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.767535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c16487-a482-48a1-8f26-841ca87eee48 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.767834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c16487-a482-48a1-8f26-841ca87eee48 None admin] PATH_INFO: `/v3/users/bb7614d8c4184d29a9515f84d7487a48` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.769058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c16487-a482-48a1-8f26-841ca87eee48 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7614d8c4184d29a9515f84d7487a48)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:21.770519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c16487-a482-48a1-8f26-841ca87eee48 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:21.772185 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 37/73] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/users/bb7614d8c4184d29a9515f84d7487a48 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:21.772964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c16487-a482-48a1-8f26-841ca87eee48 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:21.791047 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e56b3-b47f-42e1-9b6c-1bc44b97993c None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:21.824471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f0d17-1632-409e-8ecb-5b62bc868b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:21.825144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0d17-1632-409e-8ecb-5b62bc868b84 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.825428 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0d17-1632-409e-8ecb-5b62bc868b84 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.825709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f0d17-1632-409e-8ecb-5b62bc868b84 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.826472 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0d17-1632-409e-8ecb-5b62bc868b84 None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:21.826785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0d17-1632-409e-8ecb-5b62bc868b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:21.828222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f0d17-1632-409e-8ecb-5b62bc868b84 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:21.836470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 37/74] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:21.836470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e925c5-426c-403c-a1f5-17bac397b61c None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.836470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e925c5-426c-403c-a1f5-17bac397b61c None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.836470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e925c5-426c-403c-a1f5-17bac397b61c None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.836470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 38/75] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:21.836470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664de2d-0694-4e1b-9e92-4b37238f3de6 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.836470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664de2d-0694-4e1b-9e92-4b37238f3de6 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.842270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664de2d-0694-4e1b-9e92-4b37238f3de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.858509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-9664de2d-0694-4e1b-9e92-4b37238f3de6 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:21.859715 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-9664de2d-0694-4e1b-9e92-4b37238f3de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:21.877627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c16487-a482-48a1-8f26-841ca87eee48 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:21.909947 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:21.910626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:21.910916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:21.911198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:21.911989 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:21.912332 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:21.913719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:21.922206 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 38/76] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:21.922206 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:21.926907 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 39/77] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:21.926907 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664de2d-0694-4e1b-9e92-4b37238f3de6 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.032045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664de2d-0694-4e1b-9e92-4b37238f3de6 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.041497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be1222-559c-4a3d-b547-11a9a6b5301c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.065759 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242be24-fdc3-4b73-80fa-239ea5d58c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.066627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242be24-fdc3-4b73-80fa-239ea5d58c7b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.066911 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242be24-fdc3-4b73-80fa-239ea5d58c7b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.067184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242be24-fdc3-4b73-80fa-239ea5d58c7b None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.074139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2cb0-4801-4545-ae5e-07cf2b2414af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.074792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2cb0-4801-4545-ae5e-07cf2b2414af None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.075075 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2cb0-4801-4545-ae5e-07cf2b2414af None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.075352 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2cb0-4801-4545-ae5e-07cf2b2414af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.080736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242be24-fdc3-4b73-80fa-239ea5d58c7b None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.082207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242be24-fdc3-4b73-80fa-239ea5d58c7b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.083936 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 40/78] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:22.089155 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e7c0-f81d-42e4-900e-afcd36d122af None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.089155 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e7c0-f81d-42e4-900e-afcd36d122af None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.089155 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02e7c0-f81d-42e4-900e-afcd36d122af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.102093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-ae02e7c0-f81d-42e4-900e-afcd36d122af None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:22.103376 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-ae02e7c0-f81d-42e4-900e-afcd36d122af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:22.139961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2cb0-4801-4545-ae5e-07cf2b2414af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.141421 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2cb0-4801-4545-ae5e-07cf2b2414af None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.168312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 41/79] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:22.169156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02e7c0-f81d-42e4-900e-afcd36d122af None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.238072 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 39/80] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:22.238932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2cb0-4801-4545-ae5e-07cf2b2414af None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.263700 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02e7c0-f81d-42e4-900e-afcd36d122af None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.297203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44faa52-fa64-48f3-90f9-fd54864cfbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.298009 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44faa52-fa64-48f3-90f9-fd54864cfbd6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.298297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44faa52-fa64-48f3-90f9-fd54864cfbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.298573 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44faa52-fa64-48f3-90f9-fd54864cfbd6 None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.299825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44faa52-fa64-48f3-90f9-fd54864cfbd6 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.301299 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44faa52-fa64-48f3-90f9-fd54864cfbd6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.302949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 42/81] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:22.302949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44faa52-fa64-48f3-90f9-fd54864cfbd6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.341005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2cb0-4801-4545-ae5e-07cf2b2414af None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.375523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11981f7e-f9b3-4490-8c60-dffca99aa4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.376368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11981f7e-f9b3-4490-8c60-dffca99aa4d2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.376655 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11981f7e-f9b3-4490-8c60-dffca99aa4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.377020 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11981f7e-f9b3-4490-8c60-dffca99aa4d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.388110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11981f7e-f9b3-4490-8c60-dffca99aa4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-11981f7e-f9b3-4490-8c60-dffca99aa4d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:22.395701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:22.396729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:22.397598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 40/82] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:22.398349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11981f7e-f9b3-4490-8c60-dffca99aa4d2 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.405990 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44faa52-fa64-48f3-90f9-fd54864cfbd6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.439071 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896237ab-81bc-4634-a6f5-4a1b4ca9f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.439995 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896237ab-81bc-4634-a6f5-4a1b4ca9f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.440276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896237ab-81bc-4634-a6f5-4a1b4ca9f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.440550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896237ab-81bc-4634-a6f5-4a1b4ca9f1e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.496687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11981f7e-f9b3-4490-8c60-dffca99aa4d2 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.508624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896237ab-81bc-4634-a6f5-4a1b4ca9f1e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.510130 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896237ab-81bc-4634-a6f5-4a1b4ca9f1e9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.529833 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812fe10-0bbe-4f56-9cdc-1ce652865118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.530628 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812fe10-0bbe-4f56-9cdc-1ce652865118 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.530911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812fe10-0bbe-4f56-9cdc-1ce652865118 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.531187 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812fe10-0bbe-4f56-9cdc-1ce652865118 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.532402 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812fe10-0bbe-4f56-9cdc-1ce652865118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.533844 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812fe10-0bbe-4f56-9cdc-1ce652865118 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.535463 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 41/83] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:22.535463 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812fe10-0bbe-4f56-9cdc-1ce652865118 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.607497 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 43/84] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:22.608429 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896237ab-81bc-4634-a6f5-4a1b4ca9f1e9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.636793 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812fe10-0bbe-4f56-9cdc-1ce652865118 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.669825 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab944b6e-a3ae-444b-908c-c8143a205b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.670691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944b6e-a3ae-444b-908c-c8143a205b97 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.670979 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944b6e-a3ae-444b-908c-c8143a205b97 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.671259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944b6e-a3ae-444b-908c-c8143a205b97 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.672497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab944b6e-a3ae-444b-908c-c8143a205b97 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.673956 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab944b6e-a3ae-444b-908c-c8143a205b97 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.675678 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 42/85] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:22.676481 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab944b6e-a3ae-444b-908c-c8143a205b97 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.702107 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896237ab-81bc-4634-a6f5-4a1b4ca9f1e9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.734109 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924af7e-fc91-4327-8c04-7f1359abd8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.734753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924af7e-fc91-4327-8c04-7f1359abd8fe None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.735032 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924af7e-fc91-4327-8c04-7f1359abd8fe None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.735308 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924af7e-fc91-4327-8c04-7f1359abd8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.775546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab944b6e-a3ae-444b-908c-c8143a205b97 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.801495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924af7e-fc91-4327-8c04-7f1359abd8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.802956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924af7e-fc91-4327-8c04-7f1359abd8fe None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.808429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.809097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.809382 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.809659 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.810408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] RBAC: Adding query filter params (name=member) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:22.810712 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.812100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.820368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 43/86] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:22.820958 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.897160 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 44/87] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:22.898015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924af7e-fc91-4327-8c04-7f1359abd8fe None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:22.920407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991f109-2cf6-4ca1-b91d-2934abec011a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:22.953843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a46576-7494-4b1c-809e-d10632b73125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:22.954519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a46576-7494-4b1c-809e-d10632b73125 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:22.954807 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a46576-7494-4b1c-809e-d10632b73125 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:22.955087 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a46576-7494-4b1c-809e-d10632b73125 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:22.955833 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a46576-7494-4b1c-809e-d10632b73125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:22.957293 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a46576-7494-4b1c-809e-d10632b73125 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:22.977281 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 44/88] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:28:22 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:22.978103 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a46576-7494-4b1c-809e-d10632b73125 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:23.000009 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924af7e-fc91-4327-8c04-7f1359abd8fe None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:23.038233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed25e5-faea-473b-ba02-1586b50649bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:23.039139 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed25e5-faea-473b-ba02-1586b50649bb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:23.039426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed25e5-faea-473b-ba02-1586b50649bb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:23.039708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed25e5-faea-473b-ba02-1586b50649bb None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:23.041074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed25e5-faea-473b-ba02-1586b50649bb None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:23.043363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed25e5-faea-473b-ba02-1586b50649bb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:23.050241 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 45/89] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:23.050241 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed25e5-faea-473b-ba02-1586b50649bb None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:23.087630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a46576-7494-4b1c-809e-d10632b73125 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:23.126415 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:23.127102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:23.127390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:23.127673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:23.128574 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=3d5767bb2ca248d48c5820335e1738c7, user.id=bb7614d8c4184d29a9515f84d7487a48) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:23.128891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:23.130380 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:23.137909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 45/90] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:22 2022] GET /identity/v3/role_assignments?user.id=bb7614d8c4184d29a9515f84d7487a48&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=8cf832105b2949f6b11e06b208146326 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:23.138618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:23.171116 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed25e5-faea-473b-ba02-1586b50649bb None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:23.219328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83eee-e4c9-4aca-937c-807d324839b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:23.220338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83eee-e4c9-4aca-937c-807d324839b9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:23.220629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83eee-e4c9-4aca-937c-807d324839b9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:23.220911 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83eee-e4c9-4aca-937c-807d324839b9 None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:23.223123 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83eee-e4c9-4aca-937c-807d324839b9 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:23.225215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83eee-e4c9-4aca-937c-807d324839b9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:23.226536 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 46/91] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:23 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:23.232327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83eee-e4c9-4aca-937c-807d324839b9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:23.258203 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dbc23-f1c5-41e9-b6be-f3dce6530004 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:23.296568 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86cf6d-3dcf-4435-ab4b-a58604ef7f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:23.297460 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86cf6d-3dcf-4435-ab4b-a58604ef7f94 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:23.297750 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86cf6d-3dcf-4435-ab4b-a58604ef7f94 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:23.298032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86cf6d-3dcf-4435-ab4b-a58604ef7f94 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:23.299348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86cf6d-3dcf-4435-ab4b-a58604ef7f94 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:23.300852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86cf6d-3dcf-4435-ab4b-a58604ef7f94 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:23.302967 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 46/92] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:23 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:23.303842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86cf6d-3dcf-4435-ab4b-a58604ef7f94 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:23.359297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83eee-e4c9-4aca-937c-807d324839b9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:23.416721 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86cf6d-3dcf-4435-ab4b-a58604ef7f94 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:23.417299 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:23.417973 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:23.418262 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:23.418546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:23.419417 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] RBAC: Adding query filter params (role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=3d5767bb2ca248d48c5820335e1738c7, user.id=c4d4881e6ced433aab8e2c1035d9d174) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:23.419736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:23.421314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:23.427219 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 47/93] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:23 2022] GET /identity/v3/role_assignments?user.id=c4d4881e6ced433aab8e2c1035d9d174&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:23.428076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:23.458345 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa1e01-24f6-42ae-9731-329b312a9cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:23.459019 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa1e01-24f6-42ae-9731-329b312a9cc5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:23.459353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa1e01-24f6-42ae-9731-329b312a9cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:23.459641 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa1e01-24f6-42ae-9731-329b312a9cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:23.537330 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b59c9-e2e5-4c54-8757-4a3993e62d65 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:23.538294 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa1e01-24f6-42ae-9731-329b312a9cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:23.539870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa1e01-24f6-42ae-9731-329b312a9cc5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:23.576893 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:23.577749 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:23.578436 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:23.578731 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:23.579976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] RBAC: Adding query filter params (role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=3d5767bb2ca248d48c5820335e1738c7, user.id=c4d4881e6ced433aab8e2c1035d9d174) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:23.580306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:23.582020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:23.589862 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 48/94] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:23 2022] GET /identity/v3/role_assignments?user.id=c4d4881e6ced433aab8e2c1035d9d174&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=7c610827438840438f3b3e90fac7c51c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:23.673500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 47/95] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:23.684979 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:23.804844 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081924-be9b-4e05-ad4a-219e285d46f0 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:23.842780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed653c7-37a6-4844-8368-0991a8f2eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:23.843682 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed653c7-37a6-4844-8368-0991a8f2eef3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:23.844005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed653c7-37a6-4844-8368-0991a8f2eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:23.844293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed653c7-37a6-4844-8368-0991a8f2eef3 None admin] PATH_INFO: `/v3/projects/d81824eec88248b5b24de5ca0277b615` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:23.845579 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed653c7-37a6-4844-8368-0991a8f2eef3 None admin] RBAC: Authorizing `identity:get_project(project_id=d81824eec88248b5b24de5ca0277b615)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:23.847063 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed653c7-37a6-4844-8368-0991a8f2eef3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:23.849109 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 49/96] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:23 2022] GET /identity/v3/projects/d81824eec88248b5b24de5ca0277b615 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:23.855833 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa1e01-24f6-42ae-9731-329b312a9cc5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:23.997241 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa1e01-24f6-42ae-9731-329b312a9cc5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:24.039308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455466-9bd7-4b0d-9739-372bbf91f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:24.040011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455466-9bd7-4b0d-9739-372bbf91f8be None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:24.040298 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455466-9bd7-4b0d-9739-372bbf91f8be None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:24.040579 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455466-9bd7-4b0d-9739-372bbf91f8be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:24.041434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455466-9bd7-4b0d-9739-372bbf91f8be None admin] RBAC: Adding query filter params (role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=d81824eec88248b5b24de5ca0277b615, user.id=c4d4881e6ced433aab8e2c1035d9d174) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:24.041947 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455466-9bd7-4b0d-9739-372bbf91f8be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:24.043630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455466-9bd7-4b0d-9739-372bbf91f8be None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:24.049826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 48/97] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:23 2022] GET /identity/v3/role_assignments?user.id=c4d4881e6ced433aab8e2c1035d9d174&scope.project.id=d81824eec88248b5b24de5ca0277b615&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:26.113951 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1178d-7b96-455c-b0ca-128150945cd3 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.114564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1178d-7b96-455c-b0ca-128150945cd3 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.114564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1178d-7b96-455c-b0ca-128150945cd3 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.116178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 50/98] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:26.122389 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88fef-4f53-4dad-b865-b6af68491d50 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.122906 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88fef-4f53-4dad-b865-b6af68491d50 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.123008 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88fef-4f53-4dad-b865-b6af68491d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.141296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-76a88fef-4f53-4dad-b865-b6af68491d50 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:26.142511 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-76a88fef-4f53-4dad-b865-b6af68491d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:26.242117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 49/99] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:26.283448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1178d-7b96-455c-b0ca-128150945cd3 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:26.414027 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1178d-7b96-455c-b0ca-128150945cd3 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:26.472558 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5e26f-28a2-49f8-942c-b506ea8759c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:26.473412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e26f-28a2-49f8-942c-b506ea8759c7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.473704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e26f-28a2-49f8-942c-b506ea8759c7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.473985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5e26f-28a2-49f8-942c-b506ea8759c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.493061 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5e26f-28a2-49f8-942c-b506ea8759c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-d5a5e26f-28a2-49f8-942c-b506ea8759c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:26.502278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:26.503406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:26.504896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 51/100] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:26.512518 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a88fef-4f53-4dad-b865-b6af68491d50 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:26.653388 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a88fef-4f53-4dad-b865-b6af68491d50 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:26.691348 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0deb3-eafb-4893-bd4a-f5b1a63aece6 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.691698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0deb3-eafb-4893-bd4a-f5b1a63aece6 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.691915 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0deb3-eafb-4893-bd4a-f5b1a63aece6 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.693441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 52/101] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:26.699372 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66834-fd97-47fd-8243-2f4699a94616 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.699658 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66834-fd97-47fd-8243-2f4699a94616 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.699984 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66834-fd97-47fd-8243-2f4699a94616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.706904 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f7d59-f7f3-43cd-9086-737d7286e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:26.707594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7d59-f7f3-43cd-9086-737d7286e7db None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.707907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7d59-f7f3-43cd-9086-737d7286e7db None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.708189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f7d59-f7f3-43cd-9086-737d7286e7db None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.709526 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f7d59-f7f3-43cd-9086-737d7286e7db None admin] RBAC: Adding query filter params (name=reader) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:26.709526 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f7d59-f7f3-43cd-9086-737d7286e7db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:26.710649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f7d59-f7f3-43cd-9086-737d7286e7db None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:26.728077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 50/102] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:26.728077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3600-1c35-49a1-ba12-927910db6f43 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.728077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3600-1c35-49a1-ba12-927910db6f43 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.728077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3600-1c35-49a1-ba12-927910db6f43 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.728077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 51/103] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:26.730931 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-e1d66834-fd97-47fd-8243-2f4699a94616 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:26.732358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-e1d66834-fd97-47fd-8243-2f4699a94616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:26.738551 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c3600-1c35-49a1-ba12-927910db6f43 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:26.880033 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 53/104] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:26.881381 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af94c6-62ee-4dc0-a636-43b5bd16688a None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.881720 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af94c6-62ee-4dc0-a636-43b5bd16688a None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.881935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af94c6-62ee-4dc0-a636-43b5bd16688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.893289 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c3600-1c35-49a1-ba12-927910db6f43 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:26.899371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-59af94c6-62ee-4dc0-a636-43b5bd16688a None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:26.900601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-59af94c6-62ee-4dc0-a636-43b5bd16688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:26.933897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486d411-60bf-4ef7-bf3d-ef7020da9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:26.934801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486d411-60bf-4ef7-bf3d-ef7020da9a58 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.935090 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486d411-60bf-4ef7-bf3d-ef7020da9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.935369 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486d411-60bf-4ef7-bf3d-ef7020da9a58 None admin] PATH_INFO: `/v3/users/1760116515f34b5fb2889a2dc579c898` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.955359 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486d411-60bf-4ef7-bf3d-ef7020da9a58 None admin] RBAC: Authorizing `identity:get_user(user_id=1760116515f34b5fb2889a2dc579c898)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:26.956884 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486d411-60bf-4ef7-bf3d-ef7020da9a58 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:26.963209 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 52/105] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:26 2022] GET /identity/v3/users/1760116515f34b5fb2889a2dc579c898 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:26.964936 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba450-f363-4ce6-807d-1ddabe808e13 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.965234 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba450-f363-4ce6-807d-1ddabe808e13 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.965523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba450-f363-4ce6-807d-1ddabe808e13 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:26.966842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 53/106] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:26.971554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ba450-f363-4ce6-807d-1ddabe808e13 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:26.992671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 54/107] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:26.994320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7439e-5016-4b88-b7a3-04ea006e8fb3 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:26.994966 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7439e-5016-4b88-b7a3-04ea006e8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:26.995589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7439e-5016-4b88-b7a3-04ea006e8fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.021751 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-ecc7439e-5016-4b88-b7a3-04ea006e8fb3 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:27.023011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-ecc7439e-5016-4b88-b7a3-04ea006e8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:27.102550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 55/108] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:27.108712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7439e-5016-4b88-b7a3-04ea006e8fb3 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.123800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ba450-f363-4ce6-807d-1ddabe808e13 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.169939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589322a7-6e4b-4baf-bb37-b2e5c3ea0f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.171149 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589322a7-6e4b-4baf-bb37-b2e5c3ea0f29 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.171604 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589322a7-6e4b-4baf-bb37-b2e5c3ea0f29 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.172209 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589322a7-6e4b-4baf-bb37-b2e5c3ea0f29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.186821 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589322a7-6e4b-4baf-bb37-b2e5c3ea0f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-589322a7-6e4b-4baf-bb37-b2e5c3ea0f29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:27.198657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:27.200051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:27.201154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:27.203643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 54/109] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:27.204652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589322a7-6e4b-4baf-bb37-b2e5c3ea0f29 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.235831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7439e-5016-4b88-b7a3-04ea006e8fb3 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.270950 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7061ee-8a08-4d43-a445-adeab6377b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.271616 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7061ee-8a08-4d43-a445-adeab6377b91 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.271942 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7061ee-8a08-4d43-a445-adeab6377b91 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.272223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7061ee-8a08-4d43-a445-adeab6377b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.332842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589322a7-6e4b-4baf-bb37-b2e5c3ea0f29 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.341520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7061ee-8a08-4d43-a445-adeab6377b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:27.342993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7061ee-8a08-4d43-a445-adeab6377b91 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:27.366091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20501-a39c-45d7-93fe-4e3e07049c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.366903 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20501-a39c-45d7-93fe-4e3e07049c9b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.367192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20501-a39c-45d7-93fe-4e3e07049c9b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.367842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20501-a39c-45d7-93fe-4e3e07049c9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.379952 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac20501-a39c-45d7-93fe-4e3e07049c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-aac20501-a39c-45d7-93fe-4e3e07049c9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:27.389028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:27.390033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:27.390961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:27.393118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 55/110] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:27.394082 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20501-a39c-45d7-93fe-4e3e07049c9b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.456631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 56/111] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:27.457762 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7061ee-8a08-4d43-a445-adeab6377b91 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.511462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20501-a39c-45d7-93fe-4e3e07049c9b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.550708 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc02ff-e141-4083-8f12-a593adf8da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.551541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc02ff-e141-4083-8f12-a593adf8da3a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.551857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc02ff-e141-4083-8f12-a593adf8da3a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.552171 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc02ff-e141-4083-8f12-a593adf8da3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.564284 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc02ff-e141-4083-8f12-a593adf8da3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:27.565507 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7061ee-8a08-4d43-a445-adeab6377b91 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-4fcc02ff-e141-4083-8f12-a593adf8da3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:27.573356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:27.574693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:27.575629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 56/112] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:27.580790 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98533a-b5d5-467d-8387-0ab0b2f1a2a4 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.581092 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98533a-b5d5-467d-8387-0ab0b2f1a2a4 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.581385 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98533a-b5d5-467d-8387-0ab0b2f1a2a4 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.582828 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 57/113] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:27.583462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98533a-b5d5-467d-8387-0ab0b2f1a2a4 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.606688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.607689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.608166 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.608670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.609604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:27.610114 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:27.611789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:27.623806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 57/114] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:27.623806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.698304 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98533a-b5d5-467d-8387-0ab0b2f1a2a4 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.722148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366d19-599b-4b10-b0dc-a3439c8c6d53 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.731666 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.732381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.732668 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.732951 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.733710 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:27.734022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:27.735425 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:27.743747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 58/115] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:27.744637 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.755292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ec48-8526-4f7e-bee9-badfdc9dcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.756189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ec48-8526-4f7e-bee9-badfdc9dcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.756494 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ec48-8526-4f7e-bee9-badfdc9dcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.756751 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ec48-8526-4f7e-bee9-badfdc9dcdf5 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.757972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625ec48-8526-4f7e-bee9-badfdc9dcdf5 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:27.759424 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625ec48-8526-4f7e-bee9-badfdc9dcdf5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:27.762271 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 58/116] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:27.763424 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ab37-3ffb-4a85-ab4d-4a2ea3e72afa None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.763731 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ab37-3ffb-4a85-ab4d-4a2ea3e72afa None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.764024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ab37-3ffb-4a85-ab4d-4a2ea3e72afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.780180 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-1145ab37-3ffb-4a85-ab4d-4a2ea3e72afa None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:27.781373 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-1145ab37-3ffb-4a85-ab4d-4a2ea3e72afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:27.844786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f1ee3-c377-49b2-b8dc-2773881ab71e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.846849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 59/117] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:27.847676 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ab37-3ffb-4a85-ab4d-4a2ea3e72afa None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.887917 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5411-f6c7-4d94-ac4f-fb270fb185a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.888621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5411-f6c7-4d94-ac4f-fb270fb185a4 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.888915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5411-f6c7-4d94-ac4f-fb270fb185a4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.889190 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5411-f6c7-4d94-ac4f-fb270fb185a4 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.889948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5411-f6c7-4d94-ac4f-fb270fb185a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:27.890267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5411-f6c7-4d94-ac4f-fb270fb185a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:27.891640 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5411-f6c7-4d94-ac4f-fb270fb185a4 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:27.899508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 59/118] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:27.903167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b118-7007-48d7-9c1c-75873375f9c1 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.903452 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b118-7007-48d7-9c1c-75873375f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.903735 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5b118-7007-48d7-9c1c-75873375f9c1 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.905101 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 60/119] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:27.908614 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5b118-7007-48d7-9c1c-75873375f9c1 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:27.944059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ab37-3ffb-4a85-ab4d-4a2ea3e72afa None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:27.978265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cee55b-3db1-4182-98d6-3a7ca31458f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:27.979243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cee55b-3db1-4182-98d6-3a7ca31458f5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:27.979531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cee55b-3db1-4182-98d6-3a7ca31458f5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:27.979840 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cee55b-3db1-4182-98d6-3a7ca31458f5 None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:27.981066 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cee55b-3db1-4182-98d6-3a7ca31458f5 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:27.982521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cee55b-3db1-4182-98d6-3a7ca31458f5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:27.984199 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 60/120] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:27.988859 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cee55b-3db1-4182-98d6-3a7ca31458f5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.012169 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5b118-7007-48d7-9c1c-75873375f9c1 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.045490 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afa49-d038-41aa-b720-d6c18087b0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.046368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afa49-d038-41aa-b720-d6c18087b0a0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.046655 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afa49-d038-41aa-b720-d6c18087b0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.046932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afa49-d038-41aa-b720-d6c18087b0a0 None admin] PATH_INFO: `/v3/users/bb7614d8c4184d29a9515f84d7487a48` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.048164 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88afa49-d038-41aa-b720-d6c18087b0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7614d8c4184d29a9515f84d7487a48)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.049710 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88afa49-d038-41aa-b720-d6c18087b0a0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.051524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 61/121] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/users/bb7614d8c4184d29a9515f84d7487a48 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:28.052139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afa49-d038-41aa-b720-d6c18087b0a0 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.084349 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cee55b-3db1-4182-98d6-3a7ca31458f5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.117137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.117868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.118154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.118430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.119271 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] RBAC: Adding query filter params (role.id=a53fd65b58a64e39bee8522541c38253, scope.project.id=3d5767bb2ca248d48c5820335e1738c7, user.id=1760116515f34b5fb2889a2dc579c898) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:28.120157 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.122102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.127395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 61/122] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:27 2022] GET /identity/v3/role_assignments?user.id=1760116515f34b5fb2889a2dc579c898&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=a53fd65b58a64e39bee8522541c38253 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:28.140217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.152395 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afa49-d038-41aa-b720-d6c18087b0a0 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.190382 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d3117-2542-492e-951b-bef771a473a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.191220 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3117-2542-492e-951b-bef771a473a0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.191511 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3117-2542-492e-951b-bef771a473a0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.191810 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d3117-2542-492e-951b-bef771a473a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.193126 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3117-2542-492e-951b-bef771a473a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.194655 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d3117-2542-492e-951b-bef771a473a0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.196618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 62/123] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:28.198425 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdfa10-52aa-4059-8cca-b04a9bab0874 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.198783 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdfa10-52aa-4059-8cca-b04a9bab0874 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.198783 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdfa10-52aa-4059-8cca-b04a9bab0874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.216518 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-79cdfa10-52aa-4059-8cca-b04a9bab0874 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:28.217782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-79cdfa10-52aa-4059-8cca-b04a9bab0874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:28.251148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c02d7-62ab-4b6c-81dd-1d127e6200e8 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.287328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22749-e52f-4ee9-80ea-15da99eb44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.288261 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22749-e52f-4ee9-80ea-15da99eb44db None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.288721 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 63/124] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:28.288858 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22749-e52f-4ee9-80ea-15da99eb44db None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.289311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdfa10-52aa-4059-8cca-b04a9bab0874 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.292675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c22749-e52f-4ee9-80ea-15da99eb44db None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.294817 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c22749-e52f-4ee9-80ea-15da99eb44db None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.296356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c22749-e52f-4ee9-80ea-15da99eb44db None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.298305 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 62/125] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:28 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:28.298886 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22749-e52f-4ee9-80ea-15da99eb44db None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.394802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdfa10-52aa-4059-8cca-b04a9bab0874 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.412265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c22749-e52f-4ee9-80ea-15da99eb44db None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.428398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3d63-6668-45b0-a11b-781b75379666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.429271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3d63-6668-45b0-a11b-781b75379666 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.429550 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3d63-6668-45b0-a11b-781b75379666 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.429826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e3d63-6668-45b0-a11b-781b75379666 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.431013 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e3d63-6668-45b0-a11b-781b75379666 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.433138 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e3d63-6668-45b0-a11b-781b75379666 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.434848 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 64/126] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:28 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:28.436583 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3d63-6668-45b0-a11b-781b75379666 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.450208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476d9ad-30f2-4572-bf1d-e0db8272632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.451407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476d9ad-30f2-4572-bf1d-e0db8272632b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.451947 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476d9ad-30f2-4572-bf1d-e0db8272632b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.452409 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476d9ad-30f2-4572-bf1d-e0db8272632b None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.453637 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476d9ad-30f2-4572-bf1d-e0db8272632b None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.455123 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476d9ad-30f2-4572-bf1d-e0db8272632b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.457042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 63/127] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:28 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:28.462247 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476d9ad-30f2-4572-bf1d-e0db8272632b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.535465 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e3d63-6668-45b0-a11b-781b75379666 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.562404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476d9ad-30f2-4572-bf1d-e0db8272632b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.569859 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1304d4-b5f4-4cd0-aa9f-17af01643309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.570534 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1304d4-b5f4-4cd0-aa9f-17af01643309 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.570841 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1304d4-b5f4-4cd0-aa9f-17af01643309 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.571104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1304d4-b5f4-4cd0-aa9f-17af01643309 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.571861 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1304d4-b5f4-4cd0-aa9f-17af01643309 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.574039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1304d4-b5f4-4cd0-aa9f-17af01643309 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.601041 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a774c2a-7e70-4544-a867-18ebd7c7542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.601290 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 65/128] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:28:28 2022] POST /identity/v3/projects => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:28.602372 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774c2a-7e70-4544-a867-18ebd7c7542a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.602821 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774c2a-7e70-4544-a867-18ebd7c7542a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.603257 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774c2a-7e70-4544-a867-18ebd7c7542a None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.604705 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a774c2a-7e70-4544-a867-18ebd7c7542a None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.606509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a774c2a-7e70-4544-a867-18ebd7c7542a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.609158 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 64/129] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:28 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:28.610173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a774c2a-7e70-4544-a867-18ebd7c7542a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.612833 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1304d4-b5f4-4cd0-aa9f-17af01643309 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.726373 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a774c2a-7e70-4544-a867-18ebd7c7542a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.729592 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1304d4-b5f4-4cd0-aa9f-17af01643309 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.765828 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f302536-6508-4766-9cc4-8513f3aeef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.766522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d697379-f22c-4d0a-8c6a-2a04d3ec6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.767412 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697379-f22c-4d0a-8c6a-2a04d3ec6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.767649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f302536-6508-4766-9cc4-8513f3aeef41 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.767783 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697379-f22c-4d0a-8c6a-2a04d3ec6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.768145 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697379-f22c-4d0a-8c6a-2a04d3ec6bd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.768463 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f302536-6508-4766-9cc4-8513f3aeef41 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.769115 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f302536-6508-4766-9cc4-8513f3aeef41 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7/users/c4d4881e6ced433aab8e2c1035d9d174/roles/68bfbd93f3e34ca58a58a2d237564990` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.771574 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f302536-6508-4766-9cc4-8513f3aeef41 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d5767bb2ca248d48c5820335e1738c7, user_id=c4d4881e6ced433aab8e2c1035d9d174, role_id=68bfbd93f3e34ca58a58a2d237564990)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.773337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f302536-6508-4766-9cc4-8513f3aeef41 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.781119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d697379-f22c-4d0a-8c6a-2a04d3ec6bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-6d697379-f22c-4d0a-8c6a-2a04d3ec6bd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:28.789271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:28.790287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:28.791227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 66/130] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:28.792594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d697379-f22c-4d0a-8c6a-2a04d3ec6bd4 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.798701 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 65/131] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:28 2022] PUT /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7/users/c4d4881e6ced433aab8e2c1035d9d174/roles/68bfbd93f3e34ca58a58a2d237564990 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:28.798701 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f302536-6508-4766-9cc4-8513f3aeef41 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:28.922957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f302536-6508-4766-9cc4-8513f3aeef41 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.934874 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d697379-f22c-4d0a-8c6a-2a04d3ec6bd4 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:28.962413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a302-cf0d-4c8d-815a-a1419ce36105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.964821 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a302-cf0d-4c8d-815a-a1419ce36105 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.965406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a302-cf0d-4c8d-815a-a1419ce36105 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.965908 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a302-cf0d-4c8d-815a-a1419ce36105 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7/users/c4d4881e6ced433aab8e2c1035d9d174/roles/7c610827438840438f3b3e90fac7c51c` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.968766 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a302-cf0d-4c8d-815a-a1419ce36105 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d5767bb2ca248d48c5820335e1738c7, user_id=c4d4881e6ced433aab8e2c1035d9d174, role_id=7c610827438840438f3b3e90fac7c51c)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.970517 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a302-cf0d-4c8d-815a-a1419ce36105 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.974841 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c240e7f-9309-4acd-9d3f-6e3d07538748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:28.975788 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c240e7f-9309-4acd-9d3f-6e3d07538748 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:28.976149 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c240e7f-9309-4acd-9d3f-6e3d07538748 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:28.976441 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c240e7f-9309-4acd-9d3f-6e3d07538748 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7/users/bb7614d8c4184d29a9515f84d7487a48/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:28.980930 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c240e7f-9309-4acd-9d3f-6e3d07538748 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d5767bb2ca248d48c5820335e1738c7, user_id=bb7614d8c4184d29a9515f84d7487a48, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:28.983024 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c240e7f-9309-4acd-9d3f-6e3d07538748 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:28.997991 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 66/132] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:28 2022] PUT /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7/users/c4d4881e6ced433aab8e2c1035d9d174/roles/7c610827438840438f3b3e90fac7c51c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:28.999259 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a302-cf0d-4c8d-815a-a1419ce36105 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:29.015910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 67/133] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:28 2022] PUT /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7/users/bb7614d8c4184d29a9515f84d7487a48/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:29.142049 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a302-cf0d-4c8d-815a-a1419ce36105 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:29.183060 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:29.184240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:29.184850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:29.185359 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:29.186361 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:29.186908 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:29.188629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:29.199277 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 67/134] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:29.205594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c240e7f-9309-4acd-9d3f-6e3d07538748 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:29.321966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c240e7f-9309-4acd-9d3f-6e3d07538748 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:29.358279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a55d92-8a38-40eb-9bb7-1e777caa8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:29.359181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a55d92-8a38-40eb-9bb7-1e777caa8e8f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:29.359469 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a55d92-8a38-40eb-9bb7-1e777caa8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:29.359752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a55d92-8a38-40eb-9bb7-1e777caa8e8f None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:29.361025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a55d92-8a38-40eb-9bb7-1e777caa8e8f None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:29.362510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a55d92-8a38-40eb-9bb7-1e777caa8e8f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:29.364524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 68/135] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:29 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:29.370243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:29.478374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b99051-03e0-456a-8c4f-4979bc16594f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:29.514611 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424d149-3a91-4726-99bd-aeb995bdb4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:29.515500 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424d149-3a91-4726-99bd-aeb995bdb4ed None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:29.515796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424d149-3a91-4726-99bd-aeb995bdb4ed None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:29.516088 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424d149-3a91-4726-99bd-aeb995bdb4ed None admin] PATH_INFO: `/v3/projects/d81824eec88248b5b24de5ca0277b615` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:29.517338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424d149-3a91-4726-99bd-aeb995bdb4ed None admin] RBAC: Authorizing `identity:get_project(project_id=d81824eec88248b5b24de5ca0277b615)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:29.518935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424d149-3a91-4726-99bd-aeb995bdb4ed None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:29.520895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 68/136] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:29 2022] GET /identity/v3/projects/d81824eec88248b5b24de5ca0277b615 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:29.527740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a55d92-8a38-40eb-9bb7-1e777caa8e8f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:29.636005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a55d92-8a38-40eb-9bb7-1e777caa8e8f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:29.672353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844c3bf-3f9a-45cc-beb7-11f48f7ca2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:29.673262 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844c3bf-3f9a-45cc-beb7-11f48f7ca2af None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:29.673550 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844c3bf-3f9a-45cc-beb7-11f48f7ca2af None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:29.673833 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844c3bf-3f9a-45cc-beb7-11f48f7ca2af None admin] PATH_INFO: `/v3/projects/d81824eec88248b5b24de5ca0277b615/users/c4d4881e6ced433aab8e2c1035d9d174/roles/68bfbd93f3e34ca58a58a2d237564990` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:29.675957 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844c3bf-3f9a-45cc-beb7-11f48f7ca2af None admin] RBAC: Authorizing `identity:create_grant(project_id=d81824eec88248b5b24de5ca0277b615, user_id=c4d4881e6ced433aab8e2c1035d9d174, role_id=68bfbd93f3e34ca58a58a2d237564990)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:29.677434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844c3bf-3f9a-45cc-beb7-11f48f7ca2af None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:29.693035 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 69/137] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:29 2022] PUT /identity/v3/projects/d81824eec88248b5b24de5ca0277b615/users/c4d4881e6ced433aab8e2c1035d9d174/roles/68bfbd93f3e34ca58a58a2d237564990 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:31.694614 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11564847-5232-4883-bfe3-f6b31c823539 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:31.695321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11564847-5232-4883-bfe3-f6b31c823539 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:31.695321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11564847-5232-4883-bfe3-f6b31c823539 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:31.696598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 69/138] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:31.702455 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba64b-009c-4ac2-ae1a-5a86f30bbb79 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:31.703027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba64b-009c-4ac2-ae1a-5a86f30bbb79 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:31.703027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ba64b-009c-4ac2-ae1a-5a86f30bbb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:31.720851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-276ba64b-009c-4ac2-ae1a-5a86f30bbb79 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:31.722077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-276ba64b-009c-4ac2-ae1a-5a86f30bbb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:31.795621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 70/139] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:31.820864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11564847-5232-4883-bfe3-f6b31c823539 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:31.837736 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cd098-22a1-4574-9a89-c9192f9c54d8 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:31.838066 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cd098-22a1-4574-9a89-c9192f9c54d8 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:31.838879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cd098-22a1-4574-9a89-c9192f9c54d8 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:31.840406 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 71/140] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:28:31.845657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86e8b-8559-4d12-a2ee-a1aa46bbc239 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:31.845949 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86e8b-8559-4d12-a2ee-a1aa46bbc239 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:31.846236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86e8b-8559-4d12-a2ee-a1aa46bbc239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:31.879927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-3bb86e8b-8559-4d12-a2ee-a1aa46bbc239 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:31.881153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-3bb86e8b-8559-4d12-a2ee-a1aa46bbc239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:31.988466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 72/141] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:32.033467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb86e8b-8559-4d12-a2ee-a1aa46bbc239 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:32.042708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11564847-5232-4883-bfe3-f6b31c823539 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:32.144626 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3f57b-e71a-47e2-bfeb-c14284d23ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:32.145454 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3f57b-e71a-47e2-bfeb-c14284d23ee7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.145743 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3f57b-e71a-47e2-bfeb-c14284d23ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.146026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3f57b-e71a-47e2-bfeb-c14284d23ee7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.147321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3f57b-e71a-47e2-bfeb-c14284d23ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:32.148833 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3f57b-e71a-47e2-bfeb-c14284d23ee7 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:32.149270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb86e8b-8559-4d12-a2ee-a1aa46bbc239 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:32.152875 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 70/142] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:32.172190 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3f57b-e71a-47e2-bfeb-c14284d23ee7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:32.198547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1985b-3364-4f8e-88d2-7d734e3a4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:32.199389 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1985b-3364-4f8e-88d2-7d734e3a4835 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.199679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1985b-3364-4f8e-88d2-7d734e3a4835 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.202375 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1985b-3364-4f8e-88d2-7d734e3a4835 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.224660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1985b-3364-4f8e-88d2-7d734e3a4835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-cab1985b-3364-4f8e-88d2-7d734e3a4835 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:32.241570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:32.243919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:32.247036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:32.253372 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 73/143] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:32.256786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1985b-3364-4f8e-88d2-7d734e3a4835 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:32.406573 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1985b-3364-4f8e-88d2-7d734e3a4835 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:32.427795 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3f57b-e71a-47e2-bfeb-c14284d23ee7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:32.458961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f1ae-4b09-4ce9-8a14-b40234e7c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:32.459662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f1ae-4b09-4ce9-8a14-b40234e7c4db None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.463843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f1ae-4b09-4ce9-8a14-b40234e7c4db None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.463843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f1ae-4b09-4ce9-8a14-b40234e7c4db None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.463843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145f1ae-4b09-4ce9-8a14-b40234e7c4db None admin] RBAC: Adding query filter params (name=reader) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:32.463843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145f1ae-4b09-4ce9-8a14-b40234e7c4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:32.463843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145f1ae-4b09-4ce9-8a14-b40234e7c4db None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:32.473805 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 74/144] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:32.475524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdcbdb-6800-4396-b0e0-5170c58199eb None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.476123 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdcbdb-6800-4396-b0e0-5170c58199eb None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.476411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdcbdb-6800-4396-b0e0-5170c58199eb None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.477662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 75/145] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:32.487234 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56b84-4380-4352-a12f-3886cc0e579a None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.491844 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56b84-4380-4352-a12f-3886cc0e579a None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.491844 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56b84-4380-4352-a12f-3886cc0e579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.528559 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d453d1a-652b-4985-9733-2a6ec8a8c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:32.528935 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-80e56b84-4380-4352-a12f-3886cc0e579a None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:32.531789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453d1a-652b-4985-9733-2a6ec8a8c92d None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.531789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453d1a-652b-4985-9733-2a6ec8a8c92d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.531789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d453d1a-652b-4985-9733-2a6ec8a8c92d None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.532305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-80e56b84-4380-4352-a12f-3886cc0e579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:32.532568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d453d1a-652b-4985-9733-2a6ec8a8c92d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:32.532568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d453d1a-652b-4985-9733-2a6ec8a8c92d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:32.602373 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 71/146] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:28:32 2022] POST /identity/v3/users => generated 283 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:28:32.603981 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d453d1a-652b-4985-9733-2a6ec8a8c92d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:32.655540 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 76/147] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:32.657183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f74f72-be01-4035-9162-200dceb84cd4 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.657463 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f74f72-be01-4035-9162-200dceb84cd4 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.658264 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f74f72-be01-4035-9162-200dceb84cd4 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.659384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 77/148] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:32.669910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c52c-3b99-41d2-9d91-898ccaa9544b None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.669910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c52c-3b99-41d2-9d91-898ccaa9544b None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.670435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c52c-3b99-41d2-9d91-898ccaa9544b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.703792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-c997c52c-3b99-41d2-9d91-898ccaa9544b None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:32.703792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-c997c52c-3b99-41d2-9d91-898ccaa9544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:32.862133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d453d1a-652b-4985-9733-2a6ec8a8c92d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:32.898494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 78/149] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:32.898814 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8277f-69d5-42fc-b092-dc78baff2895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:32.900235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c52c-3b99-41d2-9d91-898ccaa9544b None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:32.900460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8277f-69d5-42fc-b092-dc78baff2895 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.900460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8277f-69d5-42fc-b092-dc78baff2895 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.900460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8277f-69d5-42fc-b092-dc78baff2895 None admin] PATH_INFO: `/v3/users/1760116515f34b5fb2889a2dc579c898` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.902279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8277f-69d5-42fc-b092-dc78baff2895 None admin] RBAC: Authorizing `identity:get_user(user_id=1760116515f34b5fb2889a2dc579c898)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:32.903453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8277f-69d5-42fc-b092-dc78baff2895 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:32.907485 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 72/150] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:32 2022] GET /identity/v3/users/1760116515f34b5fb2889a2dc579c898 => generated 289 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:32.908727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373a63-703e-46ac-b876-1cfd4bf94ac7 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.909015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373a63-703e-46ac-b876-1cfd4bf94ac7 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.909298 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92373a63-703e-46ac-b876-1cfd4bf94ac7 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.910681 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 73/151] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:32.918265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301dcdd-59b1-4e3e-be32-a2ae31b2ac38 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:32.918562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301dcdd-59b1-4e3e-be32-a2ae31b2ac38 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:32.918849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301dcdd-59b1-4e3e-be32-a2ae31b2ac38 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:32.923905 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 74/152] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:32.923905 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301dcdd-59b1-4e3e-be32-a2ae31b2ac38 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:33.096799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301dcdd-59b1-4e3e-be32-a2ae31b2ac38 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:33.097959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c52c-3b99-41d2-9d91-898ccaa9544b None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:33.145362 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23800d-b93d-4ac0-be38-3fbe7ea7d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:33.146054 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23800d-b93d-4ac0-be38-3fbe7ea7d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.146343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23800d-b93d-4ac0-be38-3fbe7ea7d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.146624 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23800d-b93d-4ac0-be38-3fbe7ea7d6c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.149206 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0152-1ea5-4f41-8a22-7cde7bdfc212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:33.150385 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0152-1ea5-4f41-8a22-7cde7bdfc212 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.150753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0152-1ea5-4f41-8a22-7cde7bdfc212 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.151053 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0152-1ea5-4f41-8a22-7cde7bdfc212 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.153008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a0152-1ea5-4f41-8a22-7cde7bdfc212 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:33.154699 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a0152-1ea5-4f41-8a22-7cde7bdfc212 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:33.156736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 75/153] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:32 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:33.157758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210ccf-0f3b-49b9-9eca-5efa914021ef None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.158053 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210ccf-0f3b-49b9-9eca-5efa914021ef None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.158337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba210ccf-0f3b-49b9-9eca-5efa914021ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.159033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23800d-b93d-4ac0-be38-3fbe7ea7d6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-fa23800d-b93d-4ac0-be38-3fbe7ea7d6c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:33.168758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:33.169826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:33.170760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:33.173394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 79/154] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:33.174881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b015b-0310-4ef0-87f7-1fc7a77692dd None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.175373 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b015b-0310-4ef0-87f7-1fc7a77692dd None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.175874 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b015b-0310-4ef0-87f7-1fc7a77692dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.177098 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-ba210ccf-0f3b-49b9-9eca-5efa914021ef None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:33.178306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-ba210ccf-0f3b-49b9-9eca-5efa914021ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:33.197987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-055b015b-0310-4ef0-87f7-1fc7a77692dd None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:33.200055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-055b015b-0310-4ef0-87f7-1fc7a77692dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:33.266067 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 76/155] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:33.267294 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba210ccf-0f3b-49b9-9eca-5efa914021ef None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:33.305373 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 80/156] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:33.306278 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b015b-0310-4ef0-87f7-1fc7a77692dd None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:33.418147 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba210ccf-0f3b-49b9-9eca-5efa914021ef None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:33.456377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4620386-a42e-46bb-a635-c3f258bc6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:33.457195 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4620386-a42e-46bb-a635-c3f258bc6404 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.457483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4620386-a42e-46bb-a635-c3f258bc6404 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.457767 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4620386-a42e-46bb-a635-c3f258bc6404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.483627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4620386-a42e-46bb-a635-c3f258bc6404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:33.490448 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b015b-0310-4ef0-87f7-1fc7a77692dd None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-c4620386-a42e-46bb-a635-c3f258bc6404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:33.498391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:33.499406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 77/157] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:33.500369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4620386-a42e-46bb-a635-c3f258bc6404 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:33.577478 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dddae7-21d9-4bb6-9d7c-b8dee7a4e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:33.578827 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dddae7-21d9-4bb6-9d7c-b8dee7a4e402 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.579339 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dddae7-21d9-4bb6-9d7c-b8dee7a4e402 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.579857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dddae7-21d9-4bb6-9d7c-b8dee7a4e402 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7/users/1760116515f34b5fb2889a2dc579c898/roles/a53fd65b58a64e39bee8522541c38253` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.585149 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dddae7-21d9-4bb6-9d7c-b8dee7a4e402 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d5767bb2ca248d48c5820335e1738c7, user_id=1760116515f34b5fb2889a2dc579c898, role_id=a53fd65b58a64e39bee8522541c38253)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:33.586897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dddae7-21d9-4bb6-9d7c-b8dee7a4e402 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:33.609840 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4620386-a42e-46bb-a635-c3f258bc6404 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:33.619833 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 81/158] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:33 2022] PUT /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7/users/1760116515f34b5fb2889a2dc579c898/roles/a53fd65b58a64e39bee8522541c38253 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:33.620966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dddae7-21d9-4bb6-9d7c-b8dee7a4e402 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:33.650436 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:33.652078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.652381 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.652715 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.653679 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:33.654059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:33.659790 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:33.665157 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 78/159] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:33.666017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:33.866217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f76150-4281-4735-a172-46c54c3490a7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:33.871208 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dddae7-21d9-4bb6-9d7c-b8dee7a4e402 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:33.904913 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379cb4f-6238-47ef-9f38-8802df46e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:33.906113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379cb4f-6238-47ef-9f38-8802df46e120 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.906612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379cb4f-6238-47ef-9f38-8802df46e120 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.907136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379cb4f-6238-47ef-9f38-8802df46e120 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.920046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379cb4f-6238-47ef-9f38-8802df46e120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-0379cb4f-6238-47ef-9f38-8802df46e120 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:33.928732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:33.929760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:33.930690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:33.934336 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 79/160] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:28:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:33.935586 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379cb4f-6238-47ef-9f38-8802df46e120 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:33.961429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370b46-da40-4abc-a1fb-ce85a8ff4e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:33.962486 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370b46-da40-4abc-a1fb-ce85a8ff4e33 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:33.962486 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370b46-da40-4abc-a1fb-ce85a8ff4e33 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:33.962769 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370b46-da40-4abc-a1fb-ce85a8ff4e33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:33.996695 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370b46-da40-4abc-a1fb-ce85a8ff4e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-7c370b46-da40-4abc-a1fb-ce85a8ff4e33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:34.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:34.005488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:34.006420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:34.015779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 82/161] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:34.015779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370b46-da40-4abc-a1fb-ce85a8ff4e33 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:34.058951 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379cb4f-6238-47ef-9f38-8802df46e120 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:34.096352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:34.097484 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:34.097987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:34.098469 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:34.099435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:34.099977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:34.101730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:34.111803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 80/162] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:34.112941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:34.221355 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09054d-25b6-417b-a0da-407721f10e2e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:34.257932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:34.258181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370b46-da40-4abc-a1fb-ce85a8ff4e33 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:34.259120 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:34.259630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:34.260857 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:34.262373 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:34.262922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:34.264556 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:34.273352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 81/163] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:34.274498 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:34.349855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b719d-2564-4dd6-9cc8-46461e86acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:34.350747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b719d-2564-4dd6-9cc8-46461e86acb0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:34.351027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b719d-2564-4dd6-9cc8-46461e86acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:34.351303 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b719d-2564-4dd6-9cc8-46461e86acb0 None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:34.354796 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b719d-2564-4dd6-9cc8-46461e86acb0 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:34.356667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b719d-2564-4dd6-9cc8-46461e86acb0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:34.357995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 83/164] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:34.358777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b719d-2564-4dd6-9cc8-46461e86acb0 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:34.383396 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64f6e-a0b4-4054-8352-823d61b7fd9c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:34.420307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:34.420987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:34.421274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:34.421552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:34.422321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:34.422634 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:34.424042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:34.433034 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 82/165] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:34.433853 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:34.545706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c768-2d98-4423-abaf-72ef47296bb3 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:34.581905 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a388-760d-48e1-8acf-cbb9800c850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:34.582785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a388-760d-48e1-8acf-cbb9800c850e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:34.583067 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a388-760d-48e1-8acf-cbb9800c850e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:34.583339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a388-760d-48e1-8acf-cbb9800c850e None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:34.584598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54a388-760d-48e1-8acf-cbb9800c850e None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:34.586066 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54a388-760d-48e1-8acf-cbb9800c850e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:34.587759 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 83/166] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:34.589261 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a388-760d-48e1-8acf-cbb9800c850e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:34.618777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b719d-2564-4dd6-9cc8-46461e86acb0 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:34.674828 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c23db-5f05-4d2a-b461-e8818cf831e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:34.675814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c23db-5f05-4d2a-b461-e8818cf831e4 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:34.676091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c23db-5f05-4d2a-b461-e8818cf831e4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:34.676411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c23db-5f05-4d2a-b461-e8818cf831e4 None admin] PATH_INFO: `/v3/users/bb7614d8c4184d29a9515f84d7487a48` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:34.678898 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c23db-5f05-4d2a-b461-e8818cf831e4 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7614d8c4184d29a9515f84d7487a48)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:34.680400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c23db-5f05-4d2a-b461-e8818cf831e4 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:34.686982 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 84/167] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/users/bb7614d8c4184d29a9515f84d7487a48 => generated 247 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:34.687855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c23db-5f05-4d2a-b461-e8818cf831e4 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:34.746693 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a388-760d-48e1-8acf-cbb9800c850e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:34.786166 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941c62-0561-4a43-9e0a-cba25aa3bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:34.786876 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941c62-0561-4a43-9e0a-cba25aa3bc8b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:34.787154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941c62-0561-4a43-9e0a-cba25aa3bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:34.787466 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941c62-0561-4a43-9e0a-cba25aa3bc8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:34.858478 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941c62-0561-4a43-9e0a-cba25aa3bc8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:34.859890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941c62-0561-4a43-9e0a-cba25aa3bc8b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:34.903061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c23db-5f05-4d2a-b461-e8818cf831e4 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:34.962945 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 84/168] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:34.964525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941c62-0561-4a43-9e0a-cba25aa3bc8b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:34.980618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b0c6c-1519-4689-9293-0a10ea977afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:34.981515 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0c6c-1519-4689-9293-0a10ea977afe None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:34.981801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0c6c-1519-4689-9293-0a10ea977afe None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:34.982078 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0c6c-1519-4689-9293-0a10ea977afe None admin] PATH_INFO: `/v3/users/c4d4881e6ced433aab8e2c1035d9d174` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:34.983364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b0c6c-1519-4689-9293-0a10ea977afe None admin] RBAC: Authorizing `identity:get_user(user_id=c4d4881e6ced433aab8e2c1035d9d174)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:34.985166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b0c6c-1519-4689-9293-0a10ea977afe None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:34.992589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 85/169] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/users/c4d4881e6ced433aab8e2c1035d9d174 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:34.993184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b0c6c-1519-4689-9293-0a10ea977afe None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:35.066963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941c62-0561-4a43-9e0a-cba25aa3bc8b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:35.105151 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c4590-0b88-41f7-8c4e-78b47b4a0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:35.105812 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c4590-0b88-41f7-8c4e-78b47b4a0075 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:35.106090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c4590-0b88-41f7-8c4e-78b47b4a0075 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:35.106360 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c4590-0b88-41f7-8c4e-78b47b4a0075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:35.193098 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c4590-0b88-41f7-8c4e-78b47b4a0075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:35.194567 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c4590-0b88-41f7-8c4e-78b47b4a0075 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:35.208283 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b0c6c-1519-4689-9293-0a10ea977afe None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:35.273484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92d3fe-2145-463d-b2bc-c3ce0846ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:35.274140 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d3fe-2145-463d-b2bc-c3ce0846ba11 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:35.274417 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d3fe-2145-463d-b2bc-c3ce0846ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:35.274689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d3fe-2145-463d-b2bc-c3ce0846ba11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:35.383428 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 85/170] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:35.384127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c4590-0b88-41f7-8c4e-78b47b4a0075 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:35.389418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92d3fe-2145-463d-b2bc-c3ce0846ba11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:35.390901 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92d3fe-2145-463d-b2bc-c3ce0846ba11 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:35.547780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c4590-0b88-41f7-8c4e-78b47b4a0075 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:35.566779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 86/171] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:35.567632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92d3fe-2145-463d-b2bc-c3ce0846ba11 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:35.610709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378789-4c15-4d3c-8ac0-adb39cfd91a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:35.611578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378789-4c15-4d3c-8ac0-adb39cfd91a9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:35.611875 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378789-4c15-4d3c-8ac0-adb39cfd91a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:35.612143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378789-4c15-4d3c-8ac0-adb39cfd91a9 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:35.613971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59378789-4c15-4d3c-8ac0-adb39cfd91a9 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:35.615435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59378789-4c15-4d3c-8ac0-adb39cfd91a9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:35.618186 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 86/172] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:35 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:35.618730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378789-4c15-4d3c-8ac0-adb39cfd91a9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:35.751036 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378789-4c15-4d3c-8ac0-adb39cfd91a9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:35.775440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92d3fe-2145-463d-b2bc-c3ce0846ba11 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:35.806233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532f66d-f34c-4217-8b1f-e9c1883eb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:35.807057 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532f66d-f34c-4217-8b1f-e9c1883eb01b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:35.807463 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532f66d-f34c-4217-8b1f-e9c1883eb01b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:35.807736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532f66d-f34c-4217-8b1f-e9c1883eb01b None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:35.809005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532f66d-f34c-4217-8b1f-e9c1883eb01b None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:35.812600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532f66d-f34c-4217-8b1f-e9c1883eb01b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:35.812750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 87/173] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:35 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:35.813439 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532f66d-f34c-4217-8b1f-e9c1883eb01b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:35.841629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabaad-284e-4b64-a791-6b7f68be0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:35.842949 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabaad-284e-4b64-a791-6b7f68be0849 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:35.843608 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabaad-284e-4b64-a791-6b7f68be0849 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:35.844147 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabaad-284e-4b64-a791-6b7f68be0849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:35.964473 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabaad-284e-4b64-a791-6b7f68be0849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:35.965999 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabaad-284e-4b64-a791-6b7f68be0849 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:35.966230 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532f66d-f34c-4217-8b1f-e9c1883eb01b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:36.014104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462730-f823-40b1-b15c-f0ce6bc5c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:36.016453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462730-f823-40b1-b15c-f0ce6bc5c3a7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.016795 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462730-f823-40b1-b15c-f0ce6bc5c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.017100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462730-f823-40b1-b15c-f0ce6bc5c3a7 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.019318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462730-f823-40b1-b15c-f0ce6bc5c3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:36.021837 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462730-f823-40b1-b15c-f0ce6bc5c3a7 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:36.024959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 88/174] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:35 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:36.027045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462730-f823-40b1-b15c-f0ce6bc5c3a7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:36.089883 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 87/175] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:36.090450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabaad-284e-4b64-a791-6b7f68be0849 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:36.192552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462730-f823-40b1-b15c-f0ce6bc5c3a7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:36.237253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabaad-284e-4b64-a791-6b7f68be0849 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:36.260947 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b1a87-e5f3-4c23-a51f-4cea52a60dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:36.262005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b1a87-e5f3-4c23-a51f-4cea52a60dfb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.262503 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b1a87-e5f3-4c23-a51f-4cea52a60dfb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.263003 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b1a87-e5f3-4c23-a51f-4cea52a60dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.264090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b1a87-e5f3-4c23-a51f-4cea52a60dfb None admin] RBAC: Adding query filter params (role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=3d5767bb2ca248d48c5820335e1738c7, user.id=c4d4881e6ced433aab8e2c1035d9d174) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:36.264644 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b1a87-e5f3-4c23-a51f-4cea52a60dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:36.267298 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b1a87-e5f3-4c23-a51f-4cea52a60dfb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:36.281234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 89/176] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:36 2022] GET /identity/v3/role_assignments?user.id=c4d4881e6ced433aab8e2c1035d9d174&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:36.284938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b302c-dc8c-4cf9-91d3-334b85933269 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.285827 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b302c-dc8c-4cf9-91d3-334b85933269 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.287947 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b302c-dc8c-4cf9-91d3-334b85933269 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.290765 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 90/177] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:36.293583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b302c-dc8c-4cf9-91d3-334b85933269 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:36.319388 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:36.320616 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.321132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.321627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.323413 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] RBAC: Adding query filter params (role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=3d5767bb2ca248d48c5820335e1738c7, user.id=c4d4881e6ced433aab8e2c1035d9d174) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:36.324924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:36.326831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:36.337775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 88/178] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:36 2022] GET /identity/v3/role_assignments?user.id=c4d4881e6ced433aab8e2c1035d9d174&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=7c610827438840438f3b3e90fac7c51c => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:36.346364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:36.533697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b302c-dc8c-4cf9-91d3-334b85933269 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:36.573855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791654d-870f-43c0-b07c-33c891555baf None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:36.599177 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599c9c6-455f-4005-846b-2ccfefa3de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:36.599783 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c9c6-455f-4005-846b-2ccfefa3de76 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.600067 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c9c6-455f-4005-846b-2ccfefa3de76 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.600343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599c9c6-455f-4005-846b-2ccfefa3de76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.601206 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c9c6-455f-4005-846b-2ccfefa3de76 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=3d5767bb2ca248d48c5820335e1738c7, user.id=bb7614d8c4184d29a9515f84d7487a48) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:36.601516 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c9c6-455f-4005-846b-2ccfefa3de76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:36.602985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599c9c6-455f-4005-846b-2ccfefa3de76 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:36.618460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 91/179] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:36 2022] GET /identity/v3/role_assignments?user.id=bb7614d8c4184d29a9515f84d7487a48&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=8cf832105b2949f6b11e06b208146326 => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:36.620280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc27b-23bf-4b99-80f8-e2e6aaee0eec None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.620434 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc27b-23bf-4b99-80f8-e2e6aaee0eec None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.620724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bc27b-23bf-4b99-80f8-e2e6aaee0eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.648238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dd669-7bbd-4e3d-9d20-b543bf3d8099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:36.649238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dd669-7bbd-4e3d-9d20-b543bf3d8099 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.649651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dd669-7bbd-4e3d-9d20-b543bf3d8099 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.650153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dd669-7bbd-4e3d-9d20-b543bf3d8099 None admin] PATH_INFO: `/v3/projects/d81824eec88248b5b24de5ca0277b615` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.652300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dd669-7bbd-4e3d-9d20-b543bf3d8099 None admin] RBAC: Authorizing `identity:get_project(project_id=d81824eec88248b5b24de5ca0277b615)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:36.655340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268dd669-7bbd-4e3d-9d20-b543bf3d8099 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:36.657322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 89/180] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:36 2022] GET /identity/v3/projects/d81824eec88248b5b24de5ca0277b615 => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:36.660149 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148bcb-9e86-4d97-8fd6-549bf1dc8899 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.660429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148bcb-9e86-4d97-8fd6-549bf1dc8899 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.660708 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148bcb-9e86-4d97-8fd6-549bf1dc8899 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.662303 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 90/181] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:36.668523 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-f05bc27b-23bf-4b99-80f8-e2e6aaee0eec None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:36.669881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-f05bc27b-23bf-4b99-80f8-e2e6aaee0eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:36.672027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d30ce3-be25-4011-a36f-086e9d94b650 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.674192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d30ce3-be25-4011-a36f-086e9d94b650 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.674513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d30ce3-be25-4011-a36f-086e9d94b650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.696538 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-47d30ce3-be25-4011-a36f-086e9d94b650 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:36.698679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-47d30ce3-be25-4011-a36f-086e9d94b650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:36.789488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 91/182] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:36.790008 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d30ce3-be25-4011-a36f-086e9d94b650 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:36.849669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 92/183] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:36.851680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936fe5-6e46-43b7-a360-18299f803ccc None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.852302 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936fe5-6e46-43b7-a360-18299f803ccc None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.852792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936fe5-6e46-43b7-a360-18299f803ccc None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.855388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 93/184] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:36.856473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936fe5-6e46-43b7-a360-18299f803ccc None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:36.918213 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d30ce3-be25-4011-a36f-086e9d94b650 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:36.974104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e9e40-ad9b-4fcf-b674-bcc472109a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:36.974885 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9e40-ad9b-4fcf-b674-bcc472109a10 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.975062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9e40-ad9b-4fcf-b674-bcc472109a10 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.975340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e9e40-ad9b-4fcf-b674-bcc472109a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:36.976239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e9e40-ad9b-4fcf-b674-bcc472109a10 None admin] RBAC: Adding query filter params (role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=d81824eec88248b5b24de5ca0277b615, user.id=c4d4881e6ced433aab8e2c1035d9d174) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:36.976552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e9e40-ad9b-4fcf-b674-bcc472109a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:36.978069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e9e40-ad9b-4fcf-b674-bcc472109a10 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:36.985362 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 92/185] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:36 2022] GET /identity/v3/role_assignments?user.id=c4d4881e6ced433aab8e2c1035d9d174&scope.project.id=d81824eec88248b5b24de5ca0277b615&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:36.986528 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c195-e880-4910-9a56-6a00516289cc None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:36.992584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c195-e880-4910-9a56-6a00516289cc None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:36.992794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936fe5-6e46-43b7-a360-18299f803ccc None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:36.993215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809c195-e880-4910-9a56-6a00516289cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.024995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-d809c195-e880-4910-9a56-6a00516289cc None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:37.026910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-d809c195-e880-4910-9a56-6a00516289cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:37.036270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd0354-e4ea-454e-bab4-7c870658de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.038902 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0354-e4ea-454e-bab4-7c870658de5b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.039877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0354-e4ea-454e-bab4-7c870658de5b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.040432 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd0354-e4ea-454e-bab4-7c870658de5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.064479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd0354-e4ea-454e-bab4-7c870658de5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-29cd0354-e4ea-454e-bab4-7c870658de5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:37.079038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:37.080326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 94/186] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:37.081270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd0354-e4ea-454e-bab4-7c870658de5b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.158378 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 93/187] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:37.159708 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809c195-e880-4910-9a56-6a00516289cc None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.201885 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd0354-e4ea-454e-bab4-7c870658de5b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:37.241098 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb1af-e8f3-4296-8f5f-c55b257647e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.241912 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb1af-e8f3-4296-8f5f-c55b257647e1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.242202 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb1af-e8f3-4296-8f5f-c55b257647e1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.242479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bb1af-e8f3-4296-8f5f-c55b257647e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.243710 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bb1af-e8f3-4296-8f5f-c55b257647e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:37.246437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bb1af-e8f3-4296-8f5f-c55b257647e1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:37.247486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 95/188] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:37.248245 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb1af-e8f3-4296-8f5f-c55b257647e1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.276364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809c195-e880-4910-9a56-6a00516289cc None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:37.317737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb1aaa-9e6c-4fbc-9996-fa5a013661e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.318182 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1aaa-9e6c-4fbc-9996-fa5a013661e6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.318497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1aaa-9e6c-4fbc-9996-fa5a013661e6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.318775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb1aaa-9e6c-4fbc-9996-fa5a013661e6 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.319495 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb1aaa-9e6c-4fbc-9996-fa5a013661e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:37.319932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb1aaa-9e6c-4fbc-9996-fa5a013661e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:37.321202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb1aaa-9e6c-4fbc-9996-fa5a013661e6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:37.330859 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 94/189] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:37.332381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8e436-6f4f-4c9b-adf8-30b0d3f39d10 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.332677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8e436-6f4f-4c9b-adf8-30b0d3f39d10 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.332956 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8e436-6f4f-4c9b-adf8-30b0d3f39d10 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.338273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 95/190] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:37.338273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8e436-6f4f-4c9b-adf8-30b0d3f39d10 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.362148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bb1af-e8f3-4296-8f5f-c55b257647e1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:37.395284 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ebbb-bf22-4c44-96f0-9bda67b61e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.396121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ebbb-bf22-4c44-96f0-9bda67b61e04 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.396406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ebbb-bf22-4c44-96f0-9bda67b61e04 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.396683 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ebbb-bf22-4c44-96f0-9bda67b61e04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.406682 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8ebbb-bf22-4c44-96f0-9bda67b61e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-d0a8ebbb-bf22-4c44-96f0-9bda67b61e04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:37.414515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:37.415752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 96/191] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:37.417290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ebbb-bf22-4c44-96f0-9bda67b61e04 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.439059 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8e436-6f4f-4c9b-adf8-30b0d3f39d10 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:37.471863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21239dc5-6f45-4568-bb43-cb2d4f989931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.472538 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239dc5-6f45-4568-bb43-cb2d4f989931 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.472815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239dc5-6f45-4568-bb43-cb2d4f989931 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.473085 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21239dc5-6f45-4568-bb43-cb2d4f989931 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.473788 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21239dc5-6f45-4568-bb43-cb2d4f989931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:37.475214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21239dc5-6f45-4568-bb43-cb2d4f989931 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:37.494131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 96/192] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:28:37 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:37.496082 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382f17-977e-46db-a035-4a45313071c5 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.496370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382f17-977e-46db-a035-4a45313071c5 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.496649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382f17-977e-46db-a035-4a45313071c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.514322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-06382f17-977e-46db-a035-4a45313071c5 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:37.515558 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-06382f17-977e-46db-a035-4a45313071c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:37.519710 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ebbb-bf22-4c44-96f0-9bda67b61e04 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:37.558485 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902d2c-a3c7-458d-90d4-26d2875eeba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.559385 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902d2c-a3c7-458d-90d4-26d2875eeba4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.559661 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902d2c-a3c7-458d-90d4-26d2875eeba4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.560604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902d2c-a3c7-458d-90d4-26d2875eeba4 None admin] PATH_INFO: `/v3/users/e78374f27c7f4b0db453908a6eaca9b4` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.577689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec902d2c-a3c7-458d-90d4-26d2875eeba4 None admin] RBAC: Authorizing `identity:get_user(user_id=e78374f27c7f4b0db453908a6eaca9b4)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:37.579252 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec902d2c-a3c7-458d-90d4-26d2875eeba4 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:37.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 97/193] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/users/e78374f27c7f4b0db453908a6eaca9b4 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:37.585794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902d2c-a3c7-458d-90d4-26d2875eeba4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.595794 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 97/194] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:37.596712 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06382f17-977e-46db-a035-4a45313071c5 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.707145 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06382f17-977e-46db-a035-4a45313071c5 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:37.724402 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902d2c-a3c7-458d-90d4-26d2875eeba4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:37.746022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a751a78-e335-4c82-a9c0-62dd4d8a0b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.746678 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a751a78-e335-4c82-a9c0-62dd4d8a0b1f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.746959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a751a78-e335-4c82-a9c0-62dd4d8a0b1f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.747235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a751a78-e335-4c82-a9c0-62dd4d8a0b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.764671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.765354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.765638 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.765914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.765914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] RBAC: Adding query filter params (name=reader) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:37.767077 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:37.768673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:37.781794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 98/195] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:37.782655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.831694 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a751a78-e335-4c82-a9c0-62dd4d8a0b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:37.833192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a751a78-e335-4c82-a9c0-62dd4d8a0b1f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:37.906162 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860dbcd-f8a6-4136-8fd9-8a1eaa9b983f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:37.946588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 98/196] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:37.948419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a751a78-e335-4c82-a9c0-62dd4d8a0b1f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:37.952818 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f0cc7-66a3-4777-93db-a9f1dd838a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:37.953640 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f0cc7-66a3-4777-93db-a9f1dd838a15 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:37.953917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f0cc7-66a3-4777-93db-a9f1dd838a15 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:37.954192 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f0cc7-66a3-4777-93db-a9f1dd838a15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:37.968192 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f0cc7-66a3-4777-93db-a9f1dd838a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-637f0cc7-66a3-4777-93db-a9f1dd838a15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:37.978415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:37.980678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 99/197] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:37.981629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f0cc7-66a3-4777-93db-a9f1dd838a15 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:38.070821 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a751a78-e335-4c82-a9c0-62dd4d8a0b1f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.089520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f0cc7-66a3-4777-93db-a9f1dd838a15 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.121901 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f3bb0-8efd-4342-9c7d-23b764453962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.122947 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f3bb0-8efd-4342-9c7d-23b764453962 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.123358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f3bb0-8efd-4342-9c7d-23b764453962 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.123637 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f3bb0-8efd-4342-9c7d-23b764453962 None admin] PATH_INFO: `/v3/users/1760116515f34b5fb2889a2dc579c898` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.126183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f3bb0-8efd-4342-9c7d-23b764453962 None admin] RBAC: Authorizing `identity:get_user(user_id=1760116515f34b5fb2889a2dc579c898)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.128787 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f3bb0-8efd-4342-9c7d-23b764453962 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:38.130751 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 99/198] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/users/1760116515f34b5fb2889a2dc579c898 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:38.131526 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f3bb0-8efd-4342-9c7d-23b764453962 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:38.132166 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8a0b8-ecb3-4114-876e-8f7619b2d6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.133111 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8a0b8-ecb3-4114-876e-8f7619b2d6b1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.137259 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8a0b8-ecb3-4114-876e-8f7619b2d6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.137564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8a0b8-ecb3-4114-876e-8f7619b2d6b1 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.139345 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8a0b8-ecb3-4114-876e-8f7619b2d6b1 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.140853 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8a0b8-ecb3-4114-876e-8f7619b2d6b1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:38.143007 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 100/199] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:37 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:38.143972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8a0b8-ecb3-4114-876e-8f7619b2d6b1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:38.258163 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8a0b8-ecb3-4114-876e-8f7619b2d6b1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.261310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f3bb0-8efd-4342-9c7d-23b764453962 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.294560 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b7a27-e8eb-4aec-81c2-be051eda775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.295251 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b7a27-e8eb-4aec-81c2-be051eda775b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.295533 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b7a27-e8eb-4aec-81c2-be051eda775b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.295837 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b7a27-e8eb-4aec-81c2-be051eda775b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.296255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.297032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.297312 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.297584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.298334 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:38.298637 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.300036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:38.309119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 100/200] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:28:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:38.309939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:38.366571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b7a27-e8eb-4aec-81c2-be051eda775b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.368173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b7a27-e8eb-4aec-81c2-be051eda775b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:38.410390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba867d8-87c3-4384-97a1-d5fb852aa678 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.449889 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.450558 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.450872 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.451144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.452280 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f, user.id=e78374f27c7f4b0db453908a6eaca9b4) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:38.452774 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.454288 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:38.460631 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 101/201] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:38 2022] GET /identity/v3/role_assignments?user.id=e78374f27c7f4b0db453908a6eaca9b4&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=8cf832105b2949f6b11e06b208146326 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:38.461447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:38.482475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 101/202] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:38.483922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b7a27-e8eb-4aec-81c2-be051eda775b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:38.569459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c4f4e-dd01-4180-b7ba-45b113a43a6e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.593046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b7a27-e8eb-4aec-81c2-be051eda775b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.606547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c915c-e056-49cc-ba75-bd14cacf6a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.607443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c915c-e056-49cc-ba75-bd14cacf6a83 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.607722 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c915c-e056-49cc-ba75-bd14cacf6a83 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.608031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c915c-e056-49cc-ba75-bd14cacf6a83 None admin] PATH_INFO: `/v3/users/e78374f27c7f4b0db453908a6eaca9b4` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.609300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c915c-e056-49cc-ba75-bd14cacf6a83 None admin] RBAC: Authorizing `identity:get_user(user_id=e78374f27c7f4b0db453908a6eaca9b4)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.610761 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c915c-e056-49cc-ba75-bd14cacf6a83 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:38.612791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 102/203] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:38 2022] GET /identity/v3/users/e78374f27c7f4b0db453908a6eaca9b4 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:38.625140 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c915c-e056-49cc-ba75-bd14cacf6a83 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:38.631146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b8e4-fdf6-4528-bb5b-9372563bcf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.632119 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b8e4-fdf6-4528-bb5b-9372563bcf84 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.632400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b8e4-fdf6-4528-bb5b-9372563bcf84 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.632682 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b8e4-fdf6-4528-bb5b-9372563bcf84 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.634011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b8e4-fdf6-4528-bb5b-9372563bcf84 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.636148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b8e4-fdf6-4528-bb5b-9372563bcf84 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:38.638146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 102/204] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:38 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:38.644380 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b8e4-fdf6-4528-bb5b-9372563bcf84 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:38.770576 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c915c-e056-49cc-ba75-bd14cacf6a83 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.776260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b8e4-fdf6-4528-bb5b-9372563bcf84 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:38.809286 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de6b0-9a1a-4ab2-afa4-3168e372c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.810241 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de6b0-9a1a-4ab2-afa4-3168e372c358 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.810530 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de6b0-9a1a-4ab2-afa4-3168e372c358 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.810808 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de6b0-9a1a-4ab2-afa4-3168e372c358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.842205 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:38.842806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:38.843156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:38.843440 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:38.844431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] RBAC: Adding query filter params (role.id=a53fd65b58a64e39bee8522541c38253, scope.project.id=3d5767bb2ca248d48c5820335e1738c7, user.id=1760116515f34b5fb2889a2dc579c898) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:38.844752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.846205 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:38.865919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 103/205] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:38 2022] GET /identity/v3/role_assignments?user.id=1760116515f34b5fb2889a2dc579c898&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=a53fd65b58a64e39bee8522541c38253 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:38.897609 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de6b0-9a1a-4ab2-afa4-3168e372c358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:38.899096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de6b0-9a1a-4ab2-afa4-3168e372c358 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:39.029021 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 103/206] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:39.036953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:39.205128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031feb4-33d9-4eec-9981-c3e81fa04cb9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:39.246573 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfa9bc-b625-49e2-b69d-0cb332f57d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:39.247445 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfa9bc-b625-49e2-b69d-0cb332f57d11 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:39.247723 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfa9bc-b625-49e2-b69d-0cb332f57d11 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:39.248028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfa9bc-b625-49e2-b69d-0cb332f57d11 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:39.249260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfa9bc-b625-49e2-b69d-0cb332f57d11 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:39.250725 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfa9bc-b625-49e2-b69d-0cb332f57d11 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:39.252653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 104/207] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:39 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:39.258308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de6b0-9a1a-4ab2-afa4-3168e372c358 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:39.359877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de6b0-9a1a-4ab2-afa4-3168e372c358 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:39.403551 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c79706-fe81-4b8a-8d64-056b8c7a3f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:39.404514 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79706-fe81-4b8a-8d64-056b8c7a3f3e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:39.404965 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79706-fe81-4b8a-8d64-056b8c7a3f3e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:39.405398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c79706-fe81-4b8a-8d64-056b8c7a3f3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:39.406400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c79706-fe81-4b8a-8d64-056b8c7a3f3e None admin] RBAC: Adding query filter params (role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f, user.id=e78374f27c7f4b0db453908a6eaca9b4) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:39.406895 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c79706-fe81-4b8a-8d64-056b8c7a3f3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:39.408580 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c79706-fe81-4b8a-8d64-056b8c7a3f3e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:39.418629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 104/208] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:39 2022] GET /identity/v3/role_assignments?user.id=e78374f27c7f4b0db453908a6eaca9b4&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=7c610827438840438f3b3e90fac7c51c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:40.158128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc18f4-387f-41c0-a557-23f255131929 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.158522 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc18f4-387f-41c0-a557-23f255131929 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.158738 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc18f4-387f-41c0-a557-23f255131929 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.160261 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 105/209] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:40.165439 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5e02a-257e-4ddc-8222-6808fd0c3741 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.165731 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5e02a-257e-4ddc-8222-6808fd0c3741 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.166006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5e02a-257e-4ddc-8222-6808fd0c3741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.183917 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-22c5e02a-257e-4ddc-8222-6808fd0c3741 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:40.185102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-22c5e02a-257e-4ddc-8222-6808fd0c3741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:40.254086 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 105/210] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:40.284696 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc18f4-387f-41c0-a557-23f255131929 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:40.299634 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1e98-845e-4ebd-8ddf-82723409326f None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.300226 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1e98-845e-4ebd-8ddf-82723409326f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.300226 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1e98-845e-4ebd-8ddf-82723409326f None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.302265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 106/211] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:40.311147 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd0468-3bca-46a5-b47f-92e0cf88cbdb None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.311462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd0468-3bca-46a5-b47f-92e0cf88cbdb None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.311715 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd0468-3bca-46a5-b47f-92e0cf88cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.330263 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-5abd0468-3bca-46a5-b47f-92e0cf88cbdb None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:40.331459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-5abd0468-3bca-46a5-b47f-92e0cf88cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:40.409885 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 107/212] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:40.435866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc18f4-387f-41c0-a557-23f255131929 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:40.436185 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd0468-3bca-46a5-b47f-92e0cf88cbdb None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:40.478560 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2b944-6972-42bc-b098-77202dceb906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:40.480205 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2b944-6972-42bc-b098-77202dceb906 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.480486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2b944-6972-42bc-b098-77202dceb906 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.480758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2b944-6972-42bc-b098-77202dceb906 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.494951 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2b944-6972-42bc-b098-77202dceb906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-52e2b944-6972-42bc-b098-77202dceb906 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:40.505286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:40.507665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:40.509191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 106/213] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:40.519788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2b944-6972-42bc-b098-77202dceb906 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:40.545811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd0468-3bca-46a5-b47f-92e0cf88cbdb None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:40.584566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81c0bf-aef9-4ae2-9751-0b69f978e265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:40.585385 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81c0bf-aef9-4ae2-9751-0b69f978e265 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.585665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81c0bf-aef9-4ae2-9751-0b69f978e265 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.585939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81c0bf-aef9-4ae2-9751-0b69f978e265 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.587147 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81c0bf-aef9-4ae2-9751-0b69f978e265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:40.589836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81c0bf-aef9-4ae2-9751-0b69f978e265 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:40.591838 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 108/214] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:40.597197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81c0bf-aef9-4ae2-9751-0b69f978e265 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:40.618362 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2b944-6972-42bc-b098-77202dceb906 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:40.653761 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:40.654917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.655401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.655904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.656671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:40.656977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:40.658386 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:40.667634 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 107/215] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:40.673089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:40.707813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81c0bf-aef9-4ae2-9751-0b69f978e265 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:40.745858 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc130-b970-4c32-b411-07c8b6739ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:40.746585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc130-b970-4c32-b411-07c8b6739ecd None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.746876 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc130-b970-4c32-b411-07c8b6739ecd None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.747155 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc130-b970-4c32-b411-07c8b6739ecd None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.747917 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bc130-b970-4c32-b411-07c8b6739ecd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:40.749478 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bc130-b970-4c32-b411-07c8b6739ecd None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:40.773903 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 109/216] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:28:40 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:28:40.782697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ca3d-e5c5-4885-ad2c-ff9fa166258a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:40.822702 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d20c43-d316-4537-8ed7-be10f27f1041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:40.823655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20c43-d316-4537-8ed7-be10f27f1041 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:40.823967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20c43-d316-4537-8ed7-be10f27f1041 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:40.824244 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20c43-d316-4537-8ed7-be10f27f1041 None admin] PATH_INFO: `/v3/users/36e31a314078456b83533abbd4996afe` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:40.840663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d20c43-d316-4537-8ed7-be10f27f1041 None admin] RBAC: Authorizing `identity:get_user(user_id=36e31a314078456b83533abbd4996afe)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:40.842239 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d20c43-d316-4537-8ed7-be10f27f1041 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:40.844523 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 108/217] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:40 2022] GET /identity/v3/users/36e31a314078456b83533abbd4996afe => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:40.850595 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc130-b970-4c32-b411-07c8b6739ecd None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:40.971808 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc130-b970-4c32-b411-07c8b6739ecd None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:41.008294 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4edfb-9529-4bbb-9c3c-e236ccd04443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:41.008962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4edfb-9529-4bbb-9c3c-e236ccd04443 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.009250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4edfb-9529-4bbb-9c3c-e236ccd04443 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.009533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4edfb-9529-4bbb-9c3c-e236ccd04443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.080909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4edfb-9529-4bbb-9c3c-e236ccd04443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:41.082391 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4edfb-9529-4bbb-9c3c-e236ccd04443 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:41.151565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd31d-d7f4-44ac-9dfe-5a3e49339848 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.152234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd31d-d7f4-44ac-9dfe-5a3e49339848 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.152736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd31d-d7f4-44ac-9dfe-5a3e49339848 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.154382 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 109/218] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:41.160174 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6a2b4-0302-4ae1-8ea0-7ca3e0c7c574 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.160738 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6a2b4-0302-4ae1-8ea0-7ca3e0c7c574 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.161240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6a2b4-0302-4ae1-8ea0-7ca3e0c7c574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.189260 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 110/219] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:41.190336 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-23a6a2b4-0302-4ae1-8ea0-7ca3e0c7c574 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:41.191754 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-23a6a2b4-0302-4ae1-8ea0-7ca3e0c7c574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:41.195659 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4edfb-9529-4bbb-9c3c-e236ccd04443 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:41.274709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 110/220] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:41.302461 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6a2b4-0302-4ae1-8ea0-7ca3e0c7c574 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:41.313461 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4edfb-9529-4bbb-9c3c-e236ccd04443 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:41.357156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba11c82-6850-4342-a996-254a2e20a21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:41.358037 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11c82-6850-4342-a996-254a2e20a21d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.358316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11c82-6850-4342-a996-254a2e20a21d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.358588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11c82-6850-4342-a996-254a2e20a21d None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.361352 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba11c82-6850-4342-a996-254a2e20a21d None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:41.362799 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba11c82-6850-4342-a996-254a2e20a21d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:41.370548 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 111/221] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:41 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:41.382507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba11c82-6850-4342-a996-254a2e20a21d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:41.455145 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6a2b4-0302-4ae1-8ea0-7ca3e0c7c574 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:41.494159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82d7c-39b8-41bb-a907-d0798a68226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:41.495637 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82d7c-39b8-41bb-a907-d0798a68226a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.495943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82d7c-39b8-41bb-a907-d0798a68226a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.496233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82d7c-39b8-41bb-a907-d0798a68226a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.519115 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf82d7c-39b8-41bb-a907-d0798a68226a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-fbf82d7c-39b8-41bb-a907-d0798a68226a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:41.527260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:41.528365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:41.529293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 111/222] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:41.534183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82d7c-39b8-41bb-a907-d0798a68226a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:41.579285 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba11c82-6850-4342-a996-254a2e20a21d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:41.648271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:41.648271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.648271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.648664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.649414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] RBAC: Adding query filter params (role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f, user.id=36e31a314078456b83533abbd4996afe) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:41.649730 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:41.651731 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:41.669623 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 112/223] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:41 2022] GET /identity/v3/role_assignments?user.id=36e31a314078456b83533abbd4996afe&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:41.708509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82d7c-39b8-41bb-a907-d0798a68226a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:41.768696 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb38f6-fb84-45c3-8ca2-a6d3481de4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:41.769844 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb38f6-fb84-45c3-8ca2-a6d3481de4c6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.770381 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb38f6-fb84-45c3-8ca2-a6d3481de4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.770922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb38f6-fb84-45c3-8ca2-a6d3481de4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.771964 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb38f6-fb84-45c3-8ca2-a6d3481de4c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:41.772521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb38f6-fb84-45c3-8ca2-a6d3481de4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:41.774197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb38f6-fb84-45c3-8ca2-a6d3481de4c6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:41.785237 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 112/224] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:41.792066 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:41.918753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d60b0-177e-4fd9-bb6b-2248d9723a2e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:41.960116 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6b1ec-918b-4bb7-9e62-0a157f0a0f1a None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.960779 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6b1ec-918b-4bb7-9e62-0a157f0a0f1a None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.961317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6b1ec-918b-4bb7-9e62-0a157f0a0f1a None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.962988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 113/225] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:41.968408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de54a-2212-44ef-ac4a-e2e8a7615c15 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.968711 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de54a-2212-44ef-ac4a-e2e8a7615c15 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.968953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de54a-2212-44ef-ac4a-e2e8a7615c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.969798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7ccfc-840a-40c6-afd0-a605f38d9363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:41.971046 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7ccfc-840a-40c6-afd0-a605f38d9363 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:41.971552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7ccfc-840a-40c6-afd0-a605f38d9363 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:41.972070 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7ccfc-840a-40c6-afd0-a605f38d9363 None admin] PATH_INFO: `/v3/users/e78374f27c7f4b0db453908a6eaca9b4` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:41.973534 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7ccfc-840a-40c6-afd0-a605f38d9363 None admin] RBAC: Authorizing `identity:get_user(user_id=e78374f27c7f4b0db453908a6eaca9b4)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:41.975277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7ccfc-840a-40c6-afd0-a605f38d9363 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:41.977222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 113/226] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:41 2022] GET /identity/v3/users/e78374f27c7f4b0db453908a6eaca9b4 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:41.983349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7ccfc-840a-40c6-afd0-a605f38d9363 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:42.016803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-2b2de54a-2212-44ef-ac4a-e2e8a7615c15 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:42.018015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-2b2de54a-2212-44ef-ac4a-e2e8a7615c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:42.089455 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7ccfc-840a-40c6-afd0-a605f38d9363 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:42.127436 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab685e-fc8b-4306-8451-4710a41faaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:42.128765 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab685e-fc8b-4306-8451-4710a41faaf9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:42.129277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab685e-fc8b-4306-8451-4710a41faaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:42.129763 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab685e-fc8b-4306-8451-4710a41faaf9 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:42.131232 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab685e-fc8b-4306-8451-4710a41faaf9 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:42.133030 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab685e-fc8b-4306-8451-4710a41faaf9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:42.135673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 114/227] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:41 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:42.144750 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab685e-fc8b-4306-8451-4710a41faaf9 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:42.165483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 114/228] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:42.213823 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2de54a-2212-44ef-ac4a-e2e8a7615c15 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:42.253970 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab685e-fc8b-4306-8451-4710a41faaf9 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:42.290260 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d2e8e-72b2-43d7-9d77-c370f91a763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:42.292598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2e8e-72b2-43d7-9d77-c370f91a763f None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:42.293120 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2e8e-72b2-43d7-9d77-c370f91a763f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:42.293629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d2e8e-72b2-43d7-9d77-c370f91a763f None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/users/e78374f27c7f4b0db453908a6eaca9b4/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:42.295960 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d2e8e-72b2-43d7-9d77-c370f91a763f None admin] RBAC: Authorizing `identity:create_grant(project_id=95f59159e6a94f0f993fbc3ee5a8d44f, user_id=e78374f27c7f4b0db453908a6eaca9b4, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:42.297655 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d2e8e-72b2-43d7-9d77-c370f91a763f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:42.321407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 115/229] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:42 2022] PUT /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/users/e78374f27c7f4b0db453908a6eaca9b4/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:42.358012 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2de54a-2212-44ef-ac4a-e2e8a7615c15 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:42.404218 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924347e-0e5c-4dd2-a3cd-8555e954e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:42.405048 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924347e-0e5c-4dd2-a3cd-8555e954e641 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:42.405327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924347e-0e5c-4dd2-a3cd-8555e954e641 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:42.405599 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924347e-0e5c-4dd2-a3cd-8555e954e641 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:42.421329 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924347e-0e5c-4dd2-a3cd-8555e954e641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-8924347e-0e5c-4dd2-a3cd-8555e954e641 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:42.429412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:42.430526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:42.432295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 115/230] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:28:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:42.439329 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d2e8e-72b2-43d7-9d77-c370f91a763f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:42.563423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d2e8e-72b2-43d7-9d77-c370f91a763f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:42.599800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:42.600487 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:42.600822 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:42.601099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:42.601868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:42.602216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:42.603743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:42.613043 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 116/231] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:28:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:42.621154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924347e-0e5c-4dd2-a3cd-8555e954e641 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:42.773697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924347e-0e5c-4dd2-a3cd-8555e954e641 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:42.815628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf75c9-6398-434f-af12-a6e56facbd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:42.816681 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf75c9-6398-434f-af12-a6e56facbd53 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:42.816973 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf75c9-6398-434f-af12-a6e56facbd53 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:42.817255 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf75c9-6398-434f-af12-a6e56facbd53 None admin] PATH_INFO: `/v3/users/e78374f27c7f4b0db453908a6eaca9b4` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:42.818520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf75c9-6398-434f-af12-a6e56facbd53 None admin] RBAC: Authorizing `identity:get_user(user_id=e78374f27c7f4b0db453908a6eaca9b4)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:42.820025 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf75c9-6398-434f-af12-a6e56facbd53 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:42.822005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 116/232] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:42 2022] GET /identity/v3/users/e78374f27c7f4b0db453908a6eaca9b4 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:42.828110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:42.943927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f5eba-6393-4cf9-aa93-fc0736095a5d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:42.980868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28354175-8a03-423e-93e5-2786a875c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:42.981750 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28354175-8a03-423e-93e5-2786a875c9cd None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:42.982086 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28354175-8a03-423e-93e5-2786a875c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:42.982371 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28354175-8a03-423e-93e5-2786a875c9cd None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:42.983600 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28354175-8a03-423e-93e5-2786a875c9cd None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:42.985097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28354175-8a03-423e-93e5-2786a875c9cd None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:42.987146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 117/233] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:42 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:42.992843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf75c9-6398-434f-af12-a6e56facbd53 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:43.129981 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf75c9-6398-434f-af12-a6e56facbd53 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:43.177105 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeb13b-a3c6-4fe5-ad78-74895cc2a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:43.178000 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeb13b-a3c6-4fe5-ad78-74895cc2a41e None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:43.178288 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeb13b-a3c6-4fe5-ad78-74895cc2a41e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:43.178571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeb13b-a3c6-4fe5-ad78-74895cc2a41e None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/users/e78374f27c7f4b0db453908a6eaca9b4/roles/7c610827438840438f3b3e90fac7c51c` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:43.180935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeb13b-a3c6-4fe5-ad78-74895cc2a41e None admin] RBAC: Authorizing `identity:create_grant(project_id=95f59159e6a94f0f993fbc3ee5a8d44f, user_id=e78374f27c7f4b0db453908a6eaca9b4, role_id=7c610827438840438f3b3e90fac7c51c)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:43.182962 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeb13b-a3c6-4fe5-ad78-74895cc2a41e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:43.221060 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 117/234] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:42 2022] PUT /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/users/e78374f27c7f4b0db453908a6eaca9b4/roles/7c610827438840438f3b3e90fac7c51c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:28:43.623539 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe46e-da87-46bb-a699-c09060e31d07 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:43.624320 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe46e-da87-46bb-a699-c09060e31d07 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:43.624320 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe46e-da87-46bb-a699-c09060e31d07 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:43.625723 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 118/235] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:43.632580 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56b23-c191-4ebf-8650-95ed7a6ccea6 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:43.633090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56b23-c191-4ebf-8650-95ed7a6ccea6 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:43.633252 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56b23-c191-4ebf-8650-95ed7a6ccea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:43.656173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-1cb56b23-c191-4ebf-8650-95ed7a6ccea6 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:43.657378 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-1cb56b23-c191-4ebf-8650-95ed7a6ccea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:43.754799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 118/236] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:43.784974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfe46e-da87-46bb-a699-c09060e31d07 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:43.808529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551aa4e-17c4-4f4e-b876-d79e02e649af None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:43.808871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551aa4e-17c4-4f4e-b876-d79e02e649af None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:43.809089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551aa4e-17c4-4f4e-b876-d79e02e649af None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:43.810743 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 119/237] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:43.816684 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea6e6-8023-4d1d-b28c-c31408dd5fa6 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:43.816975 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea6e6-8023-4d1d-b28c-c31408dd5fa6 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:43.817259 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea6e6-8023-4d1d-b28c-c31408dd5fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:43.848777 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-6e2ea6e6-8023-4d1d-b28c-c31408dd5fa6 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:43.849972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-6e2ea6e6-8023-4d1d-b28c-c31408dd5fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:43.906216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfe46e-da87-46bb-a699-c09060e31d07 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:43.942257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad254e8-759d-473d-84a3-a1562569a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:43.943071 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad254e8-759d-473d-84a3-a1562569a3dc None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:43.943360 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad254e8-759d-473d-84a3-a1562569a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:43.943627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad254e8-759d-473d-84a3-a1562569a3dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:43.955607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad254e8-759d-473d-84a3-a1562569a3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-8ad254e8-759d-473d-84a3-a1562569a3dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:43.965252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:43.966358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:43.967950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 119/238] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:43.973069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad254e8-759d-473d-84a3-a1562569a3dc None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:43.985521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 120/239] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:44.041415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ea6e6-8023-4d1d-b28c-c31408dd5fa6 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:44.117729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad254e8-759d-473d-84a3-a1562569a3dc None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:44.167614 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:44.168269 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.168554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.168843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.169893 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:44.170203 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:44.171818 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:44.181210 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 120/240] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:44.189043 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:44.227930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ea6e6-8023-4d1d-b28c-c31408dd5fa6 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:44.300219 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbef94-6733-4050-9127-d196677c3e57 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:44.325513 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89b49-8bb5-4465-b00f-b3393c370bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:44.326697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89b49-8bb5-4465-b00f-b3393c370bd7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.327190 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89b49-8bb5-4465-b00f-b3393c370bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.327689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89b49-8bb5-4465-b00f-b3393c370bd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.332489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89b49-8bb5-4465-b00f-b3393c370bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:44.334196 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89b49-8bb5-4465-b00f-b3393c370bd7 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:44.341194 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d8a3-b03d-4a4d-9a34-137119b3ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:44.341194 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d8a3-b03d-4a4d-9a34-137119b3ec9a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.341194 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d8a3-b03d-4a4d-9a34-137119b3ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.341194 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d8a3-b03d-4a4d-9a34-137119b3ec9a None admin] PATH_INFO: `/v3/users/7b7be1898b6a4cfe94cc6c8719709d27` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.341799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 121/241] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:44.343232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89b49-8bb5-4465-b00f-b3393c370bd7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:44.354350 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790d8a3-b03d-4a4d-9a34-137119b3ec9a None admin] RBAC: Authorizing `identity:get_user(user_id=7b7be1898b6a4cfe94cc6c8719709d27)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:44.355857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790d8a3-b03d-4a4d-9a34-137119b3ec9a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:44.357949 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 121/242] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:44 2022] GET /identity/v3/users/7b7be1898b6a4cfe94cc6c8719709d27 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:44.363614 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d8a3-b03d-4a4d-9a34-137119b3ec9a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:44.481033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d8a3-b03d-4a4d-9a34-137119b3ec9a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:44.519117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a240-c864-432b-91ce-9c9ddd917c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:44.519863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a240-c864-432b-91ce-9c9ddd917c9a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.520145 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a240-c864-432b-91ce-9c9ddd917c9a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.520465 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983a240-c864-432b-91ce-9c9ddd917c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.597359 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983a240-c864-432b-91ce-9c9ddd917c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:44.598826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983a240-c864-432b-91ce-9c9ddd917c9a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:44.601925 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89b49-8bb5-4465-b00f-b3393c370bd7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:44.647872 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052be16-89ee-49d1-a212-7d4685d5214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:44.648660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052be16-89ee-49d1-a212-7d4685d5214f None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.648837 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052be16-89ee-49d1-a212-7d4685d5214f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.649118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052be16-89ee-49d1-a212-7d4685d5214f None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.649842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052be16-89ee-49d1-a212-7d4685d5214f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:44.651949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052be16-89ee-49d1-a212-7d4685d5214f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:44.677375 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 122/243] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:28:44 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:28:44.679176 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71747a7c-0572-4825-9b3e-d3c666caa3bf None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.679518 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71747a7c-0572-4825-9b3e-d3c666caa3bf None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.679835 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71747a7c-0572-4825-9b3e-d3c666caa3bf None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.681693 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 123/244] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:44.688005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55873bf0-6055-48f2-b7e6-4698b44cf920 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.688442 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55873bf0-6055-48f2-b7e6-4698b44cf920 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.688830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55873bf0-6055-48f2-b7e6-4698b44cf920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.706910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-55873bf0-6055-48f2-b7e6-4698b44cf920 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:44.708335 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-55873bf0-6055-48f2-b7e6-4698b44cf920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:44.709126 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 122/245] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:44.715597 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a240-c864-432b-91ce-9c9ddd917c9a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:44.784702 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 124/246] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:44.808364 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55873bf0-6055-48f2-b7e6-4698b44cf920 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:44.826682 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983a240-c864-432b-91ce-9c9ddd917c9a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:44.864042 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae7e6-7abe-4e4a-aecb-e11708058ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:44.864924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae7e6-7abe-4e4a-aecb-e11708058ea2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.865251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae7e6-7abe-4e4a-aecb-e11708058ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.865527 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae7e6-7abe-4e4a-aecb-e11708058ea2 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.866758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ae7e6-7abe-4e4a-aecb-e11708058ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:44.868250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ae7e6-7abe-4e4a-aecb-e11708058ea2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:44.870655 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 123/247] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:44 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:44.876686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae7e6-7abe-4e4a-aecb-e11708058ea2 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:44.919418 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55873bf0-6055-48f2-b7e6-4698b44cf920 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:44.961089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9c2b-0723-4b77-a3fb-bdedcdbb187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:44.962067 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9c2b-0723-4b77-a3fb-bdedcdbb187b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:44.962451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9c2b-0723-4b77-a3fb-bdedcdbb187b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:44.962929 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9c2b-0723-4b77-a3fb-bdedcdbb187b None admin] PATH_INFO: `/v3/roles/member` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:44.973864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a9c2b-0723-4b77-a3fb-bdedcdbb187b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-956a9c2b-0723-4b77-a3fb-bdedcdbb187b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:44.983140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:44.984618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:44.986629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 125/248] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:44.995794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9c2b-0723-4b77-a3fb-bdedcdbb187b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:45.001038 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae7e6-7abe-4e4a-aecb-e11708058ea2 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:45.036442 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6cd04-6ac3-4af9-a95b-33858459176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:45.037032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6cd04-6ac3-4af9-a95b-33858459176e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.037312 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6cd04-6ac3-4af9-a95b-33858459176e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.037590 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6cd04-6ac3-4af9-a95b-33858459176e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.038434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6cd04-6ac3-4af9-a95b-33858459176e None admin] RBAC: Adding query filter params (role.id=a53fd65b58a64e39bee8522541c38253, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f, user.id=7b7be1898b6a4cfe94cc6c8719709d27) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:45.038746 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6cd04-6ac3-4af9-a95b-33858459176e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:45.040292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6cd04-6ac3-4af9-a95b-33858459176e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:45.047010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 124/249] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:44 2022] GET /identity/v3/role_assignments?user.id=7b7be1898b6a4cfe94cc6c8719709d27&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=a53fd65b58a64e39bee8522541c38253 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:45.106726 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675799c-ef9e-4fbd-bfb4-662eb137e57d None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.107071 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675799c-ef9e-4fbd-bfb4-662eb137e57d None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.107400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675799c-ef9e-4fbd-bfb4-662eb137e57d None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.108697 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 125/250] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:45.111128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9c2b-0723-4b77-a3fb-bdedcdbb187b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:45.114602 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bdb8-3665-4937-ae73-d3e1c0c992a8 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.114883 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bdb8-3665-4937-ae73-d3e1c0c992a8 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.115157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bdb8-3665-4937-ae73-d3e1c0c992a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.137824 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-e1e1bdb8-3665-4937-ae73-d3e1c0c992a8 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:45.139033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-e1e1bdb8-3665-4937-ae73-d3e1c0c992a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:45.148564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:45.149257 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.149541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.149821 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.151385 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:45.151705 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:45.153175 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:45.163565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 126/251] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:45.170148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:45.228260 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 126/252] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:45.252426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bdb8-3665-4937-ae73-d3e1c0c992a8 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:45.289103 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79e94-764a-49d8-8368-bd8a4e45a12a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:45.337467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aa5ed-0e76-4c3b-9207-ae4f2b0dd1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:45.339137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa5ed-0e76-4c3b-9207-ae4f2b0dd1fa None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.339524 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa5ed-0e76-4c3b-9207-ae4f2b0dd1fa None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.339826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa5ed-0e76-4c3b-9207-ae4f2b0dd1fa None admin] PATH_INFO: `/v3/users/36e31a314078456b83533abbd4996afe` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.341197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7aa5ed-0e76-4c3b-9207-ae4f2b0dd1fa None admin] RBAC: Authorizing `identity:get_user(user_id=36e31a314078456b83533abbd4996afe)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:45.342916 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7aa5ed-0e76-4c3b-9207-ae4f2b0dd1fa None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:45.345251 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 127/253] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:45 2022] GET /identity/v3/users/36e31a314078456b83533abbd4996afe => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:45.350863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aa5ed-0e76-4c3b-9207-ae4f2b0dd1fa None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:45.360256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bdb8-3665-4937-ae73-d3e1c0c992a8 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:45.395267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a5c0-e953-4411-bc22-08b9ab9bf436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:45.396421 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a5c0-e953-4411-bc22-08b9ab9bf436 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.396851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a5c0-e953-4411-bc22-08b9ab9bf436 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.397273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a5c0-e953-4411-bc22-08b9ab9bf436 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.409732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568a5c0-e953-4411-bc22-08b9ab9bf436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-f568a5c0-e953-4411-bc22-08b9ab9bf436 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:45.418520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:45.419691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:28:45.420651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:45.422986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 127/254] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:28:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:45.431368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a5c0-e953-4411-bc22-08b9ab9bf436 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:45.496670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aa5ed-0e76-4c3b-9207-ae4f2b0dd1fa None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:45.536483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639bb9-064f-487c-8fcd-87ac5d4693e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:45.537384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639bb9-064f-487c-8fcd-87ac5d4693e0 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.537665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639bb9-064f-487c-8fcd-87ac5d4693e0 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.537941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24639bb9-064f-487c-8fcd-87ac5d4693e0 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.540008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24639bb9-064f-487c-8fcd-87ac5d4693e0 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:45.541964 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24639bb9-064f-487c-8fcd-87ac5d4693e0 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:45.547876 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 128/255] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:45 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:45.549711 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639bb9-064f-487c-8fcd-87ac5d4693e0 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:45.563553 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a5c0-e953-4411-bc22-08b9ab9bf436 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:45.609344 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:45.610034 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.610321 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.611027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.612418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:45.612881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:45.614792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:45.627077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 128/256] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:45.632573 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:45.662557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24639bb9-064f-487c-8fcd-87ac5d4693e0 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:45.701130 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db35dbb-49b8-4c8e-b63c-7f453236e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:45.702038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db35dbb-49b8-4c8e-b63c-7f453236e959 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.702322 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db35dbb-49b8-4c8e-b63c-7f453236e959 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.702599 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db35dbb-49b8-4c8e-b63c-7f453236e959 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/users/36e31a314078456b83533abbd4996afe/roles/68bfbd93f3e34ca58a58a2d237564990` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.704687 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db35dbb-49b8-4c8e-b63c-7f453236e959 None admin] RBAC: Authorizing `identity:create_grant(project_id=95f59159e6a94f0f993fbc3ee5a8d44f, user_id=36e31a314078456b83533abbd4996afe, role_id=68bfbd93f3e34ca58a58a2d237564990)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:45.706167 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db35dbb-49b8-4c8e-b63c-7f453236e959 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:45.732211 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 129/257] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:45 2022] PUT /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/users/36e31a314078456b83533abbd4996afe/roles/68bfbd93f3e34ca58a58a2d237564990 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:28:45.754526 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94811297-0325-4279-874a-0e48d5a90efe None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:45.811806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14145a8a-8a7a-4c72-a77d-f810b1a7b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:45.813059 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145a8a-8a7a-4c72-a77d-f810b1a7b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:45.813567 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145a8a-8a7a-4c72-a77d-f810b1a7b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:45.814065 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145a8a-8a7a-4c72-a77d-f810b1a7b2d9 None admin] PATH_INFO: `/v3/users/e78374f27c7f4b0db453908a6eaca9b4` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:45.820762 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14145a8a-8a7a-4c72-a77d-f810b1a7b2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=e78374f27c7f4b0db453908a6eaca9b4)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:45.823139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14145a8a-8a7a-4c72-a77d-f810b1a7b2d9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:45.825586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 129/258] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:45 2022] GET /identity/v3/users/e78374f27c7f4b0db453908a6eaca9b4 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:45.832254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db35dbb-49b8-4c8e-b63c-7f453236e959 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:45.981243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db35dbb-49b8-4c8e-b63c-7f453236e959 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:46.024933 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6d744-3de6-4384-80f0-459bf10c71b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:46.025645 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6d744-3de6-4384-80f0-459bf10c71b9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:46.025930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6d744-3de6-4384-80f0-459bf10c71b9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:46.026208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6d744-3de6-4384-80f0-459bf10c71b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:46.120604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6d744-3de6-4384-80f0-459bf10c71b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:46.122478 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6d744-3de6-4384-80f0-459bf10c71b9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:46.237848 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 130/259] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:46.243471 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14145a8a-8a7a-4c72-a77d-f810b1a7b2d9 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:46.273203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55a9e-44b4-4e5c-a69b-7d7f5cbb2365 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:46.273849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55a9e-44b4-4e5c-a69b-7d7f5cbb2365 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:46.274326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55a9e-44b4-4e5c-a69b-7d7f5cbb2365 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:46.276750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 131/260] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:46.284010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ae5d2-a378-43ef-a258-8637347f3225 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:46.284558 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ae5d2-a378-43ef-a258-8637347f3225 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:46.285054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ae5d2-a378-43ef-a258-8637347f3225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:46.313441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-e96ae5d2-a378-43ef-a258-8637347f3225 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:46.315273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-e96ae5d2-a378-43ef-a258-8637347f3225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:46.419599 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 132/261] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 09 15:28:46.437743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14145a8a-8a7a-4c72-a77d-f810b1a7b2d9 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:46.446675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ae5d2-a378-43ef-a258-8637347f3225 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:46.512511 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ab1c-9ce5-4d04-b145-db489e9e2af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:46.513660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ab1c-9ce5-4d04-b145-db489e9e2af7 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:46.514129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ab1c-9ce5-4d04-b145-db489e9e2af7 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:46.514578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ab1c-9ce5-4d04-b145-db489e9e2af7 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:46.516098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04ab1c-9ce5-4d04-b145-db489e9e2af7 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:46.517753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04ab1c-9ce5-4d04-b145-db489e9e2af7 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:46.520639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 130/262] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:46 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:46.525333 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ab1c-9ce5-4d04-b145-db489e9e2af7 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:46.559501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ae5d2-a378-43ef-a258-8637347f3225 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:46.598501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de0976-1a8a-4bdc-8538-bbe684f425bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:46.599327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de0976-1a8a-4bdc-8538-bbe684f425bb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:46.599614 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de0976-1a8a-4bdc-8538-bbe684f425bb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:46.599927 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de0976-1a8a-4bdc-8538-bbe684f425bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:46.610880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de0976-1a8a-4bdc-8538-bbe684f425bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-82de0976-1a8a-4bdc-8538-bbe684f425bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:46.620356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:46.621408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:46.622741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 133/263] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:28:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:46.628094 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de0976-1a8a-4bdc-8538-bbe684f425bb None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:46.743405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de0976-1a8a-4bdc-8538-bbe684f425bb None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:46.769052 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ab1c-9ce5-4d04-b145-db489e9e2af7 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:46.784734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:46.784734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:46.784734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:46.784734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:46.785173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:46.785173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:46.786203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:46.796229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 134/264] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:28:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:46.802369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:46.846621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:46.847667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:46.848205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:46.848689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:46.849768 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f, user.id=e78374f27c7f4b0db453908a6eaca9b4) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:46.850294 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:46.852054 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:46.864636 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 131/265] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:46 2022] GET /identity/v3/role_assignments?user.id=e78374f27c7f4b0db453908a6eaca9b4&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=8cf832105b2949f6b11e06b208146326 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:46.913918 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df3deb-7be7-48cd-b5c8-8d684be3e3d9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:46.952489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5c59-6e02-4ddf-a515-7e3179ca2d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:46.953404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5c59-6e02-4ddf-a515-7e3179ca2d8a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:46.953701 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5c59-6e02-4ddf-a515-7e3179ca2d8a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:46.953959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d5c59-6e02-4ddf-a515-7e3179ca2d8a None admin] PATH_INFO: `/v3/users/e78374f27c7f4b0db453908a6eaca9b4` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:46.955407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d5c59-6e02-4ddf-a515-7e3179ca2d8a None admin] RBAC: Authorizing `identity:get_user(user_id=e78374f27c7f4b0db453908a6eaca9b4)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:46.956987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d5c59-6e02-4ddf-a515-7e3179ca2d8a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:46.959144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 135/266] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:46 2022] GET /identity/v3/users/e78374f27c7f4b0db453908a6eaca9b4 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:46.965358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:47.077501 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7515e3-f508-426d-aef1-9d23cbfbd22e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:47.114832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940646b7-49b9-4e1d-919b-9e233dd783bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:47.115889 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940646b7-49b9-4e1d-919b-9e233dd783bf None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:47.116380 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940646b7-49b9-4e1d-919b-9e233dd783bf None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:47.116844 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940646b7-49b9-4e1d-919b-9e233dd783bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:47.194710 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940646b7-49b9-4e1d-919b-9e233dd783bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:47.196610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940646b7-49b9-4e1d-919b-9e233dd783bf None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:47.299932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 132/267] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:47.305827 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5c59-6e02-4ddf-a515-7e3179ca2d8a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:47.412776 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d5c59-6e02-4ddf-a515-7e3179ca2d8a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:47.448247 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981a47-fc3d-4a05-b300-ea958f123754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:47.449124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981a47-fc3d-4a05-b300-ea958f123754 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:47.449406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981a47-fc3d-4a05-b300-ea958f123754 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:47.449680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981a47-fc3d-4a05-b300-ea958f123754 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:47.450913 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e981a47-fc3d-4a05-b300-ea958f123754 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:47.452413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e981a47-fc3d-4a05-b300-ea958f123754 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:47.454448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 136/268] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:47 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:47.460331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940646b7-49b9-4e1d-919b-9e233dd783bf None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:47.565990 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940646b7-49b9-4e1d-919b-9e233dd783bf None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:47.601583 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c442a6-90a0-4d97-9f5e-8cd15b2b7e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:47.602254 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c442a6-90a0-4d97-9f5e-8cd15b2b7e10 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:47.602540 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c442a6-90a0-4d97-9f5e-8cd15b2b7e10 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:47.602816 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c442a6-90a0-4d97-9f5e-8cd15b2b7e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:47.603885 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c442a6-90a0-4d97-9f5e-8cd15b2b7e10 None admin] RBAC: Adding query filter params (role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f, user.id=e78374f27c7f4b0db453908a6eaca9b4) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:47.604209 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c442a6-90a0-4d97-9f5e-8cd15b2b7e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:47.605654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c442a6-90a0-4d97-9f5e-8cd15b2b7e10 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:47.612110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 133/269] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:47 2022] GET /identity/v3/role_assignments?user.id=e78374f27c7f4b0db453908a6eaca9b4&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=7c610827438840438f3b3e90fac7c51c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:48.505712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295b976-7ce9-4606-a616-b0a632684ef4 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.506233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295b976-7ce9-4606-a616-b0a632684ef4 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.506346 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295b976-7ce9-4606-a616-b0a632684ef4 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.507977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 137/270] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:48.517409 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22cf9-4679-4e0c-894a-ccabbdb70ba9 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.517885 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22cf9-4679-4e0c-894a-ccabbdb70ba9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.518182 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc22cf9-4679-4e0c-894a-ccabbdb70ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.535652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-4bc22cf9-4679-4e0c-894a-ccabbdb70ba9 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:48.536923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-4bc22cf9-4679-4e0c-894a-ccabbdb70ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:48.578496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436ca4-0c16-4c37-af62-64f78769c5bd None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.578843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436ca4-0c16-4c37-af62-64f78769c5bd None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.579064 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20436ca4-0c16-4c37-af62-64f78769c5bd None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.580893 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 138/271] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:48.587463 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aee31-dca6-40b8-af0a-1f806c856131 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.588601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aee31-dca6-40b8-af0a-1f806c856131 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.589177 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1aee31-dca6-40b8-af0a-1f806c856131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.609563 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 134/272] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:48.610280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-fc1aee31-dca6-40b8-af0a-1f806c856131 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:48.611837 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-fc1aee31-dca6-40b8-af0a-1f806c856131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:48.613738 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61a136-9435-4e6b-8f54-9a4de98b6bd5 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.614032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61a136-9435-4e6b-8f54-9a4de98b6bd5 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.614315 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61a136-9435-4e6b-8f54-9a4de98b6bd5 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.616910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 135/273] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:28:48.621236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce20db-89cf-41d6-92f5-f60bfa8835eb None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.621622 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce20db-89cf-41d6-92f5-f60bfa8835eb None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.622003 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce20db-89cf-41d6-92f5-f60bfa8835eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.639314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-40ce20db-89cf-41d6-92f5-f60bfa8835eb None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:48.640433 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-40ce20db-89cf-41d6-92f5-f60bfa8835eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:48.687921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 139/274] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:48.689167 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1aee31-dca6-40b8-af0a-1f806c856131 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:48.714108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 136/275] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:48.715041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce20db-89cf-41d6-92f5-f60bfa8835eb None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:48.795916 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1aee31-dca6-40b8-af0a-1f806c856131 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:48.829630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce20db-89cf-41d6-92f5-f60bfa8835eb None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:48.833339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b41f-3150-477b-a0af-43331c67f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:48.834173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b41f-3150-477b-a0af-43331c67f653 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.834463 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b41f-3150-477b-a0af-43331c67f653 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.834736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b41f-3150-477b-a0af-43331c67f653 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.845669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b41f-3150-477b-a0af-43331c67f653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-8dc6b41f-3150-477b-a0af-43331c67f653 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:48.853988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:48.855024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 140/276] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:48.856600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b41f-3150-477b-a0af-43331c67f653 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:48.866221 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede406d8-8fd6-4bf8-8d4a-2ae221d16be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:48.867027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede406d8-8fd6-4bf8-8d4a-2ae221d16be1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.867304 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede406d8-8fd6-4bf8-8d4a-2ae221d16be1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.867571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede406d8-8fd6-4bf8-8d4a-2ae221d16be1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.878992 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede406d8-8fd6-4bf8-8d4a-2ae221d16be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-ede406d8-8fd6-4bf8-8d4a-2ae221d16be1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:48.887272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:48.888496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:48.889717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:48.893329 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 137/277] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:48.893986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede406d8-8fd6-4bf8-8d4a-2ae221d16be1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:48.963351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b41f-3150-477b-a0af-43331c67f653 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:48.992756 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede406d8-8fd6-4bf8-8d4a-2ae221d16be1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:48.996216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257d8a-1c7c-44fe-a1ac-9a476e5ffe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:48.997012 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257d8a-1c7c-44fe-a1ac-9a476e5ffe0c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:48.997294 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257d8a-1c7c-44fe-a1ac-9a476e5ffe0c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:48.997569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257d8a-1c7c-44fe-a1ac-9a476e5ffe0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:48.998801 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec257d8a-1c7c-44fe-a1ac-9a476e5ffe0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.000288 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec257d8a-1c7c-44fe-a1ac-9a476e5ffe0c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.002090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 141/278] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:49.002692 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257d8a-1c7c-44fe-a1ac-9a476e5ffe0c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.025229 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983942b-bab6-432f-a17f-94ccccd29a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.026497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983942b-bab6-432f-a17f-94ccccd29a9e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.026780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983942b-bab6-432f-a17f-94ccccd29a9e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.027053 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983942b-bab6-432f-a17f-94ccccd29a9e None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.027834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983942b-bab6-432f-a17f-94ccccd29a9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:49.028144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983942b-bab6-432f-a17f-94ccccd29a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.029522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983942b-bab6-432f-a17f-94ccccd29a9e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.037367 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 138/279] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:49.041877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6950acb-d666-48ec-9840-281c55813d8c None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.042328 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6950acb-d666-48ec-9840-281c55813d8c None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.042968 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6950acb-d666-48ec-9840-281c55813d8c None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.044332 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 139/280] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:49.045032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6950acb-d666-48ec-9840-281c55813d8c None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.100351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257d8a-1c7c-44fe-a1ac-9a476e5ffe0c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.132873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.133534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.133811 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.134082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.134955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:49.135260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.136667 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6950acb-d666-48ec-9840-281c55813d8c None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.144435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 142/281] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:49.145334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.175670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed3d00-7913-4c67-b43a-7015dc0e5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.176376 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3d00-7913-4c67-b43a-7015dc0e5aa6 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.176656 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3d00-7913-4c67-b43a-7015dc0e5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.176931 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3d00-7913-4c67-b43a-7015dc0e5aa6 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.177633 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed3d00-7913-4c67-b43a-7015dc0e5aa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.179055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed3d00-7913-4c67-b43a-7015dc0e5aa6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.198465 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 140/282] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:28:49 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:49.199985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe620f-c1e5-40ae-876b-2d6228dedfa3 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.200466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe620f-c1e5-40ae-876b-2d6228dedfa3 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.200753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe620f-c1e5-40ae-876b-2d6228dedfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.218799 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-c8fe620f-c1e5-40ae-876b-2d6228dedfa3 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:49.220097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-c8fe620f-c1e5-40ae-876b-2d6228dedfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:49.247630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a223055-7a2b-4a3e-ae75-b4edb9f1a33f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.284589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef154a2-e7aa-4f76-a9cd-9e515999e3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.285488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef154a2-e7aa-4f76-a9cd-9e515999e3ed None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.285765 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef154a2-e7aa-4f76-a9cd-9e515999e3ed None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.286039 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef154a2-e7aa-4f76-a9cd-9e515999e3ed None admin] PATH_INFO: `/v3/users/7b7be1898b6a4cfe94cc6c8719709d27` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.287320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef154a2-e7aa-4f76-a9cd-9e515999e3ed None admin] RBAC: Authorizing `identity:get_user(user_id=7b7be1898b6a4cfe94cc6c8719709d27)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.288832 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef154a2-e7aa-4f76-a9cd-9e515999e3ed None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.290535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 143/283] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:49 2022] GET /identity/v3/users/7b7be1898b6a4cfe94cc6c8719709d27 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:49.291525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef154a2-e7aa-4f76-a9cd-9e515999e3ed None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.303560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 141/284] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:49.312033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe620f-c1e5-40ae-876b-2d6228dedfa3 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.400108 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef154a2-e7aa-4f76-a9cd-9e515999e3ed None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.425959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe620f-c1e5-40ae-876b-2d6228dedfa3 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.437663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e643e4-419f-4e09-821a-9b77e372cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.438550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e643e4-419f-4e09-821a-9b77e372cba7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.438852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e643e4-419f-4e09-821a-9b77e372cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.439106 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e643e4-419f-4e09-821a-9b77e372cba7 None admin] PATH_INFO: `/v3/users/63336026aaf54e2cb824b3565422a98a` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.458330 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e643e4-419f-4e09-821a-9b77e372cba7 None admin] RBAC: Authorizing `identity:get_user(user_id=63336026aaf54e2cb824b3565422a98a)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.459925 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e643e4-419f-4e09-821a-9b77e372cba7 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.461688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 144/285] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:49 2022] GET /identity/v3/users/63336026aaf54e2cb824b3565422a98a => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:49.465492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e643e4-419f-4e09-821a-9b77e372cba7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.472661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cd0d6-2017-4304-a30a-116c61bc8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.473536 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd0d6-2017-4304-a30a-116c61bc8210 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.473814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd0d6-2017-4304-a30a-116c61bc8210 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.474084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cd0d6-2017-4304-a30a-116c61bc8210 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.475743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cd0d6-2017-4304-a30a-116c61bc8210 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.477679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cd0d6-2017-4304-a30a-116c61bc8210 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.480711 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 142/286] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:49 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:49.480928 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cd0d6-2017-4304-a30a-116c61bc8210 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.583508 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e643e4-419f-4e09-821a-9b77e372cba7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.595073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cd0d6-2017-4304-a30a-116c61bc8210 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.621415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68689af2-b800-4e86-aa6f-a8c70ad1e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.622479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68689af2-b800-4e86-aa6f-a8c70ad1e9fe None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.622938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68689af2-b800-4e86-aa6f-a8c70ad1e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.623391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68689af2-b800-4e86-aa6f-a8c70ad1e9fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.631157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.631846 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.632151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.632543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.633242 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] RBAC: Adding query filter params (role.id=68bfbd93f3e34ca58a58a2d237564990, user.id=63336026aaf54e2cb824b3565422a98a, scope.system=all) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:49.633554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.635602 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.636602 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68689af2-b800-4e86-aa6f-a8c70ad1e9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:49.641041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 143/287] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:28:49 2022] GET /identity/v3/role_assignments?user.id=63336026aaf54e2cb824b3565422a98a&scope.system=all&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:49.641816 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-68689af2-b800-4e86-aa6f-a8c70ad1e9fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:49.645136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:49.646400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:49.647561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:49.649801 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 145/288] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:49.656933 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68689af2-b800-4e86-aa6f-a8c70ad1e9fe None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.767356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68689af2-b800-4e86-aa6f-a8c70ad1e9fe None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.827741 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb556-f460-44e0-b732-b0e723b9bc39 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:49.836629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.837669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.838710 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.839340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.840457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:49.840982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.842604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.860767 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 146/289] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:49.866683 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:49.868069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a801b-fd22-43c0-93df-540f83581c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:49.868985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a801b-fd22-43c0-93df-540f83581c04 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:49.869801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a801b-fd22-43c0-93df-540f83581c04 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:49.870131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a801b-fd22-43c0-93df-540f83581c04 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/users/7b7be1898b6a4cfe94cc6c8719709d27/roles/a53fd65b58a64e39bee8522541c38253` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:49.875795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a801b-fd22-43c0-93df-540f83581c04 None admin] RBAC: Authorizing `identity:create_grant(project_id=95f59159e6a94f0f993fbc3ee5a8d44f, user_id=7b7be1898b6a4cfe94cc6c8719709d27, role_id=a53fd65b58a64e39bee8522541c38253)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:49.875795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a801b-fd22-43c0-93df-540f83581c04 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:49.893049 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 144/290] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:28:49 2022] PUT /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/users/7b7be1898b6a4cfe94cc6c8719709d27/roles/a53fd65b58a64e39bee8522541c38253 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:50.001239 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2665c8-7809-4238-8f6a-097d37ee95c9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:50.045412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd6007-e30d-4624-960c-9600d4a28a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:50.046303 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd6007-e30d-4624-960c-9600d4a28a2a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:50.046585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd6007-e30d-4624-960c-9600d4a28a2a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:50.046858 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd6007-e30d-4624-960c-9600d4a28a2a None admin] PATH_INFO: `/v3/users/36e31a314078456b83533abbd4996afe` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:50.048113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd6007-e30d-4624-960c-9600d4a28a2a None admin] RBAC: Authorizing `identity:get_user(user_id=36e31a314078456b83533abbd4996afe)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:50.049554 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd6007-e30d-4624-960c-9600d4a28a2a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:50.051188 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 147/291] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:49 2022] GET /identity/v3/users/36e31a314078456b83533abbd4996afe => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:50.057429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a801b-fd22-43c0-93df-540f83581c04 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:50.192627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a801b-fd22-43c0-93df-540f83581c04 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:50.236533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bdfb6-d82b-4fd4-a866-e79d1e502130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:50.237212 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bdfb6-d82b-4fd4-a866-e79d1e502130 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:50.237492 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bdfb6-d82b-4fd4-a866-e79d1e502130 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:50.237767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bdfb6-d82b-4fd4-a866-e79d1e502130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:50.313705 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bdfb6-d82b-4fd4-a866-e79d1e502130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:50.315360 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bdfb6-d82b-4fd4-a866-e79d1e502130 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:50.418785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 145/292] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:28:50.423921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd6007-e30d-4624-960c-9600d4a28a2a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:50.543565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd6007-e30d-4624-960c-9600d4a28a2a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:50.583757 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b75d0c-0e93-4489-b177-8841190d84c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:50.584602 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b75d0c-0e93-4489-b177-8841190d84c3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:50.584882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b75d0c-0e93-4489-b177-8841190d84c3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:50.585152 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b75d0c-0e93-4489-b177-8841190d84c3 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:50.586342 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b75d0c-0e93-4489-b177-8841190d84c3 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:50.587813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b75d0c-0e93-4489-b177-8841190d84c3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:50.589862 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 148/293] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:50 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:50.595446 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bdfb6-d82b-4fd4-a866-e79d1e502130 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:50.698258 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bdfb6-d82b-4fd4-a866-e79d1e502130 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:50.734899 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c5320-f2c9-4ca0-b4ae-bf9c456f7bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:50.735587 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5320-f2c9-4ca0-b4ae-bf9c456f7bcf None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:50.735901 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5320-f2c9-4ca0-b4ae-bf9c456f7bcf None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:50.736173 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5320-f2c9-4ca0-b4ae-bf9c456f7bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:50.737063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c5320-f2c9-4ca0-b4ae-bf9c456f7bcf None admin] RBAC: Adding query filter params (role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f, user.id=36e31a314078456b83533abbd4996afe) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:50.737376 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c5320-f2c9-4ca0-b4ae-bf9c456f7bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:50.738905 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c5320-f2c9-4ca0-b4ae-bf9c456f7bcf None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:50.747072 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 146/294] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:50 2022] GET /identity/v3/role_assignments?user.id=36e31a314078456b83533abbd4996afe&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:51.912268 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07608a71-6fc4-4e3f-b73f-9daa2fc8f430 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:51.912800 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07608a71-6fc4-4e3f-b73f-9daa2fc8f430 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:51.912800 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07608a71-6fc4-4e3f-b73f-9daa2fc8f430 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:51.914435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 149/295] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:51.919809 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673e93-e52f-4a35-a96f-bcbe29b2e408 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:51.919809 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673e93-e52f-4a35-a96f-bcbe29b2e408 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:51.919809 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8673e93-e52f-4a35-a96f-bcbe29b2e408 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:51.921928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac3ce-bc86-44ad-8899-59489d0a3083 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:51.922214 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac3ce-bc86-44ad-8899-59489d0a3083 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:51.922492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ac3ce-bc86-44ad-8899-59489d0a3083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:51.928142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 147/296] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:51.933697 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557682-2447-452b-8fee-3a1332d88d5a None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:51.933985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557682-2447-452b-8fee-3a1332d88d5a None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:51.934265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557682-2447-452b-8fee-3a1332d88d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:51.942069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-623ac3ce-bc86-44ad-8899-59489d0a3083 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:51.943481 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-623ac3ce-bc86-44ad-8899-59489d0a3083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:51.953332 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-46557682-2447-452b-8fee-3a1332d88d5a None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:51.954629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-46557682-2447-452b-8fee-3a1332d88d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:52.019880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 150/297] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:52.026292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 148/298] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:52.039542 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ac3ce-bc86-44ad-8899-59489d0a3083 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.049979 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46557682-2447-452b-8fee-3a1332d88d5a None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.145529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ac3ce-bc86-44ad-8899-59489d0a3083 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:52.153595 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46557682-2447-452b-8fee-3a1332d88d5a None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:52.180269 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7f2a2-98d0-47ac-88f3-f31e03a9bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:52.181390 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7f2a2-98d0-47ac-88f3-f31e03a9bada None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.182571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7f2a2-98d0-47ac-88f3-f31e03a9bada None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.183065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7f2a2-98d0-47ac-88f3-f31e03a9bada None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.190559 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7a2d-6d5b-4521-a7fc-a6b1678a84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:52.191451 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7a2d-6d5b-4521-a7fc-a6b1678a84ef None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.191853 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7a2d-6d5b-4521-a7fc-a6b1678a84ef None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.192205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7a2d-6d5b-4521-a7fc-a6b1678a84ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.193494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e7a2d-6d5b-4521-a7fc-a6b1678a84ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:52.195257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e7a2d-6d5b-4521-a7fc-a6b1678a84ef None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:52.195956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7f2a2-98d0-47ac-88f3-f31e03a9bada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:52.202373 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 149/299] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:52.203306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7a2d-6d5b-4521-a7fc-a6b1678a84ef None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-59e7f2a2-98d0-47ac-88f3-f31e03a9bada None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:52.205501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:52.206505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:52.207435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:52.210074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 151/300] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:52.216479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7f2a2-98d0-47ac-88f3-f31e03a9bada None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.313134 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7a2d-6d5b-4521-a7fc-a6b1678a84ef None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:52.319689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7f2a2-98d0-47ac-88f3-f31e03a9bada None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:52.350910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98cbbd-3587-4062-b6a8-8d7bc56703b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:52.351858 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98cbbd-3587-4062-b6a8-8d7bc56703b4 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.352300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98cbbd-3587-4062-b6a8-8d7bc56703b4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.352575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98cbbd-3587-4062-b6a8-8d7bc56703b4 None admin] PATH_INFO: `/v3/groups` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.353265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98cbbd-3587-4062-b6a8-8d7bc56703b4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:52.354168 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da2c57-ab2d-4e0a-89c4-c2fbde04ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:52.354950 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2c57-ab2d-4e0a-89c4-c2fbde04ae54 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.355236 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2c57-ab2d-4e0a-89c4-c2fbde04ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.355490 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98cbbd-3587-4062-b6a8-8d7bc56703b4 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:52.355605 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2c57-ab2d-4e0a-89c4-c2fbde04ae54 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.356314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da2c57-ab2d-4e0a-89c4-c2fbde04ae54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:52.356634 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da2c57-ab2d-4e0a-89c4-c2fbde04ae54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:52.358000 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da2c57-ab2d-4e0a-89c4-c2fbde04ae54 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:52.366899 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 152/301] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:52.368630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea48e-257b-435f-95f5-20af4906936a None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.369347 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea48e-257b-435f-95f5-20af4906936a None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.370015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ea48e-257b-435f-95f5-20af4906936a None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.371917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 153/302] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:52.372889 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ea48e-257b-435f-95f5-20af4906936a None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.384211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 150/303] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 9 15:28:52 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:28:52.388057 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071067-1ca6-4376-861e-9d6c0ab2c4a2 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.388057 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071067-1ca6-4376-861e-9d6c0ab2c4a2 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.388057 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071067-1ca6-4376-861e-9d6c0ab2c4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.411501 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-a1071067-1ca6-4376-861e-9d6c0ab2c4a2 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:52.413240 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-a1071067-1ca6-4376-861e-9d6c0ab2c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:52.492047 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ea48e-257b-435f-95f5-20af4906936a None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:52.507394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 151/304] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:52.530451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e813b-0c6a-4dc0-bcd4-f4dbdfdb2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:52.531357 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e813b-0c6a-4dc0-bcd4-f4dbdfdb2aff None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.531645 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e813b-0c6a-4dc0-bcd4-f4dbdfdb2aff None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.531967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e813b-0c6a-4dc0-bcd4-f4dbdfdb2aff None admin] PATH_INFO: `/v3/users/90b5f31e17884146a6c199aa3f899e9c` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.532662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071067-1ca6-4376-861e-9d6c0ab2c4a2 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.547720 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e813b-0c6a-4dc0-bcd4-f4dbdfdb2aff None admin] RBAC: Authorizing `identity:get_user(user_id=90b5f31e17884146a6c199aa3f899e9c)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:52.549337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e813b-0c6a-4dc0-bcd4-f4dbdfdb2aff None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:52.551405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 154/305] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/users/90b5f31e17884146a6c199aa3f899e9c => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:52.557639 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e813b-0c6a-4dc0-bcd4-f4dbdfdb2aff None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.657892 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071067-1ca6-4376-861e-9d6c0ab2c4a2 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:52.686326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e813b-0c6a-4dc0-bcd4-f4dbdfdb2aff None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:52.700768 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf7d7-d7cc-4f71-a1fe-75add352d126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:52.702456 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf7d7-d7cc-4f71-a1fe-75add352d126 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.703012 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf7d7-d7cc-4f71-a1fe-75add352d126 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.703456 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf7d7-d7cc-4f71-a1fe-75add352d126 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.718519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf7d7-d7cc-4f71-a1fe-75add352d126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:52.722132 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e258a-6bc4-4023-a5bb-522f5527b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:52.722870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e258a-6bc4-4023-a5bb-522f5527b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.723230 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e258a-6bc4-4023-a5bb-522f5527b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.723579 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e258a-6bc4-4023-a5bb-522f5527b6c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.724516 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e258a-6bc4-4023-a5bb-522f5527b6c2 None admin] RBAC: Adding query filter params (role.id=a53fd65b58a64e39bee8522541c38253, user.id=90b5f31e17884146a6c199aa3f899e9c, scope.system=all) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:52.724904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e258a-6bc4-4023-a5bb-522f5527b6c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:52.726455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e258a-6bc4-4023-a5bb-522f5527b6c2 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-d22bf7d7-d7cc-4f71-a1fe-75add352d126 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:52.728503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:52.729779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:52.730914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:52.733277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 152/306] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:52.739152 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf7d7-d7cc-4f71-a1fe-75add352d126 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.741287 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 155/307] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/role_assignments?user.id=90b5f31e17884146a6c199aa3f899e9c&scope.system=all&role.id=a53fd65b58a64e39bee8522541c38253 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:52.800754 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa142f8-9223-452e-960d-7300da34cccf None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.800943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa142f8-9223-452e-960d-7300da34cccf None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.801223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa142f8-9223-452e-960d-7300da34cccf None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.802950 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 156/308] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:52.810437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4907b11-71b4-407a-bc8c-112025da0690 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.810842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4907b11-71b4-407a-bc8c-112025da0690 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.811226 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4907b11-71b4-407a-bc8c-112025da0690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.830351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-c4907b11-71b4-407a-bc8c-112025da0690 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:52.831366 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-c4907b11-71b4-407a-bc8c-112025da0690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:52.874554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf7d7-d7cc-4f71-a1fe-75add352d126 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:52.912200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 157/309] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:52.921003 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:52.922296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:52.922740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:52.923203 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:52.924166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] RBAC: Adding query filter params (name=member) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:52.924648 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:52.926194 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:52.932907 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4907b11-71b4-407a-bc8c-112025da0690 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:52.936820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 153/310] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:52.942843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:53.037669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4907b11-71b4-407a-bc8c-112025da0690 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:53.049777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98823ae6-4af5-4fbc-b5d0-9461bc0ec181 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:53.074565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971873b-a797-40b5-b865-243d2fbd68b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:53.075479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971873b-a797-40b5-b865-243d2fbd68b7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:53.075912 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971873b-a797-40b5-b865-243d2fbd68b7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:53.076491 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971873b-a797-40b5-b865-243d2fbd68b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:53.087199 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971873b-a797-40b5-b865-243d2fbd68b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:53.088509 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb924c-766b-487e-a2f6-33fd08ff062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:53.089591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb924c-766b-487e-a2f6-33fd08ff062c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:53.090032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb924c-766b-487e-a2f6-33fd08ff062c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:53.090462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb924c-766b-487e-a2f6-33fd08ff062c None admin] PATH_INFO: `/v3/users/63336026aaf54e2cb824b3565422a98a` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:53.091886 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb924c-766b-487e-a2f6-33fd08ff062c None admin] RBAC: Authorizing `identity:get_user(user_id=63336026aaf54e2cb824b3565422a98a)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:53.093520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb924c-766b-487e-a2f6-33fd08ff062c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-0971873b-a797-40b5-b865-243d2fbd68b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:53.099976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:53.101013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:53.101959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:28:53.103137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 158/312] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:53.103387 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 154/312] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:52 2022] GET /identity/v3/users/63336026aaf54e2cb824b3565422a98a => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:53.104835 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971873b-a797-40b5-b865-243d2fbd68b7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:53.105618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb924c-766b-487e-a2f6-33fd08ff062c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:53.208421 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb924c-766b-487e-a2f6-33fd08ff062c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:53.208631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971873b-a797-40b5-b865-243d2fbd68b7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:53.244895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045c308-bafd-4c53-b6e9-426a96875179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:53.245850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c308-bafd-4c53-b6e9-426a96875179 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:53.246121 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:53.246262 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c308-bafd-4c53-b6e9-426a96875179 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:53.246470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c308-bafd-4c53-b6e9-426a96875179 None admin] PATH_INFO: `/v3/system/users/63336026aaf54e2cb824b3565422a98a/roles/68bfbd93f3e34ca58a58a2d237564990` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:53.247455 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:53.247983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045c308-bafd-4c53-b6e9-426a96875179 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=63336026aaf54e2cb824b3565422a98a, role_id=68bfbd93f3e34ca58a58a2d237564990)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:53.248208 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:53.248686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:53.249446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045c308-bafd-4c53-b6e9-426a96875179 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:53.249873 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:53.250411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:53.252041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:53.263803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 159/313] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 9 15:28:53 2022] PUT /identity/v3/system/users/63336026aaf54e2cb824b3565422a98a/roles/68bfbd93f3e34ca58a58a2d237564990 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:28:53.264187 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 155/314] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:53.269352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045c308-bafd-4c53-b6e9-426a96875179 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:53.383690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045c308-bafd-4c53-b6e9-426a96875179 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:53.427125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd40e-1303-4ea6-894a-7cf624f4254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:53.428304 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd40e-1303-4ea6-894a-7cf624f4254b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:53.428444 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd40e-1303-4ea6-894a-7cf624f4254b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:53.428684 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd40e-1303-4ea6-894a-7cf624f4254b None admin] PATH_INFO: `/v3/users/7b7be1898b6a4cfe94cc6c8719709d27` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:53.433110 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bd40e-1303-4ea6-894a-7cf624f4254b None admin] RBAC: Authorizing `identity:get_user(user_id=7b7be1898b6a4cfe94cc6c8719709d27)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:53.434644 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bd40e-1303-4ea6-894a-7cf624f4254b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:53.436760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 160/315] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:53 2022] GET /identity/v3/users/7b7be1898b6a4cfe94cc6c8719709d27 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:53.442811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:53.548842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d60b69-4aa9-40f3-956d-919a16b5e044 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:53.583327 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9bbbc-1177-4409-8368-46f8dc1d8726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:53.584079 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9bbbc-1177-4409-8368-46f8dc1d8726 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:53.584445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9bbbc-1177-4409-8368-46f8dc1d8726 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:53.584736 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9bbbc-1177-4409-8368-46f8dc1d8726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:53.656797 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9bbbc-1177-4409-8368-46f8dc1d8726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:53.658205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9bbbc-1177-4409-8368-46f8dc1d8726 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:53.760767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 156/316] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:28:53.765934 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd40e-1303-4ea6-894a-7cf624f4254b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:53.871235 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd40e-1303-4ea6-894a-7cf624f4254b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:53.908959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265d8b3-3951-4082-bc0f-224c9468b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:53.909752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265d8b3-3951-4082-bc0f-224c9468b1fc None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:53.910035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265d8b3-3951-4082-bc0f-224c9468b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:53.910311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265d8b3-3951-4082-bc0f-224c9468b1fc None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:53.911534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265d8b3-3951-4082-bc0f-224c9468b1fc None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:53.913015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265d8b3-3951-4082-bc0f-224c9468b1fc None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:53.915061 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 161/317] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:53 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:53.922502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9bbbc-1177-4409-8368-46f8dc1d8726 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:54.029112 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9bbbc-1177-4409-8368-46f8dc1d8726 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:54.063667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a32e59-9197-478f-8346-e58bae18f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:54.064357 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32e59-9197-478f-8346-e58bae18f8df None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:54.064635 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32e59-9197-478f-8346-e58bae18f8df None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:54.065159 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a32e59-9197-478f-8346-e58bae18f8df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:54.065995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a32e59-9197-478f-8346-e58bae18f8df None admin] RBAC: Adding query filter params (role.id=a53fd65b58a64e39bee8522541c38253, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f, user.id=7b7be1898b6a4cfe94cc6c8719709d27) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:54.066298 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a32e59-9197-478f-8346-e58bae18f8df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:54.067719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a32e59-9197-478f-8346-e58bae18f8df None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:54.074943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 157/318] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:28:53 2022] GET /identity/v3/role_assignments?user.id=7b7be1898b6a4cfe94cc6c8719709d27&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=a53fd65b58a64e39bee8522541c38253 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:54.803487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b237135-4a27-4071-9414-cbdc0012edee None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:54.804083 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b237135-4a27-4071-9414-cbdc0012edee None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:54.804083 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b237135-4a27-4071-9414-cbdc0012edee None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:54.805467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 162/319] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:54.811075 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1616e-ceeb-438a-b459-67d1c1d1755d None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:54.811363 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1616e-ceeb-438a-b459-67d1c1d1755d None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:54.811640 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1616e-ceeb-438a-b459-67d1c1d1755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:54.829069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-65c1616e-ceeb-438a-b459-67d1c1d1755d None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:54.830240 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-65c1616e-ceeb-438a-b459-67d1c1d1755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:54.902279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 158/320] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:54.925509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b237135-4a27-4071-9414-cbdc0012edee None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:55.031348 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b237135-4a27-4071-9414-cbdc0012edee None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:55.062930 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06de0-7de5-4c33-bd71-3fc89ce0ec39 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.062930 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06de0-7de5-4c33-bd71-3fc89ce0ec39 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.062930 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce06de0-7de5-4c33-bd71-3fc89ce0ec39 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.062930 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 159/321] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:55.067074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a682c03-c350-4995-9113-797b839d3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:55.067900 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682c03-c350-4995-9113-797b839d3665 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.068182 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682c03-c350-4995-9113-797b839d3665 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.068359 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503426-5e3e-46c4-865f-7b3be55b24b5 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.068520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a682c03-c350-4995-9113-797b839d3665 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.068686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503426-5e3e-46c4-865f-7b3be55b24b5 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.068867 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503426-5e3e-46c4-865f-7b3be55b24b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.069643 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a682c03-c350-4995-9113-797b839d3665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:55.071091 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a682c03-c350-4995-9113-797b839d3665 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:55.073018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 163/322] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:28:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:55.078502 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a682c03-c350-4995-9113-797b839d3665 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:55.085350 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-33503426-5e3e-46c4-865f-7b3be55b24b5 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:55.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-33503426-5e3e-46c4-865f-7b3be55b24b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:55.155262 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 160/323] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:55.177619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33503426-5e3e-46c4-865f-7b3be55b24b5 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:55.180520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a682c03-c350-4995-9113-797b839d3665 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:55.219067 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258bfed-3d76-4cf5-a095-2a4fcdc345d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:55.219758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258bfed-3d76-4cf5-a095-2a4fcdc345d1 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.220590 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258bfed-3d76-4cf5-a095-2a4fcdc345d1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.220590 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258bfed-3d76-4cf5-a095-2a4fcdc345d1 None admin] PATH_INFO: `/v3/groups` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.221045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258bfed-3d76-4cf5-a095-2a4fcdc345d1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:55.222753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258bfed-3d76-4cf5-a095-2a4fcdc345d1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:55.255970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 164/324] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 9 15:28:55 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:28:55.288603 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33503426-5e3e-46c4-865f-7b3be55b24b5 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:55.326116 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeba71-a96f-43ff-89ce-4009bdacd611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:55.326854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeba71-a96f-43ff-89ce-4009bdacd611 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.327143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeba71-a96f-43ff-89ce-4009bdacd611 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.327422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faeba71-a96f-43ff-89ce-4009bdacd611 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.339558 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faeba71-a96f-43ff-89ce-4009bdacd611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-9faeba71-a96f-43ff-89ce-4009bdacd611 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:55.347529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:55.348775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:55.355214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 161/325] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:55.358267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258bfed-3d76-4cf5-a095-2a4fcdc345d1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:55.464151 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258bfed-3d76-4cf5-a095-2a4fcdc345d1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:55.503055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:55.504245 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.504245 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.504427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.505122 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:55.505453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:55.506869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:55.518086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 165/326] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:55.523792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeba71-a96f-43ff-89ce-4009bdacd611 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:55.645411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faeba71-a96f-43ff-89ce-4009bdacd611 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:55.684224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964d150-2509-4e37-be36-efef749fd3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:55.685441 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964d150-2509-4e37-be36-efef749fd3f3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.685915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964d150-2509-4e37-be36-efef749fd3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.686380 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964d150-2509-4e37-be36-efef749fd3f3 None admin] PATH_INFO: `/v3/users/90b5f31e17884146a6c199aa3f899e9c` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.687880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964d150-2509-4e37-be36-efef749fd3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=90b5f31e17884146a6c199aa3f899e9c)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:55.689522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964d150-2509-4e37-be36-efef749fd3f3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:55.692016 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 162/327] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:55 2022] GET /identity/v3/users/90b5f31e17884146a6c199aa3f899e9c => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:55.699065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:55.715938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d113ca-a501-421c-aa46-f08ebad78b2f None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.716551 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d113ca-a501-421c-aa46-f08ebad78b2f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.716841 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d113ca-a501-421c-aa46-f08ebad78b2f None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.718370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 163/328] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:55.723948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ea01-1e79-4d40-a992-129e2075df27 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.724503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ea01-1e79-4d40-a992-129e2075df27 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.724991 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ea01-1e79-4d40-a992-129e2075df27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.742925 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-b9a4ea01-1e79-4d40-a992-129e2075df27 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:55.745891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-b9a4ea01-1e79-4d40-a992-129e2075df27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:55.830109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 164/329] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:55.836211 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb76ed-4f39-490b-b830-e53b2f22ef70 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:55.856164 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ea01-1e79-4d40-a992-129e2075df27 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:55.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ab31d-75f0-447a-9817-5e3331c6acc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:55.874339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab31d-75f0-447a-9817-5e3331c6acc4 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:55.874527 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab31d-75f0-447a-9817-5e3331c6acc4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:55.874765 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab31d-75f0-447a-9817-5e3331c6acc4 None admin] PATH_INFO: `/v3/system/users/90b5f31e17884146a6c199aa3f899e9c/roles/a53fd65b58a64e39bee8522541c38253` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:55.876351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ab31d-75f0-447a-9817-5e3331c6acc4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=90b5f31e17884146a6c199aa3f899e9c, role_id=a53fd65b58a64e39bee8522541c38253)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:55.877946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ab31d-75f0-447a-9817-5e3331c6acc4 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:55.888740 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 166/330] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 9 15:28:55 2022] PUT /identity/v3/system/users/90b5f31e17884146a6c199aa3f899e9c/roles/a53fd65b58a64e39bee8522541c38253 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:28:55.981115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ea01-1e79-4d40-a992-129e2075df27 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:56.023197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844927-d92a-40d1-bae9-0c7a06a63421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:56.024316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844927-d92a-40d1-bae9-0c7a06a63421 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:56.024847 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844927-d92a-40d1-bae9-0c7a06a63421 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:56.025215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06844927-d92a-40d1-bae9-0c7a06a63421 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:56.037786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06844927-d92a-40d1-bae9-0c7a06a63421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-06844927-d92a-40d1-bae9-0c7a06a63421 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:56.047104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:56.048911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:56.050470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 165/331] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:28:56.060860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ab31d-75f0-447a-9817-5e3331c6acc4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:56.173086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ab31d-75f0-447a-9817-5e3331c6acc4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:56.210117 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:56.211214 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:56.211717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:56.212256 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:56.213845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:56.214380 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:56.216052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:56.239582 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 167/332] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:28:56.246458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844927-d92a-40d1-bae9-0c7a06a63421 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:56.413416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06844927-d92a-40d1-bae9-0c7a06a63421 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:56.457554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4971c41-e1b6-4236-91ff-fe30623c9a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:56.458449 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971c41-e1b6-4236-91ff-fe30623c9a22 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:56.458741 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971c41-e1b6-4236-91ff-fe30623c9a22 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:56.459002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971c41-e1b6-4236-91ff-fe30623c9a22 None admin] PATH_INFO: `/v3/users/63336026aaf54e2cb824b3565422a98a` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:56.460344 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4971c41-e1b6-4236-91ff-fe30623c9a22 None admin] RBAC: Authorizing `identity:get_user(user_id=63336026aaf54e2cb824b3565422a98a)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:56.461796 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4971c41-e1b6-4236-91ff-fe30623c9a22 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:56.464507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 166/333] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:28:56 2022] GET /identity/v3/users/63336026aaf54e2cb824b3565422a98a => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:56.471284 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:56.620908 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238037ca-bd33-46e6-8d85-9073de79755a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:56.667404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9614c-36fa-4e33-bd7a-3552ccc18d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:56.668126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9614c-36fa-4e33-bd7a-3552ccc18d2e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:56.668420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9614c-36fa-4e33-bd7a-3552ccc18d2e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:56.668703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9614c-36fa-4e33-bd7a-3552ccc18d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:56.669561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9614c-36fa-4e33-bd7a-3552ccc18d2e None admin] RBAC: Adding query filter params (role.id=68bfbd93f3e34ca58a58a2d237564990, user.id=63336026aaf54e2cb824b3565422a98a, scope.system=all) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:56.669873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9614c-36fa-4e33-bd7a-3552ccc18d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:56.671352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9614c-36fa-4e33-bd7a-3552ccc18d2e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:56.688079 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 168/334] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:28:56 2022] GET /identity/v3/role_assignments?user.id=63336026aaf54e2cb824b3565422a98a&scope.system=all&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:58.673090 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dad08-e7b2-4fbc-bb4d-5bf9a387a395 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:58.673601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dad08-e7b2-4fbc-bb4d-5bf9a387a395 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:58.673601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dad08-e7b2-4fbc-bb4d-5bf9a387a395 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:58.675207 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 167/335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:58.685422 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7624-48a7-43cd-bc37-999dd07900d3 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:58.686345 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7624-48a7-43cd-bc37-999dd07900d3 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:58.686849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7624-48a7-43cd-bc37-999dd07900d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:58.712923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-86ac7624-48a7-43cd-bc37-999dd07900d3 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:58.714593 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-86ac7624-48a7-43cd-bc37-999dd07900d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:58.797136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 169/336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:58.840464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dad08-e7b2-4fbc-bb4d-5bf9a387a395 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:58.972513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dad08-e7b2-4fbc-bb4d-5bf9a387a395 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:59.013466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274055a-96ce-4bd1-8548-8249656e63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:59.014287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274055a-96ce-4bd1-8548-8249656e63f0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.014570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274055a-96ce-4bd1-8548-8249656e63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.014846 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274055a-96ce-4bd1-8548-8249656e63f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.030318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274055a-96ce-4bd1-8548-8249656e63f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-e274055a-96ce-4bd1-8548-8249656e63f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:59.038273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:59.039310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:28:59.040318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:59.044324 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 168/337] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:28:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:59.050144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac7624-48a7-43cd-bc37-999dd07900d3 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:59.175420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f973-923f-4cfe-a692-58e88b4898a7 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.176031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f973-923f-4cfe-a692-58e88b4898a7 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.176498 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6f973-923f-4cfe-a692-58e88b4898a7 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.178329 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 169/338] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:28:59.183478 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b394-4528-4c82-a527-7f5adea76f52 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.184096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b394-4528-4c82-a527-7f5adea76f52 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.184607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578b394-4528-4c82-a527-7f5adea76f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.202511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac7624-48a7-43cd-bc37-999dd07900d3 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:59.216878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-9578b394-4528-4c82-a527-7f5adea76f52 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:59.218443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-9578b394-4528-4c82-a527-7f5adea76f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:59.282018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:59.282628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.282909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.283180 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.283976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:28:59.284285 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:59.285686 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:59.306105 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 170/340] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:28:59.307703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b93b-f848-4299-b003-8657f9f77d40 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.311848 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 170/340] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:28:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:28:59.312125 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b93b-f848-4299-b003-8657f9f77d40 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.312414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962b93b-f848-4299-b003-8657f9f77d40 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.313747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 171/341] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:59.315322 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:59.320903 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03c3d4-8150-4583-a949-d04194e6db47 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.321184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03c3d4-8150-4583-a949-d04194e6db47 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.321457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03c3d4-8150-4583-a949-d04194e6db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.354692 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-db03c3d4-8150-4583-a949-d04194e6db47 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:28:59.356077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-db03c3d4-8150-4583-a949-d04194e6db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:28:59.465259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 172/342] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:28:59.466134 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03c3d4-8150-4583-a949-d04194e6db47 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:59.557600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ff8a-68f0-4781-88ca-ac80a6b28daa None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:59.629065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378b5a1-1c46-4fa6-a664-e394f2e9ff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:59.629757 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378b5a1-1c46-4fa6-a664-e394f2e9ff04 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.630035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378b5a1-1c46-4fa6-a664-e394f2e9ff04 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.630306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378b5a1-1c46-4fa6-a664-e394f2e9ff04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.648684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03c3d4-8150-4583-a949-d04194e6db47 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:59.684688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9ab63-18d7-430c-b9d5-d02238458625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:59.685595 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ab63-18d7-430c-b9d5-d02238458625 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.685846 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ab63-18d7-430c-b9d5-d02238458625 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.686115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9ab63-18d7-430c-b9d5-d02238458625 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.704336 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9ab63-18d7-430c-b9d5-d02238458625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-93e9ab63-18d7-430c-b9d5-d02238458625 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:59.713058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:59.714111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 173/343] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:28:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:59.715591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9ab63-18d7-430c-b9d5-d02238458625 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:59.735129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378b5a1-1c46-4fa6-a664-e394f2e9ff04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:28:59.736804 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378b5a1-1c46-4fa6-a664-e394f2e9ff04 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:28:59.830273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9ab63-18d7-430c-b9d5-d02238458625 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:28:59.864338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 171/344] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:28:59.866059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfb0b0-3bfb-4617-8653-27fe344225e5 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.866615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfb0b0-3bfb-4617-8653-27fe344225e5 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.866965 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfb0b0-3bfb-4617-8653-27fe344225e5 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.872524 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 172/345] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:59.872524 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfb0b0-3bfb-4617-8653-27fe344225e5 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:28:59.875051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44f616-6b0e-4ad1-bd0f-4cc31e5b50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:28:59.875927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f616-6b0e-4ad1-bd0f-4cc31e5b50de None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.876207 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f616-6b0e-4ad1-bd0f-4cc31e5b50de None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.876477 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f616-6b0e-4ad1-bd0f-4cc31e5b50de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.889833 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44f616-6b0e-4ad1-bd0f-4cc31e5b50de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-5a44f616-6b0e-4ad1-bd0f-4cc31e5b50de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:28:59.896617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:28:59.897673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:28:59.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 174/346] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:28:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:28:59.899373 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4ba73-a666-4a1e-bbd5-2c8227d5eb19 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:28:59.899455 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4ba73-a666-4a1e-bbd5-2c8227d5eb19 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:28:59.900481 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4ba73-a666-4a1e-bbd5-2c8227d5eb19 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:28:59.902459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 175/347] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:28:59.902459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4ba73-a666-4a1e-bbd5-2c8227d5eb19 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.001458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfb0b0-3bfb-4617-8653-27fe344225e5 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.025494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4ba73-a666-4a1e-bbd5-2c8227d5eb19 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.045998 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f53328-1346-4202-881d-a7adf005afa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.046552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f53328-1346-4202-881d-a7adf005afa2 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.046836 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f53328-1346-4202-881d-a7adf005afa2 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.047108 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f53328-1346-4202-881d-a7adf005afa2 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.050540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f53328-1346-4202-881d-a7adf005afa2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:00.050540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f53328-1346-4202-881d-a7adf005afa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:00.050764 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f53328-1346-4202-881d-a7adf005afa2 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:00.064286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 173/348] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:28:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:00.066372 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f762cc9-e71a-4e6e-9896-02d047d765c7 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.066834 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f762cc9-e71a-4e6e-9896-02d047d765c7 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.067281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f762cc9-e71a-4e6e-9896-02d047d765c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.070414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fcfd9-f7fe-4bda-9518-87d6f8b46c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.071312 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fcfd9-f7fe-4bda-9518-87d6f8b46c82 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.071564 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fcfd9-f7fe-4bda-9518-87d6f8b46c82 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.071873 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fcfd9-f7fe-4bda-9518-87d6f8b46c82 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.074353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fcfd9-f7fe-4bda-9518-87d6f8b46c82 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:00.076915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fcfd9-f7fe-4bda-9518-87d6f8b46c82 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:00.078013 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 176/349] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:28:59 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:00.079388 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e3478-184d-4377-a3ca-40619b882ff9 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.079677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e3478-184d-4377-a3ca-40619b882ff9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.079982 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e3478-184d-4377-a3ca-40619b882ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.090393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-1f762cc9-e71a-4e6e-9896-02d047d765c7 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:00.091959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-1f762cc9-e71a-4e6e-9896-02d047d765c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:00.097806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-e81e3478-184d-4377-a3ca-40619b882ff9 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:00.098994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-e81e3478-184d-4377-a3ca-40619b882ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:00.179491 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 174/350] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:00.180335 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f762cc9-e71a-4e6e-9896-02d047d765c7 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.183872 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 177/351] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:00.184780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e3478-184d-4377-a3ca-40619b882ff9 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.313007 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e3478-184d-4377-a3ca-40619b882ff9 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.324054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f762cc9-e71a-4e6e-9896-02d047d765c7 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.360360 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2ce99-58ca-4874-864f-9e4a44ff9f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.361278 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2ce99-58ca-4874-864f-9e4a44ff9f7a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.361732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2ce99-58ca-4874-864f-9e4a44ff9f7a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.362013 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2ce99-58ca-4874-864f-9e4a44ff9f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.367274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.368165 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.368628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.369628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.371394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:00.372412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:00.374038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:00.383396 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 175/352] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:00.385150 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.460481 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2ce99-58ca-4874-864f-9e4a44ff9f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:00.461946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2ce99-58ca-4874-864f-9e4a44ff9f7a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:00.498675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24252ba4-6e67-4f9a-8c91-ba2e28e305f4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.540304 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3c4f-f823-42f6-8516-bdb3ea9fc030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.541736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3c4f-f823-42f6-8516-bdb3ea9fc030 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.542243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3c4f-f823-42f6-8516-bdb3ea9fc030 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.542736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf3c4f-f823-42f6-8516-bdb3ea9fc030 None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.551903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf3c4f-f823-42f6-8516-bdb3ea9fc030 None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:00.553426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf3c4f-f823-42f6-8516-bdb3ea9fc030 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:00.555292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 176/353] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:00 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:00.556022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3c4f-f823-42f6-8516-bdb3ea9fc030 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.573745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 178/354] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:00.574625 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2ce99-58ca-4874-864f-9e4a44ff9f7a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.673181 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf3c4f-f823-42f6-8516-bdb3ea9fc030 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.690097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2ce99-58ca-4874-864f-9e4a44ff9f7a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.708437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f813cf-6460-4e35-9506-8e92e709cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.709346 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f813cf-6460-4e35-9506-8e92e709cce9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.709634 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f813cf-6460-4e35-9506-8e92e709cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.709917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f813cf-6460-4e35-9506-8e92e709cce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.721411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f813cf-6460-4e35-9506-8e92e709cce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:00.729135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c8c33-6926-4bc2-9e4b-f0c68dcdf218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-e0f813cf-6460-4e35-9506-8e92e709cce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:00.729847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:00.730871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:00.731838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:00.732543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8c33-6926-4bc2-9e4b-f0c68dcdf218 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.732543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8c33-6926-4bc2-9e4b-f0c68dcdf218 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.732543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c8c33-6926-4bc2-9e4b-f0c68dcdf218 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.732766 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 177/355] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:00.732766 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f813cf-6460-4e35-9506-8e92e709cce9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.746695 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c8c33-6926-4bc2-9e4b-f0c68dcdf218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-3f6c8c33-6926-4bc2-9e4b-f0c68dcdf218 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:00.754831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:00.756050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:29:00.756954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:00.757653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 179/356] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:00.758416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97c32-62f3-4253-a20b-ffa2258e49a2 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.758754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97c32-62f3-4253-a20b-ffa2258e49a2 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.759034 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97c32-62f3-4253-a20b-ffa2258e49a2 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.760436 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 180/357] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:00.764656 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e97c32-62f3-4253-a20b-ffa2258e49a2 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.851205 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f813cf-6460-4e35-9506-8e92e709cce9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.877182 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e97c32-62f3-4253-a20b-ffa2258e49a2 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:00.894427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95b69c-c54e-47d6-8fb9-ea85d5288463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.895850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95b69c-c54e-47d6-8fb9-ea85d5288463 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.895850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95b69c-c54e-47d6-8fb9-ea85d5288463 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.895850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95b69c-c54e-47d6-8fb9-ea85d5288463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.920549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:00.921215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:00.921495 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:00.922256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:00.922603 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] RBAC: Adding query filter params (group.id=39c9c694600e4b728e47b75bc586e4df, role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=3d5767bb2ca248d48c5820335e1738c7) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:00.922912 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:00.924489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:00.931994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 181/358] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:00 2022] GET /identity/v3/role_assignments?group.id=39c9c694600e4b728e47b75bc586e4df&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:00.932879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:00.993263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95b69c-c54e-47d6-8fb9-ea85d5288463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:00.995551 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95b69c-c54e-47d6-8fb9-ea85d5288463 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.069802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb9500-421b-4400-b2cb-317b50611b75 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.126488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14763-7753-4c5b-8f01-de84a2bf49cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.127374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14763-7753-4c5b-8f01-de84a2bf49cb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.127651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14763-7753-4c5b-8f01-de84a2bf49cb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.128253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14763-7753-4c5b-8f01-de84a2bf49cb None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.129178 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14763-7753-4c5b-8f01-de84a2bf49cb None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:01.130632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14763-7753-4c5b-8f01-de84a2bf49cb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.132635 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 182/359] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:00 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:01.133159 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14763-7753-4c5b-8f01-de84a2bf49cb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.139992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 178/360] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:01.140970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95b69c-c54e-47d6-8fb9-ea85d5288463 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.261658 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14763-7753-4c5b-8f01-de84a2bf49cb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.263727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95b69c-c54e-47d6-8fb9-ea85d5288463 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.305255 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4083a4f-3434-4bf1-af16-b84815bf1b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.305492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083a4f-3434-4bf1-af16-b84815bf1b8f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.305599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498eba-916b-4902-8020-098089058ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.305709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083a4f-3434-4bf1-af16-b84815bf1b8f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.305974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083a4f-3434-4bf1-af16-b84815bf1b8f None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.306166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498eba-916b-4902-8020-098089058ceb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.310062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498eba-916b-4902-8020-098089058ceb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.310062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa498eba-916b-4902-8020-098089058ceb None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.310282 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4083a4f-3434-4bf1-af16-b84815bf1b8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:01.310380 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa498eba-916b-4902-8020-098089058ceb None admin] RBAC: Adding query filter params (name=member) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:01.310466 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4083a4f-3434-4bf1-af16-b84815bf1b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:01.310544 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa498eba-916b-4902-8020-098089058ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:01.310625 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4083a4f-3434-4bf1-af16-b84815bf1b8f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.310709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa498eba-916b-4902-8020-098089058ceb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.319258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 179/361] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:01.321130 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 183/362] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:01.322333 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498eba-916b-4902-8020-098089058ceb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.324427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedf4a-7d3f-40f7-a0e1-f28b2605f913 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.324427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedf4a-7d3f-40f7-a0e1-f28b2605f913 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.324427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dedf4a-7d3f-40f7-a0e1-f28b2605f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.345102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-f4dedf4a-7d3f-40f7-a0e1-f28b2605f913 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:01.346320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-f4dedf4a-7d3f-40f7-a0e1-f28b2605f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:01.427401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 180/363] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:01.428618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dedf4a-7d3f-40f7-a0e1-f28b2605f913 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.461288 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa498eba-916b-4902-8020-098089058ceb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.500649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe2dee-78a3-4fe1-a4ec-9925fccb888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.501516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2dee-78a3-4fe1-a4ec-9925fccb888b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.501800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2dee-78a3-4fe1-a4ec-9925fccb888b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.502074 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2dee-78a3-4fe1-a4ec-9925fccb888b None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.503253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe2dee-78a3-4fe1-a4ec-9925fccb888b None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:01.504834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe2dee-78a3-4fe1-a4ec-9925fccb888b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.506475 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 184/364] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:01.507244 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe2dee-78a3-4fe1-a4ec-9925fccb888b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.546505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dedf4a-7d3f-40f7-a0e1-f28b2605f913 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.580853 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab19cee-8b73-4d9c-8824-d45107bc00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.581723 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab19cee-8b73-4d9c-8824-d45107bc00c6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.582003 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab19cee-8b73-4d9c-8824-d45107bc00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.582274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab19cee-8b73-4d9c-8824-d45107bc00c6 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.583479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab19cee-8b73-4d9c-8824-d45107bc00c6 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:01.584952 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab19cee-8b73-4d9c-8824-d45107bc00c6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.592029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 181/365] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:01.592029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab19cee-8b73-4d9c-8824-d45107bc00c6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.615143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe2dee-78a3-4fe1-a4ec-9925fccb888b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.650096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e8a5-9917-4322-a679-2a0c647bcaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.651519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e8a5-9917-4322-a679-2a0c647bcaad None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.651519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e8a5-9917-4322-a679-2a0c647bcaad None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.651832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99e8a5-9917-4322-a679-2a0c647bcaad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.690963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab19cee-8b73-4d9c-8824-d45107bc00c6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.719859 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99e8a5-9917-4322-a679-2a0c647bcaad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:01.721310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99e8a5-9917-4322-a679-2a0c647bcaad None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.728173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4f2b9-4b0e-410a-8c9a-48a766e9aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.729136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f2b9-4b0e-410a-8c9a-48a766e9aeaf None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.729488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f2b9-4b0e-410a-8c9a-48a766e9aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.729833 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4f2b9-4b0e-410a-8c9a-48a766e9aeaf None admin] PATH_INFO: `/v3/users/90b5f31e17884146a6c199aa3f899e9c` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.731143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4f2b9-4b0e-410a-8c9a-48a766e9aeaf None admin] RBAC: Authorizing `identity:get_user(user_id=90b5f31e17884146a6c199aa3f899e9c)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:01.732702 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4f2b9-4b0e-410a-8c9a-48a766e9aeaf None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.739211 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 182/366] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/users/90b5f31e17884146a6c199aa3f899e9c => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:01.739211 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4f2b9-4b0e-410a-8c9a-48a766e9aeaf None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.825316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 185/367] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:01.825316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e8a5-9917-4322-a679-2a0c647bcaad None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.841986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4f2b9-4b0e-410a-8c9a-48a766e9aeaf None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.875424 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5a45-8116-4d72-b5a9-d3c96df0cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.876255 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5a45-8116-4d72-b5a9-d3c96df0cff4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.876541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5a45-8116-4d72-b5a9-d3c96df0cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.876825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac5a45-8116-4d72-b5a9-d3c96df0cff4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.887146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac5a45-8116-4d72-b5a9-d3c96df0cff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-e9ac5a45-8116-4d72-b5a9-d3c96df0cff4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:01.894860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:01.895943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 183/368] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:01.897531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5a45-8116-4d72-b5a9-d3c96df0cff4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:01.920539 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99e8a5-9917-4322-a679-2a0c647bcaad None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:01.954409 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:01.955064 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:01.955348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:01.955632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:01.956507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] RBAC: Adding query filter params (group.id=39c9c694600e4b728e47b75bc586e4df, role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:01.956828 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:01.958241 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:01.964784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 186/369] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/role_assignments?group.id=39c9c694600e4b728e47b75bc586e4df&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=7c610827438840438f3b3e90fac7c51c => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:01.965575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:02.013137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac5a45-8116-4d72-b5a9-d3c96df0cff4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:02.057427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f2b27-d2d8-4e10-8164-a87b0e859976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:02.058740 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f2b27-d2d8-4e10-8164-a87b0e859976 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:02.058871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f2b27-d2d8-4e10-8164-a87b0e859976 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:02.059098 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f2b27-d2d8-4e10-8164-a87b0e859976 None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:02.060535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f2b27-d2d8-4e10-8164-a87b0e859976 None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:02.062026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f2b27-d2d8-4e10-8164-a87b0e859976 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:02.069101 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 184/370] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:02.070078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f2b27-d2d8-4e10-8164-a87b0e859976 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:02.083802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a48e-fc1c-4414-a475-4dd6582467f1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:02.131564 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:02.132076 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:02.132375 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:02.132654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:02.133513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] RBAC: Adding query filter params (role.id=a53fd65b58a64e39bee8522541c38253, user.id=90b5f31e17884146a6c199aa3f899e9c, scope.system=all) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:02.133829 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:02.135926 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:02.155798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 187/371] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:29:01 2022] GET /identity/v3/role_assignments?user.id=90b5f31e17884146a6c199aa3f899e9c&scope.system=all&role.id=a53fd65b58a64e39bee8522541c38253 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:02.155798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:02.211211 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f2b27-d2d8-4e10-8164-a87b0e859976 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:02.247919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58089b6-773a-4b81-95bd-8703247d91e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:02.249223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58089b6-773a-4b81-95bd-8703247d91e3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:02.249730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58089b6-773a-4b81-95bd-8703247d91e3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:02.250224 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58089b6-773a-4b81-95bd-8703247d91e3 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:02.251821 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58089b6-773a-4b81-95bd-8703247d91e3 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:02.253552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58089b6-773a-4b81-95bd-8703247d91e3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:02.260027 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 185/372] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:02 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:02.261482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58089b6-773a-4b81-95bd-8703247d91e3 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:02.354210 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb903-a630-4434-b330-765a19b3ca50 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:02.378659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58089b6-773a-4b81-95bd-8703247d91e3 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:02.416681 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:02.417800 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:02.418310 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:02.418816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:02.420037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] RBAC: Adding query filter params (group.id=39c9c694600e4b728e47b75bc586e4df, role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=3d5767bb2ca248d48c5820335e1738c7) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:02.420659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:02.422401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:02.426573 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:02.427274 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:02.427559 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:02.427858 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:02.428685 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:02.429000 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:02.430384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:02.430985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 186/373] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:02 2022] GET /identity/v3/role_assignments?group.id=39c9c694600e4b728e47b75bc586e4df&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=7c610827438840438f3b3e90fac7c51c => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:02.441009 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:02.442250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 188/374] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:02.449146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:02.554353 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89993477-4551-48b2-bd08-66720ccfc30f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:02.594036 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2df566-7cc3-4950-a6fc-e46fa836ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:02.595370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2df566-7cc3-4950-a6fc-e46fa836ed39 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:02.595910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2df566-7cc3-4950-a6fc-e46fa836ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:02.596423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2df566-7cc3-4950-a6fc-e46fa836ed39 None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:02.597993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2df566-7cc3-4950-a6fc-e46fa836ed39 None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:02.599726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2df566-7cc3-4950-a6fc-e46fa836ed39 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:02.600595 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bee1d-3194-4400-8202-60be5ca60a0c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:02.602295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 187/375] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:02 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:02.608907 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2df566-7cc3-4950-a6fc-e46fa836ed39 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:02.647796 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6cd6d-20db-4d3e-ae7f-9187a9ff085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:02.647796 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6cd6d-20db-4d3e-ae7f-9187a9ff085f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:02.647796 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6cd6d-20db-4d3e-ae7f-9187a9ff085f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:02.647796 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6cd6d-20db-4d3e-ae7f-9187a9ff085f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:02.720459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6cd6d-20db-4d3e-ae7f-9187a9ff085f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:02.721946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6cd6d-20db-4d3e-ae7f-9187a9ff085f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:02.725126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2df566-7cc3-4950-a6fc-e46fa836ed39 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:02.762710 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:02.763382 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:02.763668 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:02.763998 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:02.764853 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] RBAC: Adding query filter params (group.id=39c9c694600e4b728e47b75bc586e4df, role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:02.765173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:02.766617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:02.772959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 188/376] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:02 2022] GET /identity/v3/role_assignments?group.id=39c9c694600e4b728e47b75bc586e4df&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:02.841802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 189/377] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:02.847518 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:02.966369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381bfc9-90cb-4254-a195-7b2df977ddb9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:03.008470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823cdd5-ffb4-421e-95c1-e21647930b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:03.009917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823cdd5-ffb4-421e-95c1-e21647930b89 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:03.010340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823cdd5-ffb4-421e-95c1-e21647930b89 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:03.011189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823cdd5-ffb4-421e-95c1-e21647930b89 None admin] PATH_INFO: `/v3/projects/4feddf1938a742ebac431fd3312cccc1` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:03.012611 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823cdd5-ffb4-421e-95c1-e21647930b89 None admin] RBAC: Authorizing `identity:get_project(project_id=4feddf1938a742ebac431fd3312cccc1)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:03.014080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823cdd5-ffb4-421e-95c1-e21647930b89 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:03.016178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 189/378] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:02 2022] GET /identity/v3/projects/4feddf1938a742ebac431fd3312cccc1 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:03.021941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6cd6d-20db-4d3e-ae7f-9187a9ff085f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:03.144581 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6cd6d-20db-4d3e-ae7f-9187a9ff085f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:03.192245 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9e354-11f4-4984-bb58-b34783f2e271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:03.193112 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9e354-11f4-4984-bb58-b34783f2e271 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:03.193391 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9e354-11f4-4984-bb58-b34783f2e271 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:03.193670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9e354-11f4-4984-bb58-b34783f2e271 None admin] PATH_INFO: `/v3/groups/31072592cece47c98418d3b42aea3da9` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:03.202088 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9e354-11f4-4984-bb58-b34783f2e271 None admin] RBAC: Authorizing `identity:get_group(group_id=31072592cece47c98418d3b42aea3da9)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:03.203908 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9e354-11f4-4984-bb58-b34783f2e271 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:03.206173 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 190/379] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:03 2022] GET /identity/v3/groups/31072592cece47c98418d3b42aea3da9 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:03.211669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823cdd5-ffb4-421e-95c1-e21647930b89 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:03.366754 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823cdd5-ffb4-421e-95c1-e21647930b89 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:03.424518 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098226e4-7a63-4160-ad06-11895b56d7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:03.425581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098226e4-7a63-4160-ad06-11895b56d7e1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:03.426084 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098226e4-7a63-4160-ad06-11895b56d7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:03.426599 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098226e4-7a63-4160-ad06-11895b56d7e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:03.427668 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098226e4-7a63-4160-ad06-11895b56d7e1 None admin] RBAC: Adding query filter params (group.id=31072592cece47c98418d3b42aea3da9, role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=4feddf1938a742ebac431fd3312cccc1) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:03.428216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098226e4-7a63-4160-ad06-11895b56d7e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:03.429946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098226e4-7a63-4160-ad06-11895b56d7e1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:03.443909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 190/380] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:03 2022] GET /identity/v3/role_assignments?group.id=31072592cece47c98418d3b42aea3da9&scope.project.id=4feddf1938a742ebac431fd3312cccc1&role.id=8cf832105b2949f6b11e06b208146326 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:03.666807 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215a810-68ce-4f5e-a7f8-e7532abf18af None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:03.667501 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215a810-68ce-4f5e-a7f8-e7532abf18af None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:03.668019 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215a810-68ce-4f5e-a7f8-e7532abf18af None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:03.669837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 191/381] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:03.675706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ffbf-4bc0-4576-9d57-2926bb6efb37 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:03.676328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ffbf-4bc0-4576-9d57-2926bb6efb37 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:03.676837 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200ffbf-4bc0-4576-9d57-2926bb6efb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:03.704062 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-5200ffbf-4bc0-4576-9d57-2926bb6efb37 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:03.705680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-5200ffbf-4bc0-4576-9d57-2926bb6efb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:03.800045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 191/382] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:03.823855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215a810-68ce-4f5e-a7f8-e7532abf18af None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:03.960715 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215a810-68ce-4f5e-a7f8-e7532abf18af None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:04.013419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a032a1-8f3c-4a9b-b29a-51835e3a69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:04.014492 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a032a1-8f3c-4a9b-b29a-51835e3a69d0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:04.014949 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a032a1-8f3c-4a9b-b29a-51835e3a69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:04.015385 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a032a1-8f3c-4a9b-b29a-51835e3a69d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:04.030277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a032a1-8f3c-4a9b-b29a-51835e3a69d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-c0a032a1-8f3c-4a9b-b29a-51835e3a69d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:04.038500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:04.039706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:04.040896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:04.043306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 192/383] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:04.052855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200ffbf-4bc0-4576-9d57-2926bb6efb37 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:04.169873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200ffbf-4bc0-4576-9d57-2926bb6efb37 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:04.206870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:04.207555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:04.207885 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:04.208160 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:04.208955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:04.209263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:04.210632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:04.220190 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 192/384] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:29:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:04.225875 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a032a1-8f3c-4a9b-b29a-51835e3a69d0 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:04.393936 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a032a1-8f3c-4a9b-b29a-51835e3a69d0 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:04.449386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608916ff-d15c-4e21-9d22-d94d88e35a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:04.450645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608916ff-d15c-4e21-9d22-d94d88e35a41 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:04.451156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608916ff-d15c-4e21-9d22-d94d88e35a41 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:04.451654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608916ff-d15c-4e21-9d22-d94d88e35a41 None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:04.453080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608916ff-d15c-4e21-9d22-d94d88e35a41 None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:04.454768 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608916ff-d15c-4e21-9d22-d94d88e35a41 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:04.457069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 193/385] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:04 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:04.463462 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:04.627025 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cae56-8ed8-4336-8717-80d71557bad1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:04.676493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09187fde-8118-42a1-bbb4-463b854603a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:04.677375 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187fde-8118-42a1-bbb4-463b854603a2 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:04.677656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187fde-8118-42a1-bbb4-463b854603a2 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:04.677932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187fde-8118-42a1-bbb4-463b854603a2 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:04.679197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09187fde-8118-42a1-bbb4-463b854603a2 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:04.680677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09187fde-8118-42a1-bbb4-463b854603a2 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:04.683400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 193/386] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:04 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:04.688855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608916ff-d15c-4e21-9d22-d94d88e35a41 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:04.763517 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4df0b-24f5-46cd-b727-8ed288f1f361 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:04.763917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4df0b-24f5-46cd-b727-8ed288f1f361 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:04.764104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4df0b-24f5-46cd-b727-8ed288f1f361 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:04.765789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 194/387] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:04.771210 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8593308-a20a-404f-b0ce-95ca2ae44842 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:04.771502 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8593308-a20a-404f-b0ce-95ca2ae44842 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:04.771796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8593308-a20a-404f-b0ce-95ca2ae44842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:04.797440 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-b8593308-a20a-404f-b0ce-95ca2ae44842 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:04.798644 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-b8593308-a20a-404f-b0ce-95ca2ae44842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:04.872839 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608916ff-d15c-4e21-9d22-d94d88e35a41 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:04.918739 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 195/388] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:04.935239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3026e53-006c-4066-bf4c-2f6481600b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:04.936167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3026e53-006c-4066-bf4c-2f6481600b83 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:04.936456 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3026e53-006c-4066-bf4c-2f6481600b83 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:04.936735 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3026e53-006c-4066-bf4c-2f6481600b83 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7/groups/39c9c694600e4b728e47b75bc586e4df/roles/68bfbd93f3e34ca58a58a2d237564990` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:04.938798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3026e53-006c-4066-bf4c-2f6481600b83 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d5767bb2ca248d48c5820335e1738c7, group_id=39c9c694600e4b728e47b75bc586e4df, role_id=68bfbd93f3e34ca58a58a2d237564990)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:04.940594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3026e53-006c-4066-bf4c-2f6481600b83 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:04.949096 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8593308-a20a-404f-b0ce-95ca2ae44842 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:04.957175 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 194/389] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:29:04 2022] PUT /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7/groups/39c9c694600e4b728e47b75bc586e4df/roles/68bfbd93f3e34ca58a58a2d237564990 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:05.063113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8593308-a20a-404f-b0ce-95ca2ae44842 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:05.110071 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074063-1cd0-4a7c-b2de-76abad2a6025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:05.110932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074063-1cd0-4a7c-b2de-76abad2a6025 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:05.111280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074063-1cd0-4a7c-b2de-76abad2a6025 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:05.111562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074063-1cd0-4a7c-b2de-76abad2a6025 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:05.126356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88074063-1cd0-4a7c-b2de-76abad2a6025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-88074063-1cd0-4a7c-b2de-76abad2a6025 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:05.135549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:05.136854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:05.137816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:05.141521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 196/390] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:29:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:05.150729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3026e53-006c-4066-bf4c-2f6481600b83 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:05.297890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3026e53-006c-4066-bf4c-2f6481600b83 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:05.317865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b1333-e0f2-4c91-8840-5ddc415685ef None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:05.318162 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b1333-e0f2-4c91-8840-5ddc415685ef None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:05.318441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b1333-e0f2-4c91-8840-5ddc415685ef None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:05.320518 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 197/391] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:05.325957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f8264-01a1-4864-83f1-4224442c670b None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:05.326247 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f8264-01a1-4864-83f1-4224442c670b None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:05.326532 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f8264-01a1-4864-83f1-4224442c670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:05.336534 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:05.337749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:05.338283 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:05.338873 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:05.340079 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:05.340616 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:05.342223 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:05.346253 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-a51f8264-01a1-4864-83f1-4224442c670b None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:05.347666 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a51f8264-01a1-4864-83f1-4224442c670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:05.350948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 195/392] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:05.357301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:05.467254 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058817e-fe14-43b3-b835-31d5dc9074a3 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:05.490563 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 198/393] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:05.502580 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e7503-2567-46bd-9118-2bc3b8b3d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:05.503448 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7503-2567-46bd-9118-2bc3b8b3d91b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:05.503733 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7503-2567-46bd-9118-2bc3b8b3d91b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:05.504038 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7503-2567-46bd-9118-2bc3b8b3d91b None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:05.505251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e7503-2567-46bd-9118-2bc3b8b3d91b None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:05.506678 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e7503-2567-46bd-9118-2bc3b8b3d91b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:05.508639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 196/394] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:05 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:05.517907 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f8264-01a1-4864-83f1-4224442c670b None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:05.518108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e7503-2567-46bd-9118-2bc3b8b3d91b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:05.626440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e7503-2567-46bd-9118-2bc3b8b3d91b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:05.697459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929cefc-665f-4367-b711-36b70f8ce9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:05.698291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929cefc-665f-4367-b711-36b70f8ce9ba None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:05.698566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929cefc-665f-4367-b711-36b70f8ce9ba None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:05.699004 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929cefc-665f-4367-b711-36b70f8ce9ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:05.720688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929cefc-665f-4367-b711-36b70f8ce9ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-a929cefc-665f-4367-b711-36b70f8ce9ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:05.729039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:05.730095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:05.731069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 197/395] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:29:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:05.736892 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929cefc-665f-4367-b711-36b70f8ce9ba None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:05.739472 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f8264-01a1-4864-83f1-4224442c670b None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:05.789473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659b4b2-0d52-4acc-974b-5127daa90a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:05.790360 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659b4b2-0d52-4acc-974b-5127daa90a2d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:05.791243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659b4b2-0d52-4acc-974b-5127daa90a2d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:05.791530 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659b4b2-0d52-4acc-974b-5127daa90a2d None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:05.792869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659b4b2-0d52-4acc-974b-5127daa90a2d None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:05.794391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659b4b2-0d52-4acc-974b-5127daa90a2d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:05.796601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 199/396] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:05 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:05.802012 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659b4b2-0d52-4acc-974b-5127daa90a2d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:05.930419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929cefc-665f-4367-b711-36b70f8ce9ba None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:06.001059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659b4b2-0d52-4acc-974b-5127daa90a2d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:06.003198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:06.003909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.004196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.004471 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.005241 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:06.005554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:06.006947 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:06.026951 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 198/397] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:06.032076 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:06.070272 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6dbf7-99d9-4eee-ba41-4bab6d6dadc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:06.071413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6dbf7-99d9-4eee-ba41-4bab6d6dadc6 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.071694 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6dbf7-99d9-4eee-ba41-4bab6d6dadc6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.073316 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6dbf7-99d9-4eee-ba41-4bab6d6dadc6 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/groups/39c9c694600e4b728e47b75bc586e4df/roles/7c610827438840438f3b3e90fac7c51c` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.079556 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6dbf7-99d9-4eee-ba41-4bab6d6dadc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=95f59159e6a94f0f993fbc3ee5a8d44f, group_id=39c9c694600e4b728e47b75bc586e4df, role_id=7c610827438840438f3b3e90fac7c51c)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:06.081131 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6dbf7-99d9-4eee-ba41-4bab6d6dadc6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:06.098186 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 200/398] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:29:05 2022] PUT /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/groups/39c9c694600e4b728e47b75bc586e4df/roles/7c610827438840438f3b3e90fac7c51c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:29:06.099526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf739a8-4b0b-472f-9dc2-615240389543 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.100291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf739a8-4b0b-472f-9dc2-615240389543 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.100580 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf739a8-4b0b-472f-9dc2-615240389543 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.102529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 201/399] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:06.107970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aca28-02b5-482c-8793-b37dfd6011c8 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.108285 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aca28-02b5-482c-8793-b37dfd6011c8 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.108556 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aca28-02b5-482c-8793-b37dfd6011c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.126943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-642aca28-02b5-482c-8793-b37dfd6011c8 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:06.128207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-642aca28-02b5-482c-8793-b37dfd6011c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:06.172223 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa27c4-88ee-41e5-94d1-ac9287731fdb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:06.199952 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 202/400] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:06.233069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85a2db-ec6a-4a38-be4f-cc7468384c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:06.233729 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aca28-02b5-482c-8793-b37dfd6011c8 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:06.233974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85a2db-ec6a-4a38-be4f-cc7468384c2f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.234244 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85a2db-ec6a-4a38-be4f-cc7468384c2f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.234527 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85a2db-ec6a-4a38-be4f-cc7468384c2f None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.236112 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85a2db-ec6a-4a38-be4f-cc7468384c2f None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:06.237661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85a2db-ec6a-4a38-be4f-cc7468384c2f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:06.239922 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 199/401] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:06 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:06.252872 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85a2db-ec6a-4a38-be4f-cc7468384c2f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:06.415436 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85a2db-ec6a-4a38-be4f-cc7468384c2f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:06.447969 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aca28-02b5-482c-8793-b37dfd6011c8 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:06.453192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3bc74-534e-4b1c-a30f-354e90a80a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:06.454456 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bc74-534e-4b1c-a30f-354e90a80a59 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.454971 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bc74-534e-4b1c-a30f-354e90a80a59 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.455474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3bc74-534e-4b1c-a30f-354e90a80a59 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.457772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3bc74-534e-4b1c-a30f-354e90a80a59 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:06.460120 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3bc74-534e-4b1c-a30f-354e90a80a59 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:06.463692 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 200/402] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:06 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:06.465237 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ad63-9af0-4e21-bfcd-4759486283b3 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.465669 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ad63-9af0-4e21-bfcd-4759486283b3 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.466104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0ad63-9af0-4e21-bfcd-4759486283b3 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.467778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 201/403] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:06.472686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0ad63-9af0-4e21-bfcd-4759486283b3 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:06.497921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90affb76-257d-4d13-a81a-1de4e3ec2aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:06.498790 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90affb76-257d-4d13-a81a-1de4e3ec2aba None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.499077 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90affb76-257d-4d13-a81a-1de4e3ec2aba None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.499353 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90affb76-257d-4d13-a81a-1de4e3ec2aba None admin] PATH_INFO: `/v3/roles/member` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.513471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90affb76-257d-4d13-a81a-1de4e3ec2aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-90affb76-257d-4d13-a81a-1de4e3ec2aba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:06.523356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:06.524458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:06.526076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 203/404] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:06.527450 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d6b9-8fc3-4af2-bf13-0e6e0c444c2a None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.527638 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d6b9-8fc3-4af2-bf13-0e6e0c444c2a None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.527923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d6b9-8fc3-4af2-bf13-0e6e0c444c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.549387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-fcc0d6b9-8fc3-4af2-bf13-0e6e0c444c2a None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:06.551041 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-fcc0d6b9-8fc3-4af2-bf13-0e6e0c444c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:06.602674 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0ad63-9af0-4e21-bfcd-4759486283b3 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:06.640567 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f4f7-e388-4b30-b895-2a6972c56c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:06.641455 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f4f7-e388-4b30-b895-2a6972c56c06 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.641734 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f4f7-e388-4b30-b895-2a6972c56c06 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.642006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f4f7-e388-4b30-b895-2a6972c56c06 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7/groups/39c9c694600e4b728e47b75bc586e4df/roles/7c610827438840438f3b3e90fac7c51c` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.647874 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f4f7-e388-4b30-b895-2a6972c56c06 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d5767bb2ca248d48c5820335e1738c7, group_id=39c9c694600e4b728e47b75bc586e4df, role_id=7c610827438840438f3b3e90fac7c51c)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:06.647874 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f4f7-e388-4b30-b895-2a6972c56c06 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:06.648310 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 204/405] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:06.652320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0d6b9-8fc3-4af2-bf13-0e6e0c444c2a None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:06.672056 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 202/406] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:29:06 2022] PUT /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7/groups/39c9c694600e4b728e47b75bc586e4df/roles/7c610827438840438f3b3e90fac7c51c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:06.674412 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f4f7-e388-4b30-b895-2a6972c56c06 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:06.791322 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0d6b9-8fc3-4af2-bf13-0e6e0c444c2a None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:06.841340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:06.842040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.842331 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.842654 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.843366 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] RBAC: Adding query filter params (name=member) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:06.843672 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:06.845125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:06.856179 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f4f7-e388-4b30-b895-2a6972c56c06 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:06.866137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 205/407] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:29:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:06.871979 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:06.900912 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927c2d-6fef-42cd-bc9b-b16ed79fcf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:06.902149 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927c2d-6fef-42cd-bc9b-b16ed79fcf4d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:06.902647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927c2d-6fef-42cd-bc9b-b16ed79fcf4d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:06.903136 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927c2d-6fef-42cd-bc9b-b16ed79fcf4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:06.924850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51927c2d-6fef-42cd-bc9b-b16ed79fcf4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-51927c2d-6fef-42cd-bc9b-b16ed79fcf4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:06.937671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:06.939252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:06.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:06.951290 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 203/408] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:06.962483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927c2d-6fef-42cd-bc9b-b16ed79fcf4d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:07.072723 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24384cd3-18b9-4bae-9db4-128f25e39868 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:07.119292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c956f-8ffa-4378-ae22-4f99cc2389c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:07.121015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c956f-8ffa-4378-ae22-4f99cc2389c9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.122133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c956f-8ffa-4378-ae22-4f99cc2389c9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.122431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c956f-8ffa-4378-ae22-4f99cc2389c9 None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.123874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c956f-8ffa-4378-ae22-4f99cc2389c9 None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:07.125337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c956f-8ffa-4378-ae22-4f99cc2389c9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:07.127167 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 206/409] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:06 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:07.133341 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927c2d-6fef-42cd-bc9b-b16ed79fcf4d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:07.136842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c956f-8ffa-4378-ae22-4f99cc2389c9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:07.199497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:07.200211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.200496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.200774 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.201541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:07.201850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:07.203228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:07.223675 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 204/410] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:07.230461 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:07.290283 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c956f-8ffa-4378-ae22-4f99cc2389c9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:07.329601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de343fe6-fd53-4512-a6d6-6cdda081c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:07.330383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343fe6-fd53-4512-a6d6-6cdda081c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.330659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343fe6-fd53-4512-a6d6-6cdda081c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.330928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343fe6-fd53-4512-a6d6-6cdda081c7d5 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.332863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de343fe6-fd53-4512-a6d6-6cdda081c7d5 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:07.334300 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de343fe6-fd53-4512-a6d6-6cdda081c7d5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:07.336033 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 207/411] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:07 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:07.342457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de343fe6-fd53-4512-a6d6-6cdda081c7d5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:07.438335 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b3724-4194-478a-b8ff-d6449dea3e3b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:07.517321 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23a093-3f11-4d87-aeda-164d3fe382dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:07.518245 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a093-3f11-4d87-aeda-164d3fe382dd None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.518867 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a093-3f11-4d87-aeda-164d3fe382dd None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.519147 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a093-3f11-4d87-aeda-164d3fe382dd None admin] PATH_INFO: `/v3/groups/31072592cece47c98418d3b42aea3da9` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.521302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23a093-3f11-4d87-aeda-164d3fe382dd None admin] RBAC: Authorizing `identity:get_group(group_id=31072592cece47c98418d3b42aea3da9)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:07.522749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23a093-3f11-4d87-aeda-164d3fe382dd None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:07.524411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 205/412] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:07 2022] GET /identity/v3/groups/31072592cece47c98418d3b42aea3da9 => generated 229 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:07.530959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23a093-3f11-4d87-aeda-164d3fe382dd None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:07.543069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de343fe6-fd53-4512-a6d6-6cdda081c7d5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:07.577749 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e80a8-e87f-4735-bb36-bce21646a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:07.578620 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e80a8-e87f-4735-bb36-bce21646a133 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.578899 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e80a8-e87f-4735-bb36-bce21646a133 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.579202 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e80a8-e87f-4735-bb36-bce21646a133 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/groups/39c9c694600e4b728e47b75bc586e4df/roles/68bfbd93f3e34ca58a58a2d237564990` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.586089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e80a8-e87f-4735-bb36-bce21646a133 None admin] RBAC: Authorizing `identity:create_grant(project_id=95f59159e6a94f0f993fbc3ee5a8d44f, group_id=39c9c694600e4b728e47b75bc586e4df, role_id=68bfbd93f3e34ca58a58a2d237564990)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:07.587503 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e80a8-e87f-4735-bb36-bce21646a133 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:07.611491 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 208/413] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:29:07 2022] PUT /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f/groups/39c9c694600e4b728e47b75bc586e4df/roles/68bfbd93f3e34ca58a58a2d237564990 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:29:07.693493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23a093-3f11-4d87-aeda-164d3fe382dd None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:07.703241 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861820-4be8-498b-bfad-1ea68f74280b None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.703567 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861820-4be8-498b-bfad-1ea68f74280b None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.703798 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861820-4be8-498b-bfad-1ea68f74280b None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.705192 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 209/414] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:07.713918 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1658293-5b97-484d-9cf4-055ed96af0cd None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.714279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1658293-5b97-484d-9cf4-055ed96af0cd None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.714647 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1658293-5b97-484d-9cf4-055ed96af0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.738204 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-c1658293-5b97-484d-9cf4-055ed96af0cd None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:07.739450 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-c1658293-5b97-484d-9cf4-055ed96af0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:07.779977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b991720-c40f-47af-88d0-4e2179d62a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:07.780926 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b991720-c40f-47af-88d0-4e2179d62a02 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.781204 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b991720-c40f-47af-88d0-4e2179d62a02 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.781477 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b991720-c40f-47af-88d0-4e2179d62a02 None admin] PATH_INFO: `/v3/projects/4feddf1938a742ebac431fd3312cccc1` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.784308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b991720-c40f-47af-88d0-4e2179d62a02 None admin] RBAC: Authorizing `identity:get_project(project_id=4feddf1938a742ebac431fd3312cccc1)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:07.785846 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b991720-c40f-47af-88d0-4e2179d62a02 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:07.791441 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 206/415] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:07 2022] GET /identity/v3/projects/4feddf1938a742ebac431fd3312cccc1 => generated 344 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:07.797975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b991720-c40f-47af-88d0-4e2179d62a02 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:07.862292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 210/416] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:07.886650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1658293-5b97-484d-9cf4-055ed96af0cd None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:07.927497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b991720-c40f-47af-88d0-4e2179d62a02 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:07.964136 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf49e90-4335-4ed2-8ed2-fe4299d65fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:07.965053 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49e90-4335-4ed2-8ed2-fe4299d65fbe None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:07.965297 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49e90-4335-4ed2-8ed2-fe4299d65fbe None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:07.965575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf49e90-4335-4ed2-8ed2-fe4299d65fbe None admin] PATH_INFO: `/v3/projects/4feddf1938a742ebac431fd3312cccc1/groups/31072592cece47c98418d3b42aea3da9/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:07.968309 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf49e90-4335-4ed2-8ed2-fe4299d65fbe None admin] RBAC: Authorizing `identity:create_grant(project_id=4feddf1938a742ebac431fd3312cccc1, group_id=31072592cece47c98418d3b42aea3da9, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:07.969771 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf49e90-4335-4ed2-8ed2-fe4299d65fbe None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:07.994833 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 207/417] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:29:07 2022] PUT /identity/v3/projects/4feddf1938a742ebac431fd3312cccc1/groups/31072592cece47c98418d3b42aea3da9/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:08.003806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1658293-5b97-484d-9cf4-055ed96af0cd None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:08.044373 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c0798-d48d-4b4e-9675-9ec59c33ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:08.045186 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c0798-d48d-4b4e-9675-9ec59c33ab35 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:08.045527 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c0798-d48d-4b4e-9675-9ec59c33ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:08.045805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c0798-d48d-4b4e-9675-9ec59c33ab35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:08.058562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c0798-d48d-4b4e-9675-9ec59c33ab35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-758c0798-d48d-4b4e-9675-9ec59c33ab35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:08.067020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:08.069371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:08.071565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 211/418] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:08.079928 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf49e90-4335-4ed2-8ed2-fe4299d65fbe None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:08.218298 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf49e90-4335-4ed2-8ed2-fe4299d65fbe None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:08.266827 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:08.267516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:08.267824 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:08.268109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:08.268886 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] RBAC: Adding query filter params (name=member) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:08.269198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:08.270579 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:08.285131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 208/419] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:29:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:08.289355 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c0798-d48d-4b4e-9675-9ec59c33ab35 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:08.433493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c0798-d48d-4b4e-9675-9ec59c33ab35 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:08.474910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4d768-5232-4338-bfa1-af885e6f75aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:08.475502 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4d768-5232-4338-bfa1-af885e6f75aa None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:08.475801 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4d768-5232-4338-bfa1-af885e6f75aa None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:08.476095 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4d768-5232-4338-bfa1-af885e6f75aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:08.583908 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4d768-5232-4338-bfa1-af885e6f75aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:08.585422 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4d768-5232-4338-bfa1-af885e6f75aa None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:08.721479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 212/420] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:08.726772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:08.777630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1c9a-bc1e-4615-8777-85c282e38d99 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:08.777986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1c9a-bc1e-4615-8777-85c282e38d99 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:08.778189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1c9a-bc1e-4615-8777-85c282e38d99 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:08.779702 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 213/421] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:08.787053 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704975c2-cc44-4155-9891-3a27fe26ad70 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:08.787053 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704975c2-cc44-4155-9891-3a27fe26ad70 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:08.787053 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704975c2-cc44-4155-9891-3a27fe26ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:08.804078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-704975c2-cc44-4155-9891-3a27fe26ad70 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:08.805617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-704975c2-cc44-4155-9891-3a27fe26ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:08.876329 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 214/422] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:08.883785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43864f-953d-45cc-b3c4-b6d4cf945234 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:08.901267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704975c2-cc44-4155-9891-3a27fe26ad70 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:08.941657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6e7f-1619-453b-9e9a-828fd5608731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:08.942538 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6e7f-1619-453b-9e9a-828fd5608731 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:08.942818 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6e7f-1619-453b-9e9a-828fd5608731 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:08.943295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6e7f-1619-453b-9e9a-828fd5608731 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:08.944735 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc6e7f-1619-453b-9e9a-828fd5608731 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:08.947603 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc6e7f-1619-453b-9e9a-828fd5608731 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:08.950282 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 209/423] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:08 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:08.955487 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6e7f-1619-453b-9e9a-828fd5608731 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:09.008404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704975c2-cc44-4155-9891-3a27fe26ad70 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:09.044728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b067e-e285-4f17-a4f2-110cc58969ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:09.045956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b067e-e285-4f17-a4f2-110cc58969ee None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.046460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b067e-e285-4f17-a4f2-110cc58969ee None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.046946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b067e-e285-4f17-a4f2-110cc58969ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.058019 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b067e-e285-4f17-a4f2-110cc58969ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:09.064122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6e7f-1619-453b-9e9a-828fd5608731 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-3e8b067e-e285-4f17-a4f2-110cc58969ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:09.067420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:09.068451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:09.069479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:09.072675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 215/424] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:29:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:09.078582 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b067e-e285-4f17-a4f2-110cc58969ee None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:09.104552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b29ea-2107-44ed-bf06-51bf9078d153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:09.105416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b29ea-2107-44ed-bf06-51bf9078d153 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.105694 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b29ea-2107-44ed-bf06-51bf9078d153 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.105968 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b29ea-2107-44ed-bf06-51bf9078d153 None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.107428 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b29ea-2107-44ed-bf06-51bf9078d153 None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:09.109236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b29ea-2107-44ed-bf06-51bf9078d153 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:09.111647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 210/425] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:08 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:09.120739 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b29ea-2107-44ed-bf06-51bf9078d153 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:09.273214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b29ea-2107-44ed-bf06-51bf9078d153 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:09.302129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b067e-e285-4f17-a4f2-110cc58969ee None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:09.320130 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:09.321202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.321839 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.322535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.323711 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] RBAC: Adding query filter params (group.id=39c9c694600e4b728e47b75bc586e4df, role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=3d5767bb2ca248d48c5820335e1738c7) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:09.324331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:09.326074 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:09.336756 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 211/426] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:09 2022] GET /identity/v3/role_assignments?group.id=39c9c694600e4b728e47b75bc586e4df&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 611 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:09.381879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d835e-feb8-48dd-97d6-cba8a20d4b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:09.382593 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d835e-feb8-48dd-97d6-cba8a20d4b4f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.382878 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d835e-feb8-48dd-97d6-cba8a20d4b4f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.383158 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d835e-feb8-48dd-97d6-cba8a20d4b4f None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.383996 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d835e-feb8-48dd-97d6-cba8a20d4b4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:09.384489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d835e-feb8-48dd-97d6-cba8a20d4b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:09.385948 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d835e-feb8-48dd-97d6-cba8a20d4b4f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:09.403229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 216/427] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:09.408803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:09.521708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cb12-77e6-4ef8-b849-bbb47933a889 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.521952 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cb12-77e6-4ef8-b849-bbb47933a889 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.522187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cb12-77e6-4ef8-b849-bbb47933a889 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.523932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 217/428] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:09.534338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce887d-d57e-4be3-9ce6-c44f5338527e None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.534654 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce887d-d57e-4be3-9ce6-c44f5338527e None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.534897 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce887d-d57e-4be3-9ce6-c44f5338527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.564270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56fbcd-2307-447a-be6e-59244c6f49f3 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:09.565589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-b2ce887d-d57e-4be3-9ce6-c44f5338527e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:09.566793 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-b2ce887d-d57e-4be3-9ce6-c44f5338527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:09.609283 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f646a-ab63-41a0-a2bc-c05fe2c8e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:09.609951 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f646a-ab63-41a0-a2bc-c05fe2c8e494 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.610239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f646a-ab63-41a0-a2bc-c05fe2c8e494 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.610521 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f646a-ab63-41a0-a2bc-c05fe2c8e494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.668416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 218/429] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:09.693234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce887d-d57e-4be3-9ce6-c44f5338527e None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:09.698693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f646a-ab63-41a0-a2bc-c05fe2c8e494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:09.700507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f646a-ab63-41a0-a2bc-c05fe2c8e494 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:09.801662 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce887d-d57e-4be3-9ce6-c44f5338527e None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:09.804221 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 212/430] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:09.810111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f646a-ab63-41a0-a2bc-c05fe2c8e494 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:09.840246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e873f66-ac0a-4d3e-8da3-336b42669266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:09.841117 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873f66-ac0a-4d3e-8da3-336b42669266 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.841347 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873f66-ac0a-4d3e-8da3-336b42669266 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.841621 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e873f66-ac0a-4d3e-8da3-336b42669266 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.852276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e873f66-ac0a-4d3e-8da3-336b42669266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-3e873f66-ac0a-4d3e-8da3-336b42669266 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:09.861405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:09.862726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:09.863971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:09.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 219/431] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:29:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:09.869708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e873f66-ac0a-4d3e-8da3-336b42669266 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:09.921789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f646a-ab63-41a0-a2bc-c05fe2c8e494 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:09.960661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c4e8a-4570-4606-8cde-6d5e2515b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:09.961781 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c4e8a-4570-4606-8cde-6d5e2515b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:09.962789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c4e8a-4570-4606-8cde-6d5e2515b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:09.963363 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c4e8a-4570-4606-8cde-6d5e2515b9d3 None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:09.965081 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c4e8a-4570-4606-8cde-6d5e2515b9d3 None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:09.966724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c4e8a-4570-4606-8cde-6d5e2515b9d3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:09.968957 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 213/432] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:09 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:09.974551 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c4e8a-4570-4606-8cde-6d5e2515b9d3 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:09.975078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e873f66-ac0a-4d3e-8da3-336b42669266 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:10.012606 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:10.013289 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.013573 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.013855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.014686 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:10.014996 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:10.017157 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:10.026998 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 220/433] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:10.032709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:10.085898 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c4e8a-4570-4606-8cde-6d5e2515b9d3 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:10.124324 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd38910-e0c3-4b50-8164-721cfef4fdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:10.125586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd38910-e0c3-4b50-8164-721cfef4fdb1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.125949 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd38910-e0c3-4b50-8164-721cfef4fdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.126301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd38910-e0c3-4b50-8164-721cfef4fdb1 None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.128050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd38910-e0c3-4b50-8164-721cfef4fdb1 None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:10.129600 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd38910-e0c3-4b50-8164-721cfef4fdb1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:10.132173 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 214/434] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:09 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:10.139972 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd38910-e0c3-4b50-8164-721cfef4fdb1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:10.147782 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101959c0-d791-4c36-adf8-103efdd9e7a3 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:10.184047 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d21b9-e28d-44e5-800e-5625ff665dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:10.185065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d21b9-e28d-44e5-800e-5625ff665dc9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.185552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d21b9-e28d-44e5-800e-5625ff665dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.186032 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d21b9-e28d-44e5-800e-5625ff665dc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.250342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd38910-e0c3-4b50-8164-721cfef4fdb1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:10.257872 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d21b9-e28d-44e5-800e-5625ff665dc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:10.260311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d21b9-e28d-44e5-800e-5625ff665dc9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:10.296673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:10.297403 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.297690 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.298346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.299533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] RBAC: Adding query filter params (group.id=39c9c694600e4b728e47b75bc586e4df, role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:10.299895 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:10.302137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:10.320189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 215/435] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:10 2022] GET /identity/v3/role_assignments?group.id=39c9c694600e4b728e47b75bc586e4df&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=7c610827438840438f3b3e90fac7c51c => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:10.389112 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 221/436] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:10.394966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:10.522537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb96e1-94a0-44e8-90e6-54db4eefa38a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:10.560932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312be74-e5da-4bcd-99ab-82c597455e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:10.561805 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312be74-e5da-4bcd-99ab-82c597455e18 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.562087 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312be74-e5da-4bcd-99ab-82c597455e18 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.562363 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312be74-e5da-4bcd-99ab-82c597455e18 None admin] PATH_INFO: `/v3/projects/3d5767bb2ca248d48c5820335e1738c7` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.563598 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312be74-e5da-4bcd-99ab-82c597455e18 None admin] RBAC: Authorizing `identity:get_project(project_id=3d5767bb2ca248d48c5820335e1738c7)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:10.565344 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312be74-e5da-4bcd-99ab-82c597455e18 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:10.567381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 216/437] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:10 2022] GET /identity/v3/projects/3d5767bb2ca248d48c5820335e1738c7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:10.572812 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d21b9-e28d-44e5-800e-5625ff665dc9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:10.602251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda80f-d587-42ed-b7da-c95f5134fa2c None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.602617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda80f-d587-42ed-b7da-c95f5134fa2c None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.602811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda80f-d587-42ed-b7da-c95f5134fa2c None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.605506 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 217/438] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:10.610774 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdde9-01e8-4e59-a231-fccb0dbfee8c None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.611063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdde9-01e8-4e59-a231-fccb0dbfee8c None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.611342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bdde9-01e8-4e59-a231-fccb0dbfee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.631345 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-8b5bdde9-01e8-4e59-a231-fccb0dbfee8c None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:10.633080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-8b5bdde9-01e8-4e59-a231-fccb0dbfee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:10.687238 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d21b9-e28d-44e5-800e-5625ff665dc9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:10.711921 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 218/439] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:10.724933 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd96088-4632-41fa-840d-4c03410b0f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:10.725894 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd96088-4632-41fa-840d-4c03410b0f4c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.726245 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd96088-4632-41fa-840d-4c03410b0f4c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.726592 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd96088-4632-41fa-840d-4c03410b0f4c None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.728594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd96088-4632-41fa-840d-4c03410b0f4c None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:10.730275 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd96088-4632-41fa-840d-4c03410b0f4c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:10.731990 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bdde9-01e8-4e59-a231-fccb0dbfee8c None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:10.732513 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 222/440] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:10 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:10.738309 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd96088-4632-41fa-840d-4c03410b0f4c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:10.832443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bdde9-01e8-4e59-a231-fccb0dbfee8c None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:10.849658 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd96088-4632-41fa-840d-4c03410b0f4c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:10.868116 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3ffd-e484-4c43-84dc-df0e12420912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:10.868995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3ffd-e484-4c43-84dc-df0e12420912 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.869271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3ffd-e484-4c43-84dc-df0e12420912 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.869540 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3ffd-e484-4c43-84dc-df0e12420912 None admin] PATH_INFO: `/v3/roles/member` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.879994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b3ffd-e484-4c43-84dc-df0e12420912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:10.885557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a436d2-9f77-400f-827b-feb5735a5813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:10.886206 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a436d2-9f77-400f-827b-feb5735a5813 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.886494 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a436d2-9f77-400f-827b-feb5735a5813 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.886772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a436d2-9f77-400f-827b-feb5735a5813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.887601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a436d2-9f77-400f-827b-feb5735a5813 None admin] RBAC: Adding query filter params (group.id=39c9c694600e4b728e47b75bc586e4df, role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=3d5767bb2ca248d48c5820335e1738c7) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-ec6b3ffd-e484-4c43-84dc-df0e12420912 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:10.887754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:10.888987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:29:10.895256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:10.896313 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a436d2-9f77-400f-827b-feb5735a5813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:10.896404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 219/441] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:10.896487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a436d2-9f77-400f-827b-feb5735a5813 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:10.896570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0ceb9-9082-486b-a9df-442d1e8ba385 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.896570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0ceb9-9082-486b-a9df-442d1e8ba385 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.896570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0ceb9-9082-486b-a9df-442d1e8ba385 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.896570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 220/442] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:10.896866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 223/443] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:10 2022] GET /identity/v3/role_assignments?group.id=39c9c694600e4b728e47b75bc586e4df&scope.project.id=3d5767bb2ca248d48c5820335e1738c7&role.id=7c610827438840438f3b3e90fac7c51c => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:10.896944 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0ceb9-9082-486b-a9df-442d1e8ba385 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:10.909443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cdd9a-7800-4c18-a2f0-32774019e310 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:10.909763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cdd9a-7800-4c18-a2f0-32774019e310 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:10.910016 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cdd9a-7800-4c18-a2f0-32774019e310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:10.929586 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-be0cdd9a-7800-4c18-a2f0-32774019e310 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:10.931369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-be0cdd9a-7800-4c18-a2f0-32774019e310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:11.019875 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 224/444] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:11.020106 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0ceb9-9082-486b-a9df-442d1e8ba385 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.032274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cdd9a-7800-4c18-a2f0-32774019e310 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.044144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.044847 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.045245 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.045529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.046309 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] RBAC: Adding query filter params (name=member) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:11.046623 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.048065 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.058569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 221/445] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:29:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:11.064118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.146739 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cdd9a-7800-4c18-a2f0-32774019e310 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.184802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0c8b9-79cc-4d8b-86cf-120cfbfa7a34 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.189152 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a269a-9ae0-48ca-b4aa-72a89f92731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.190215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a269a-9ae0-48ca-b4aa-72a89f92731e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.190507 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a269a-9ae0-48ca-b4aa-72a89f92731e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.190766 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a269a-9ae0-48ca-b4aa-72a89f92731e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.203291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a269a-9ae0-48ca-b4aa-72a89f92731e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-157a269a-9ae0-48ca-b4aa-72a89f92731e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:11.212270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:11.214631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:11.215600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 225/446] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:11.221250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a269a-9ae0-48ca-b4aa-72a89f92731e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.226882 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cd7e-f9cc-462f-a67d-b8199183dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.227554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cd7e-f9cc-462f-a67d-b8199183dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.228563 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cd7e-f9cc-462f-a67d-b8199183dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.228857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cd7e-f9cc-462f-a67d-b8199183dbc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.308051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cd7e-f9cc-462f-a67d-b8199183dbc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.309443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cd7e-f9cc-462f-a67d-b8199183dbc5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.333371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a269a-9ae0-48ca-b4aa-72a89f92731e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.365642 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.366303 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.366589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.366866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.367616 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:11.367961 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.369751 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.380802 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 226/447] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:11.386883 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.408513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 222/448] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:29:11.414074 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cd7e-f9cc-462f-a67d-b8199183dbc5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.482786 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ff00-2e59-4990-8341-8160de64afd7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.508863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cd7e-f9cc-462f-a67d-b8199183dbc5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.520295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92845747-20bd-4694-b1a3-5cd557f6c6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.520961 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845747-20bd-4694-b1a3-5cd557f6c6d0 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.521251 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845747-20bd-4694-b1a3-5cd557f6c6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.521526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845747-20bd-4694-b1a3-5cd557f6c6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.543707 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb202-3247-4b2d-aa24-b6f3f91dd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.544634 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb202-3247-4b2d-aa24-b6f3f91dd99c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.544917 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb202-3247-4b2d-aa24-b6f3f91dd99c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.545195 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb202-3247-4b2d-aa24-b6f3f91dd99c None admin] PATH_INFO: `/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.546444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb202-3247-4b2d-aa24-b6f3f91dd99c None admin] RBAC: Authorizing `identity:get_project(project_id=95f59159e6a94f0f993fbc3ee5a8d44f)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.547905 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb202-3247-4b2d-aa24-b6f3f91dd99c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.549610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 223/449] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/projects/95f59159e6a94f0f993fbc3ee5a8d44f => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:11.555172 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb202-3247-4b2d-aa24-b6f3f91dd99c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.590741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845747-20bd-4694-b1a3-5cd557f6c6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.592174 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845747-20bd-4694-b1a3-5cd557f6c6d0 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.653736 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb202-3247-4b2d-aa24-b6f3f91dd99c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.686068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c56a-cc46-4392-a94b-1bbc30285b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.686915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c56a-cc46-4392-a94b-1bbc30285b6c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.687192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c56a-cc46-4392-a94b-1bbc30285b6c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.687463 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c56a-cc46-4392-a94b-1bbc30285b6c None admin] PATH_INFO: `/v3/groups/39c9c694600e4b728e47b75bc586e4df` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.687718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 227/450] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:29:11.688684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82c56a-cc46-4392-a94b-1bbc30285b6c None admin] RBAC: Authorizing `identity:get_group(group_id=39c9c694600e4b728e47b75bc586e4df)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.690487 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82c56a-cc46-4392-a94b-1bbc30285b6c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.692133 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 224/451] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/groups/39c9c694600e4b728e47b75bc586e4df => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:11.697990 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c56a-cc46-4392-a94b-1bbc30285b6c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.698664 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92845747-20bd-4694-b1a3-5cd557f6c6d0 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.791547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92845747-20bd-4694-b1a3-5cd557f6c6d0 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.794295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c56a-cc46-4392-a94b-1bbc30285b6c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.825759 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6fd29-9244-4789-800e-42b3c7476cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.826629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6fd29-9244-4789-800e-42b3c7476cbb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.826903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6fd29-9244-4789-800e-42b3c7476cbb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.827175 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6fd29-9244-4789-800e-42b3c7476cbb None admin] PATH_INFO: `/v3/projects/4feddf1938a742ebac431fd3312cccc1` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.828371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6fd29-9244-4789-800e-42b3c7476cbb None admin] RBAC: Authorizing `identity:get_project(project_id=4feddf1938a742ebac431fd3312cccc1)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.829236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.829806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6fd29-9244-4789-800e-42b3c7476cbb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.829907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.830148 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.830422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.831252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] RBAC: Adding query filter params (group.id=39c9c694600e4b728e47b75bc586e4df, role.id=68bfbd93f3e34ca58a58a2d237564990, scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:11.831640 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 228/452] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/projects/4feddf1938a742ebac431fd3312cccc1 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:11.831756 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.832990 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.836807 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6fd29-9244-4789-800e-42b3c7476cbb None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:11.851880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 225/453] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/role_assignments?group.id=39c9c694600e4b728e47b75bc586e4df&scope.project.id=95f59159e6a94f0f993fbc3ee5a8d44f&role.id=68bfbd93f3e34ca58a58a2d237564990 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:11.947825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6fd29-9244-4789-800e-42b3c7476cbb None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:11.982425 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bc5b3-0734-44ba-a61a-f88d21bdf86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:11.983297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bc5b3-0734-44ba-a61a-f88d21bdf86c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:11.983577 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bc5b3-0734-44ba-a61a-f88d21bdf86c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:11.983877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bc5b3-0734-44ba-a61a-f88d21bdf86c None admin] PATH_INFO: `/v3/groups/31072592cece47c98418d3b42aea3da9` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:11.985134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bc5b3-0734-44ba-a61a-f88d21bdf86c None admin] RBAC: Authorizing `identity:get_group(group_id=31072592cece47c98418d3b42aea3da9)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:11.986608 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bc5b3-0734-44ba-a61a-f88d21bdf86c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:11.988301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 229/454] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/groups/31072592cece47c98418d3b42aea3da9 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:11.994974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:12.097426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3b108-d257-49ef-81a0-584ee1e7c6ed None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:12.131292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eacc43-9f45-42f4-915b-00c8937c75a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:12.131909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eacc43-9f45-42f4-915b-00c8937c75a5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:12.132201 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eacc43-9f45-42f4-915b-00c8937c75a5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:12.132484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eacc43-9f45-42f4-915b-00c8937c75a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:12.133332 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eacc43-9f45-42f4-915b-00c8937c75a5 None admin] RBAC: Adding query filter params (group.id=31072592cece47c98418d3b42aea3da9, role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=4feddf1938a742ebac431fd3312cccc1) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:12.133667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eacc43-9f45-42f4-915b-00c8937c75a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:12.135675 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eacc43-9f45-42f4-915b-00c8937c75a5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:12.141619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 226/455] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:29:11 2022] GET /identity/v3/role_assignments?group.id=31072592cece47c98418d3b42aea3da9&scope.project.id=4feddf1938a742ebac431fd3312cccc1&role.id=8cf832105b2949f6b11e06b208146326 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:14.969822 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd350a50-391f-4c35-b94e-e6340d62746a None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:14.970378 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd350a50-391f-4c35-b94e-e6340d62746a None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:14.970378 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd350a50-391f-4c35-b94e-e6340d62746a None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:14.972093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 230/456] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:14.985941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979c82d-b779-4232-9216-409337a65cd7 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:14.986505 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979c82d-b779-4232-9216-409337a65cd7 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:14.986904 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979c82d-b779-4232-9216-409337a65cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.013068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-b979c82d-b779-4232-9216-409337a65cd7 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:15.014290 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-b979c82d-b779-4232-9216-409337a65cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:15.102441 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 227/457] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:15.147139 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd350a50-391f-4c35-b94e-e6340d62746a None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:15.157667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e95c-236d-442a-a042-2df8e78b5b53 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.158012 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e95c-236d-442a-a042-2df8e78b5b53 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.158235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e95c-236d-442a-a042-2df8e78b5b53 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.159911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 228/458] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:15.172572 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0ddc-29bd-4830-83b0-6ec2903eed7f None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.172917 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0ddc-29bd-4830-83b0-6ec2903eed7f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.173133 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb0ddc-29bd-4830-83b0-6ec2903eed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.204986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-abcb0ddc-29bd-4830-83b0-6ec2903eed7f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:15.206205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-abcb0ddc-29bd-4830-83b0-6ec2903eed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:15.297582 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd350a50-391f-4c35-b94e-e6340d62746a None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:15.335888 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 229/459] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:15.340943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f127b-90f3-456c-a9b7-df69a9ee4c5f None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.341452 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f127b-90f3-456c-a9b7-df69a9ee4c5f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.341890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f127b-90f3-456c-a9b7-df69a9ee4c5f None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.343662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 230/460] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:15.353004 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d60d-8ecc-4b14-a313-1eb80e2c5b02 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.353936 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d60d-8ecc-4b14-a313-1eb80e2c5b02 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.354886 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d60d-8ecc-4b14-a313-1eb80e2c5b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.358782 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:15.360082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.360609 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.361970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.379569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-8ed2d60d-8ecc-4b14-a313-1eb80e2c5b02 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:15.380805 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-8ed2d60d-8ecc-4b14-a313-1eb80e2c5b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:15.384752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:15.386043 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:15.404791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:15.405846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:15.407514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:15.407514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:15.407514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:15.407514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:15.407514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 231/461] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:15.407514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:15.458106 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 231/462] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:15.464727 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2d60d-8ecc-4b14-a313-1eb80e2c5b02 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:15.515881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a2141-2118-4619-b769-32730b56d0ac None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:15.551994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:15.553183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.553648 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.554093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.566088 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:15.567879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:15.588411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:15.589544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:15.590546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:15.590546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:15.590546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:15.590546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:15.597636 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2d60d-8ecc-4b14-a313-1eb80e2c5b02 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:15.598081 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 232/463] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:15.599302 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:15.631743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:15.632451 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.632738 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.633019 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.633765 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:15.634577 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:15.636008 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:15.648022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 232/464] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:15.648664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:15.709578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8e429-4ff3-4170-a905-fa2a3f0fc676 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:15.745943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:15.747128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.747636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.748186 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.752193 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610736-f5b3-4b0e-b504-6295c6b86f7b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:15.766967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:15.766967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:15.785490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:15.786546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:15.787549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:15.787549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:15.787549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:15.787549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:15.787549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 233/465] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:15.787549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:15.792565 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad21a6-719e-4524-878e-8d836e3745e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:15.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad21a6-719e-4524-878e-8d836e3745e2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.793533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad21a6-719e-4524-878e-8d836e3745e2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.793809 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad21a6-719e-4524-878e-8d836e3745e2 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.794552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad21a6-719e-4524-878e-8d836e3745e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:15.794860 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad21a6-719e-4524-878e-8d836e3745e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:15.796287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad21a6-719e-4524-878e-8d836e3745e2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:15.808279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 233/466] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:15.809493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f207b2-8bd8-41ed-8ac6-6b6e2244b2cd None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.809779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f207b2-8bd8-41ed-8ac6-6b6e2244b2cd None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.810055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f207b2-8bd8-41ed-8ac6-6b6e2244b2cd None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.811429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 234/467] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:15.812448 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f207b2-8bd8-41ed-8ac6-6b6e2244b2cd None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:15.893273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c24a7-f090-4cc7-aa83-32c8e513327f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:15.930029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237baf-1263-436c-be16-e83ca425fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:15.930274 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f207b2-8bd8-41ed-8ac6-6b6e2244b2cd None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:15.930708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237baf-1263-436c-be16-e83ca425fd6c None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.931852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237baf-1263-436c-be16-e83ca425fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.931978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237baf-1263-436c-be16-e83ca425fd6c None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.932637 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237baf-1263-436c-be16-e83ca425fd6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:15.934099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237baf-1263-436c-be16-e83ca425fd6c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:15.956268 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 234/468] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:29:15 2022] POST /identity/v3/users => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:29:15.957413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237baf-1263-436c-be16-e83ca425fd6c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:15.984747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688ac0c-7ce3-4ae6-a683-7fbaaf88728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:15.985478 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688ac0c-7ce3-4ae6-a683-7fbaaf88728f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:15.985825 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688ac0c-7ce3-4ae6-a683-7fbaaf88728f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:15.986109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688ac0c-7ce3-4ae6-a683-7fbaaf88728f None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:15.987271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688ac0c-7ce3-4ae6-a683-7fbaaf88728f None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:15.987585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688ac0c-7ce3-4ae6-a683-7fbaaf88728f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:15.989243 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688ac0c-7ce3-4ae6-a683-7fbaaf88728f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:16.002675 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 235/469] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:16.003747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95eb0-1ba2-4d17-9254-11a41c82b764 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.004114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95eb0-1ba2-4d17-9254-11a41c82b764 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.004397 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d95eb0-1ba2-4d17-9254-11a41c82b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.023191 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-63d95eb0-1ba2-4d17-9254-11a41c82b764 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:16.024513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-63d95eb0-1ba2-4d17-9254-11a41c82b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:16.078660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237baf-1263-436c-be16-e83ca425fd6c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:16.106449 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 236/470] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:16.107217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d95eb0-1ba2-4d17-9254-11a41c82b764 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:16.126352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7956889-090c-4da5-88ee-c80ae2437f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:16.127928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7956889-090c-4da5-88ee-c80ae2437f24 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.128525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7956889-090c-4da5-88ee-c80ae2437f24 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.128980 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7956889-090c-4da5-88ee-c80ae2437f24 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.130067 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7956889-090c-4da5-88ee-c80ae2437f24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:16.131930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7956889-090c-4da5-88ee-c80ae2437f24 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:16.153622 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 235/471] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:29:15 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:29:16.155184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c43eae-65a7-47bc-9325-a1e122402470 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.155572 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c43eae-65a7-47bc-9325-a1e122402470 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.155851 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c43eae-65a7-47bc-9325-a1e122402470 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.159856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 236/472] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:16.159856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c43eae-65a7-47bc-9325-a1e122402470 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:16.240615 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d95eb0-1ba2-4d17-9254-11a41c82b764 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:16.285969 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38018d-d702-4a17-b0d9-25f0dd220b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:16.287223 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38018d-d702-4a17-b0d9-25f0dd220b2b None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.287801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38018d-d702-4a17-b0d9-25f0dd220b2b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.288315 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38018d-d702-4a17-b0d9-25f0dd220b2b None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.289299 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38018d-d702-4a17-b0d9-25f0dd220b2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:16.291178 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38018d-d702-4a17-b0d9-25f0dd220b2b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:16.297671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c43eae-65a7-47bc-9325-a1e122402470 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:16.316958 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 237/473] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:29:16 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:29:16.324346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b0bd-2948-4df5-859f-79b7bbc458db None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.325134 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b0bd-2948-4df5-859f-79b7bbc458db None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.325650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b0bd-2948-4df5-859f-79b7bbc458db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.340498 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:16.341221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.341547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.341838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.354631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:16.356203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:16.361080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-f522b0bd-2948-4df5-859f-79b7bbc458db None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:16.362319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-f522b0bd-2948-4df5-859f-79b7bbc458db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:16.390215 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:16.391473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:16.392541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:16.392541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:16.392541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:16.392541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:16.396222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 237/474] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:16.398084 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:16.483797 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 238/475] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:16.504517 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522b0bd-2948-4df5-859f-79b7bbc458db None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:16.540043 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bdf83-f552-44d2-ba4b-095f8e59434b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:16.587588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:16.588717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.589003 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.589838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.590904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:16.591171 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:16.593536 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:16.617733 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 238/476] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:16.626046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:16.630736 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522b0bd-2948-4df5-859f-79b7bbc458db None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:16.670907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:16.672005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.672521 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.673027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.674011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:16.675689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:16.684909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.sql.core [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:29:16.684909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:29:16.684909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [parameters: {'id': '55664be744f24d67aacfcb1fa12db2bd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:29:16.684909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=206370) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application conn.query(q) May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result.read() May 09 15:29:16.707709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return ref.to_dict() May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:29:16.708811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application next(self.gen) May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application yield resource May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application next(self.gen) May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise self.value May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application session.commit() May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:29:16.709933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.session.flush() May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application compat.raise_( May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:29:16.711667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:29:16.715211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application conn.query(q) May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result.read() May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:29:16.717440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [parameters: {'id': '55664be744f24d67aacfcb1fa12db2bd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:16.720464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:29:16.723236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:16.733181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 239/477] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:29:16 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:16.738214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:16.747258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad0a54-9b55-4d4b-a985-48aab142b2f9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:16.783647 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762545ba-f01b-4ac3-8e13-a12d7479755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:16.784391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762545ba-f01b-4ac3-8e13-a12d7479755d None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.784744 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762545ba-f01b-4ac3-8e13-a12d7479755d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.784951 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762545ba-f01b-4ac3-8e13-a12d7479755d None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.785660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762545ba-f01b-4ac3-8e13-a12d7479755d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:16.787114 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762545ba-f01b-4ac3-8e13-a12d7479755d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:16.814238 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 239/478] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:29:16 2022] POST /identity/v3/users => generated 249 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:29:16.910865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64da9e7-027f-4e07-b4f0-fd1286415b35 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:16.966373 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1695f9-7037-44f8-94d6-517b41c86a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:16.967220 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1695f9-7037-44f8-94d6-517b41c86a08 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:16.967504 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1695f9-7037-44f8-94d6-517b41c86a08 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:16.967791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1695f9-7037-44f8-94d6-517b41c86a08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:16.987446 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1695f9-7037-44f8-94d6-517b41c86a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-ac1695f9-7037-44f8-94d6-517b41c86a08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:16.996777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:16.998096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:16.999330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 240/479] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:29:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:17.006632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762545ba-f01b-4ac3-8e13-a12d7479755d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:17.136625 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762545ba-f01b-4ac3-8e13-a12d7479755d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:17.178445 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdea7a-f165-48d8-8fc8-d7327e21b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:17.179054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdea7a-f165-48d8-8fc8-d7327e21b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:17.179336 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdea7a-f165-48d8-8fc8-d7327e21b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:17.179611 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdea7a-f165-48d8-8fc8-d7327e21b7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:17.180406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdea7a-f165-48d8-8fc8-d7327e21b7a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:17.180715 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdea7a-f165-48d8-8fc8-d7327e21b7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:17.182147 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdea7a-f165-48d8-8fc8-d7327e21b7a1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:17.191365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 240/480] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:18.735113 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fa2-5156-47a4-93c3-da2d11db3961 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:18.735747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fa2-5156-47a4-93c3-da2d11db3961 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:18.735747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d39fa2-5156-47a4-93c3-da2d11db3961 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:18.737404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 241/481] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:18.742435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e10c5-e254-4911-bdea-611b9dbb24e5 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:18.742922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e10c5-e254-4911-bdea-611b9dbb24e5 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:18.743102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e10c5-e254-4911-bdea-611b9dbb24e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:18.768795 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-2c1e10c5-e254-4911-bdea-611b9dbb24e5 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:18.770029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-2c1e10c5-e254-4911-bdea-611b9dbb24e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:18.852593 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 241/482] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:18.888844 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39fa2-5156-47a4-93c3-da2d11db3961 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.028581 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d39fa2-5156-47a4-93c3-da2d11db3961 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.075368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6c255-610c-4a22-99b4-48f2bcf9f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.076215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6c255-610c-4a22-99b4-48f2bcf9f35a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.076500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6c255-610c-4a22-99b4-48f2bcf9f35a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.076779 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6c255-610c-4a22-99b4-48f2bcf9f35a None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.091390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6c255-610c-4a22-99b4-48f2bcf9f35a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-dbd6c255-610c-4a22-99b4-48f2bcf9f35a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:19.099247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:19.100306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:19.101246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 242/483] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:19.108870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e10c5-e254-4911-bdea-611b9dbb24e5 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.119528 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5578-79a8-4ab4-9873-87f365f2ee12 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.119738 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5578-79a8-4ab4-9873-87f365f2ee12 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.120066 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e5578-79a8-4ab4-9873-87f365f2ee12 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.121674 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 243/484] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:19.127033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84b21-8dda-4b11-9cfd-2ef1f0c9d973 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.127320 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84b21-8dda-4b11-9cfd-2ef1f0c9d973 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.127600 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84b21-8dda-4b11-9cfd-2ef1f0c9d973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.160798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-d9b84b21-8dda-4b11-9cfd-2ef1f0c9d973 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:19.162009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-d9b84b21-8dda-4b11-9cfd-2ef1f0c9d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:19.214658 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e10c5-e254-4911-bdea-611b9dbb24e5 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.251049 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.252122 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.252618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.253103 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.254087 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:19.254646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:19.256274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:19.264145 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 244/485] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:19.265420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 242/486] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:19.271277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d403-83a4-4a43-a43b-bc3f1e4cf20d None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.271277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d403-83a4-4a43-a43b-bc3f1e4cf20d None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.271277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d403-83a4-4a43-a43b-bc3f1e4cf20d None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.271558 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 245/487] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:19.272674 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.281216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c771b-d3ec-4ece-90a0-853888c785c6 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.281462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c771b-d3ec-4ece-90a0-853888c785c6 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.281725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c771b-d3ec-4ece-90a0-853888c785c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.300144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-ba1c771b-d3ec-4ece-90a0-853888c785c6 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:19.301335 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-ba1c771b-d3ec-4ece-90a0-853888c785c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:19.370443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 246/488] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:19.371383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c771b-d3ec-4ece-90a0-853888c785c6 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.375987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f32da-24d5-445c-a76a-581fae3e9269 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.411456 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.412651 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.413165 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.413674 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.425461 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:19.427216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:19.445388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:19.446932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:19.448166 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:19.448166 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:19.448166 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:19.448166 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:19.450535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 243/489] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:19.451548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.480777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c771b-d3ec-4ece-90a0-853888c785c6 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.518133 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389155-39c4-4df1-9954-ac353c0190f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.518947 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389155-39c4-4df1-9954-ac353c0190f6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.519235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389155-39c4-4df1-9954-ac353c0190f6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.519517 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389155-39c4-4df1-9954-ac353c0190f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.530324 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2389155-39c4-4df1-9954-ac353c0190f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-a2389155-39c4-4df1-9954-ac353c0190f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:19.540028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:19.541687 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:19.542627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:19.549938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 247/490] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:19.551041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389155-39c4-4df1-9954-ac353c0190f6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.557559 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee362008-8088-4aeb-b93b-68036eec05b4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.593305 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ba947-e226-4fa6-a06d-4b2608c87501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.594508 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba947-e226-4fa6-a06d-4b2608c87501 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.594999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba947-e226-4fa6-a06d-4b2608c87501 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.595477 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba947-e226-4fa6-a06d-4b2608c87501 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.606313 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ba947-e226-4fa6-a06d-4b2608c87501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-6a7ba947-e226-4fa6-a06d-4b2608c87501 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:19.614351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:19.615387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:19.616363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:19.619141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 244/491] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:19.620196 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ba947-e226-4fa6-a06d-4b2608c87501 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.659310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389155-39c4-4df1-9954-ac353c0190f6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.697922 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.698608 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.698893 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.699171 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.699944 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:19.700255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:19.701720 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:19.720155 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 248/492] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:19.721146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.730870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ba947-e226-4fa6-a06d-4b2608c87501 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.766384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.767929 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.768441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.768928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.769923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:19.770454 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:19.772079 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:19.781736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 245/493] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:19.782844 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.832293 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7804cc-f1bc-424e-b043-aff1065f6b9d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.867312 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.868126 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.869023 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.869309 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.870074 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:19.870382 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:19.871758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:19.880016 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 249/494] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:19.881095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.890655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77d56c-4d41-4349-a045-8343de0f0736 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:19.929877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0939d2-5593-4a2b-ad13-7dc2d6a81873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:19.931103 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0939d2-5593-4a2b-ad13-7dc2d6a81873 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.931580 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0939d2-5593-4a2b-ad13-7dc2d6a81873 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.932069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0939d2-5593-4a2b-ad13-7dc2d6a81873 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.939689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0939d2-5593-4a2b-ad13-7dc2d6a81873 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:19.941626 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0939d2-5593-4a2b-ad13-7dc2d6a81873 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-6a0939d2-5593-4a2b-ad13-7dc2d6a81873 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:19.957562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:19.958714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:19.959946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 246/495] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:19.960656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1c95-d055-4dbe-9e2d-df27b5d9a257 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:19.960656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1c95-d055-4dbe-9e2d-df27b5d9a257 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:19.960790 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1c95-d055-4dbe-9e2d-df27b5d9a257 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:19.962633 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 247/496] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:19.967643 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d1c95-d055-4dbe-9e2d-df27b5d9a257 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:19.989456 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd61c6-8320-4bee-8dc4-08e9a7544451 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.026653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.027494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.027817 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.028099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.038737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.040811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:20.058343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:20.059349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:20.060739 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:20.060739 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:20.060739 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:20.060739 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:20.060739 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 250/497] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:20.060739 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.083355 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d1c95-d055-4dbe-9e2d-df27b5d9a257 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.121554 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc22c37-d3b1-4d17-b6d2-651b5e524f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.122514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22c37-d3b1-4d17-b6d2-651b5e524f11 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.122797 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22c37-d3b1-4d17-b6d2-651b5e524f11 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.123371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc22c37-d3b1-4d17-b6d2-651b5e524f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.137112 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc22c37-d3b1-4d17-b6d2-651b5e524f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.138588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc22c37-d3b1-4d17-b6d2-651b5e524f11 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-bfc22c37-d3b1-4d17-b6d2-651b5e524f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:20.156525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:20.157610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:20.158588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:20.158588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:20.158588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:20.158588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:20.158588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 248/498] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:20.159345 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9a1e4-c065-440b-b8b1-ace904b56a1b None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.159345 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9a1e4-c065-440b-b8b1-ace904b56a1b None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.159528 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9a1e4-c065-440b-b8b1-ace904b56a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.167622 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbfbc1-49ab-406f-9758-f1bf32e7989f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.175881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-2af9a1e4-c065-440b-b8b1-ace904b56a1b None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:20.177087 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-2af9a1e4-c065-440b-b8b1-ace904b56a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:20.201704 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.202375 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.202659 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.202940 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.203804 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:20.204118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.205554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.242323 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 249/499] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:20.248209 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 251/500] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:20.248372 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9a1e4-c065-440b-b8b1-ace904b56a1b None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.248489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.344521 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef39435-cd54-44d7-869f-4c67d22e501b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.345938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9a1e4-c065-440b-b8b1-ace904b56a1b None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.378028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9cbcc-500c-4420-8e7c-361b658e82aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.378702 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9cbcc-500c-4420-8e7c-361b658e82aa None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.378897 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.379027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9cbcc-500c-4420-8e7c-361b658e82aa None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.379246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9cbcc-500c-4420-8e7c-361b658e82aa None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.379563 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.379883 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.380028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9cbcc-500c-4420-8e7c-361b658e82aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:20.380146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.380315 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9cbcc-500c-4420-8e7c-361b658e82aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.380884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:20.381195 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.381698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9cbcc-500c-4420-8e7c-361b658e82aa None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.382564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.393557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 252/501] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:20.398609 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 250/502] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:20.398786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41d11-f39c-4fa5-9338-8ba76e976473 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.398898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.398993 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41d11-f39c-4fa5-9338-8ba76e976473 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.398993 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41d11-f39c-4fa5-9338-8ba76e976473 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.398993 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 253/503] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:20.398993 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e41d11-f39c-4fa5-9338-8ba76e976473 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.496907 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373598f0-2585-493a-8f64-39881312d5e2 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.497153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e41d11-f39c-4fa5-9338-8ba76e976473 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.529998 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0c86-1ce0-4001-bb1c-4b274716ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.530787 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0c86-1ce0-4001-bb1c-4b274716ec93 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.531065 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0c86-1ce0-4001-bb1c-4b274716ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.531335 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0c86-1ce0-4001-bb1c-4b274716ec93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.537814 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a520ef2-20f8-435a-a8b5-c51fc7dfda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.538462 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a520ef2-20f8-435a-a8b5-c51fc7dfda3c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.538749 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a520ef2-20f8-435a-a8b5-c51fc7dfda3c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.539037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a520ef2-20f8-435a-a8b5-c51fc7dfda3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.542023 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a0c86-1ce0-4001-bb1c-4b274716ec93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-225a0c86-1ce0-4001-bb1c-4b274716ec93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:20.549778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:20.550815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 254/504] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:20.557467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0c86-1ce0-4001-bb1c-4b274716ec93 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.606289 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a520ef2-20f8-435a-a8b5-c51fc7dfda3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.607694 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a520ef2-20f8-435a-a8b5-c51fc7dfda3c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.652144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0c86-1ce0-4001-bb1c-4b274716ec93 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.685165 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcc875-987c-4d0e-8e97-1a0a8c6cc7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.685949 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc875-987c-4d0e-8e97-1a0a8c6cc7f0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.686243 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc875-987c-4d0e-8e97-1a0a8c6cc7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.686519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcc875-987c-4d0e-8e97-1a0a8c6cc7f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.694226 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc875-987c-4d0e-8e97-1a0a8c6cc7f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.695664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcc875-987c-4d0e-8e97-1a0a8c6cc7f0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.703113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 251/505] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:20.703971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a520ef2-20f8-435a-a8b5-c51fc7dfda3c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-ccdcc875-987c-4d0e-8e97-1a0a8c6cc7f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:20.711863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:20.713488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 255/506] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:20.714524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22287-93b5-4aeb-a6e0-b5f36a16f53a None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.715257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22287-93b5-4aeb-a6e0-b5f36a16f53a None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.715257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec22287-93b5-4aeb-a6e0-b5f36a16f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.732562 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-0ec22287-93b5-4aeb-a6e0-b5f36a16f53a None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:20.733768 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-0ec22287-93b5-4aeb-a6e0-b5f36a16f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:20.800191 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 256/507] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:20.801045 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec22287-93b5-4aeb-a6e0-b5f36a16f53a None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.809898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a520ef2-20f8-435a-a8b5-c51fc7dfda3c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.843735 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.844560 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.844842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.845117 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.852128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.854193 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:20.868578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:20.869890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 252/508] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:20.870959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.897244 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec22287-93b5-4aeb-a6e0-b5f36a16f53a None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:20.931786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:20.932567 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:20.932854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:20.933135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:20.933898 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:20.934210 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:20.935602 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:20.943639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 257/509] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:20.944493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:20.972084 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ea9d2-81a1-423a-88f9-647ea35a0e88 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.005636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.006422 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.006704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.006975 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.016874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.018323 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:21.035566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:21.036774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:21.037789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:21.037789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:21.037789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:21.037789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:21.037789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 253/510] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:21.037789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.041211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4efdc-876b-48d5-8837-2f0b3d147c29 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.074153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.074822 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.075102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.075375 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.076261 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:21.076572 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.078014 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.094556 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 258/511] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:29:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:21.095346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.134936 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab164676-b6d4-4b2f-9c04-1865689ea3b5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.168402 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.169184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.169470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.169746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.179512 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.181282 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.191935 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37b5c1-4e04-44c7-8c31-1203024ea38e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:21.200185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:21.209898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:21.211903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:21.211903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:21.211903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:21.211903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:21.211903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 254/512] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:21.211903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.230955 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.231621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.233157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.233157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.233157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:21.233427 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.234765 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.251881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 259/513] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:21.256716 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.300003 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc02b63-7edd-48cc-81a9-7d731275804d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.333532 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.334325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.334608 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.334884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.344720 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.346203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.350513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275378c8-4cf1-4d0e-93de-f3a864df758c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:21.363393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:21.364465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:21.365482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:21.365482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:21.365482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:21.365482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:21.365482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 255/514] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:21.365482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.391651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.392283 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.392561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.392830 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.393546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:21.393847 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.395202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.407216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 260/515] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:21.408058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.467323 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc3d9f-98ee-47e9-ba79-96977760b264 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.500181 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1c56d-4710-4634-bb26-a65539f44cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.500827 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c56d-4710-4634-bb26-a65539f44cbc None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.501112 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c56d-4710-4634-bb26-a65539f44cbc None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.501391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c56d-4710-4634-bb26-a65539f44cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.503982 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22020783-0e96-4b4a-a505-a11157510377 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.536373 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.537030 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.537311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.537585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.538306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:21.538610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.540006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.552722 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 261/516] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:21.553763 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.567294 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1c56d-4710-4634-bb26-a65539f44cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.568783 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1c56d-4710-4634-bb26-a65539f44cbc None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.650283 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8c4b7-640b-43ca-bce6-19a28b49035f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.663055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 256/517] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:21.663914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1c56d-4710-4634-bb26-a65539f44cbc None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.684671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6846b-4efa-4561-84d1-9fcbdc1df75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.685322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6846b-4efa-4561-84d1-9fcbdc1df75a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.685613 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6846b-4efa-4561-84d1-9fcbdc1df75a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.685888 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6846b-4efa-4561-84d1-9fcbdc1df75a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.750447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6846b-4efa-4561-84d1-9fcbdc1df75a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.751942 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6846b-4efa-4561-84d1-9fcbdc1df75a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.763052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1c56d-4710-4634-bb26-a65539f44cbc None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.795523 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.796216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.796493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.796762 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.797475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:21.797774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.799144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.810751 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 257/518] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:21.811621 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.848629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 262/519] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:21.849451 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6846b-4efa-4561-84d1-9fcbdc1df75a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.907636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd72a8-d186-4f92-a872-da319e4b1b96 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.939699 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.940777 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.941061 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.941337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.943671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6846b-4efa-4561-84d1-9fcbdc1df75a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:21.949105 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.950582 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:21.965726 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:21.966910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 258/520] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:21.967953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:21.977549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293d315-9863-4c81-97df-6be7ef0df939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:21.978367 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d315-9863-4c81-97df-6be7ef0df939 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:21.978645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d315-9863-4c81-97df-6be7ef0df939 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:21.978919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293d315-9863-4c81-97df-6be7ef0df939 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:21.979625 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293d315-9863-4c81-97df-6be7ef0df939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:21.981088 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293d315-9863-4c81-97df-6be7ef0df939 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.000865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 263/521] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:29:21 2022] POST /identity/v3/users => generated 247 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:29:22.001657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293d315-9863-4c81-97df-6be7ef0df939 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.076864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87e0a-3e19-4226-b41f-7e061396e205 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.111681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293d315-9863-4c81-97df-6be7ef0df939 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.113621 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.114444 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.114727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.115006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.128311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.129947 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:22.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:22.150416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:22.152541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:22.152541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:22.152541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:22.152541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:22.152808 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.152808 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.152808 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.152808 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.155718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 259/522] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:22.156700 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.161974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.163369 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:22.178962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:22.180137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 264/523] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:22.182430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.264856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945ca5e-1f50-4f56-af11-0d97f1bc6fd5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.292441 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2dd6-115a-4978-a1f4-ddb0f257cd0a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.299700 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.300530 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.300814 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.301090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.312135 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.313601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.328271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.329067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.329452 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.329830 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.330725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:22.331156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.332733 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:22.332884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:22.333982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:22.340212 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:22.340212 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:22.340212 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:22.340212 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:22.340212 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 260/524] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:22.340212 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.355249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 265/525] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:22.356162 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.446068 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2638a3-a17a-4c65-ae7d-e4e00470ea7c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.464943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faa6ff-cdd2-43ec-89e4-e2e4736e2a61 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.479891 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.480564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.480836 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.481116 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.481845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:22.482153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.483552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.495716 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 261/526] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:22.496561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.504821 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.505504 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.505784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.506059 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.506914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:22.507275 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.508762 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.528756 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 266/527] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:22.529692 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.602461 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559cae7-0c14-4abd-be82-1fe392c91733 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.633267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52d36b-f167-469d-ac32-0dc981a4fa05 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.638290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.638964 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.639246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.639520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.640284 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:22.640591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.642403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.664108 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 262/528] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:22.664108 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.668984 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.669648 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.669931 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.670207 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.671050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=4be3545ab61f47aab2897c713fcc1c85) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:22.671365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.672836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.688205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 267/529] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/role_assignments?user.id=4be3545ab61f47aab2897c713fcc1c85&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:22.688205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.770777 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f78ad-1e61-4906-9460-9cc4bfd47fc3 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.803255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317729b-cd51-49ab-afae-d94fad7781ef None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.808873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.809692 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.809974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.810249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.818299 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.819793 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:22.835183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:22.836334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 263/530] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:22.837930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:22.850552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de3398-1b29-467b-9c38-a9399c2271eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.850552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de3398-1b29-467b-9c38-a9399c2271eb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.850552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de3398-1b29-467b-9c38-a9399c2271eb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.851368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de3398-1b29-467b-9c38-a9399c2271eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.927246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de3398-1b29-467b-9c38-a9399c2271eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.928763 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de3398-1b29-467b-9c38-a9399c2271eb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:22.945104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6ef00-caef-457b-8dc6-5871cb4e247f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:22.981503 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:22.982301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:22.982577 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:22.982845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:22.990142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:22.991578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:23.006200 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:23.007232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 264/531] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:23.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:23.043527 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 268/532] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:23.044402 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de3398-1b29-467b-9c38-a9399c2271eb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:23.110607 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d0cf-f2fa-4621-bb31-3d3cbe5c277c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:23.146555 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de3398-1b29-467b-9c38-a9399c2271eb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:23.147290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:23.148087 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:23.148468 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:23.148838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:23.150536 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:23.150946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:23.152514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.170777 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 265/533] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:23.171576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:23.183968 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:23.184653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:23.184941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:23.185218 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:23.186051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:23.186363 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:23.187887 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.205995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 269/534] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:23.206876 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:23.280397 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41bec5-accb-4e61-a2cc-582a6e7dbf7d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:23.323654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c9787-66dc-43a3-b808-b426f1ebe0e6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:23.324565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:23.325469 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:23.325846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:23.326217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:23.340125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:23.341735 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.363055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:23.363865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:23.364198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:23.364479 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:23.365394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=18b014c40d954881b8fa19f9e1d9b09a) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:23.365703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:23.366849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:23.368100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:23.368100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:23.368100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:23.368100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:23.369174 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:23.369174 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.371517 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 266/535] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:23.371656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:23.379869 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 270/536] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/role_assignments?user.id=18b014c40d954881b8fa19f9e1d9b09a&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:23.380802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:23.509951 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2cd61-2540-401b-83b8-b64c27afa12d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:23.537938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf42f-b3ab-4351-9792-c653bc0b56ca None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:23.550391 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:23.551102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:23.551386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:23.551661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:23.552443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:23.552753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:23.554140 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.572985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 271/537] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:23.578684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:23.610828 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:23.611552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:23.611870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:23.612144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:23.613059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=2243309aa6e34df780759918f87ae043) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:23.613369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:23.614892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.633435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 267/538] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/role_assignments?user.id=2243309aa6e34df780759918f87ae043&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:23.695582 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb34e8a-00bc-452a-aa92-57efa620622d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:23.734222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:23.735035 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:23.735318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:23.735592 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:23.744067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:23.745535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:23.761792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:23.764063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:23.766296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 272/539] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:23.771880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:23.878609 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c80d6-52c5-4ff0-9b71-62178e5275da None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:23.913350 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bbdd4-8741-451d-9ba5-b0d39975489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:23.914024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bbdd4-8741-451d-9ba5-b0d39975489b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:23.914311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bbdd4-8741-451d-9ba5-b0d39975489b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:23.914592 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bbdd4-8741-451d-9ba5-b0d39975489b None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:23.915961 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bbdd4-8741-451d-9ba5-b0d39975489b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:23.916279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bbdd4-8741-451d-9ba5-b0d39975489b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:23.917742 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bbdd4-8741-451d-9ba5-b0d39975489b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:23.930632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 268/540] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:23.937052 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:24.047110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd73f9f-1fbb-46ff-974e-a395998574d0 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:24.082579 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d6762-0cfb-4457-a6fa-a2e08b3d9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:24.083241 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d6762-0cfb-4457-a6fa-a2e08b3d9162 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:24.083534 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d6762-0cfb-4457-a6fa-a2e08b3d9162 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:24.083796 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d6762-0cfb-4457-a6fa-a2e08b3d9162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:24.084657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d6762-0cfb-4457-a6fa-a2e08b3d9162 None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=ff6dfa76a7a14d09a88235482b3e68d8) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:24.084969 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d6762-0cfb-4457-a6fa-a2e08b3d9162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:24.086410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d6762-0cfb-4457-a6fa-a2e08b3d9162 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:24.093523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 273/541] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:23 2022] GET /identity/v3/role_assignments?user.id=ff6dfa76a7a14d09a88235482b3e68d8&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:24.513453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad95e-a257-4a3e-b374-ccab3b21d7a9 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:24.513842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad95e-a257-4a3e-b374-ccab3b21d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:24.514023 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad95e-a257-4a3e-b374-ccab3b21d7a9 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:24.515656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 269/542] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:24.521118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1fb75-2b57-4715-be17-30ad0c43f273 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:24.521411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1fb75-2b57-4715-be17-30ad0c43f273 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:24.521696 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1fb75-2b57-4715-be17-30ad0c43f273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:24.548083 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-c4f1fb75-2b57-4715-be17-30ad0c43f273 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:24.549309 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-c4f1fb75-2b57-4715-be17-30ad0c43f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:24.643210 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 274/543] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:24.679225 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cad95e-a257-4a3e-b374-ccab3b21d7a9 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:24.798937 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cad95e-a257-4a3e-b374-ccab3b21d7a9 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:24.840456 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2330-1013-4585-b0e9-530854ba82c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:24.841657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2330-1013-4585-b0e9-530854ba82c7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:24.842178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2330-1013-4585-b0e9-530854ba82c7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:24.842656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2330-1013-4585-b0e9-530854ba82c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:24.856649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef2330-1013-4585-b0e9-530854ba82c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-1cef2330-1013-4585-b0e9-530854ba82c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:24.864671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:24.865709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:24.866653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:24.869765 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 270/544] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:24.875895 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1fb75-2b57-4715-be17-30ad0c43f273 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:25.001461 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1fb75-2b57-4715-be17-30ad0c43f273 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:25.043457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7218b9f-882f-4fdc-b30e-086f177089cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:25.044166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218b9f-882f-4fdc-b30e-086f177089cf None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:25.044453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218b9f-882f-4fdc-b30e-086f177089cf None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:25.044733 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7218b9f-882f-4fdc-b30e-086f177089cf None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:25.045494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7218b9f-882f-4fdc-b30e-086f177089cf None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:25.045802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7218b9f-882f-4fdc-b30e-086f177089cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:25.047189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7218b9f-882f-4fdc-b30e-086f177089cf None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:25.056264 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 275/545] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:25.064813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2330-1013-4585-b0e9-530854ba82c7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:25.122677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1e14a-9482-4836-8b41-4bc175b2dc21 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:25.123030 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1e14a-9482-4836-8b41-4bc175b2dc21 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:25.123239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1e14a-9482-4836-8b41-4bc175b2dc21 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:25.125658 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 276/546] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:25.131065 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba2c7e-4ef5-441c-bf8e-c80f92896e7e None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:25.131434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba2c7e-4ef5-441c-bf8e-c80f92896e7e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:25.131751 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba2c7e-4ef5-441c-bf8e-c80f92896e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:25.167631 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-c1ba2c7e-4ef5-441c-bf8e-c80f92896e7e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:25.170418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-c1ba2c7e-4ef5-441c-bf8e-c80f92896e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:25.242974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2330-1013-4585-b0e9-530854ba82c7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:25.285545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:25.286724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:25.288138 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:25.288974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:25.305198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 277/547] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:25.310893 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:25.312673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:25.328212 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba2c7e-4ef5-441c-bf8e-c80f92896e7e None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:25.339675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:25.340892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:25.342096 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:25.342096 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:25.342096 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:25.342096 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:25.342804 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 271/548] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:25.349030 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:25.498879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49207-7d60-416c-8c6e-74477fb9a03f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:25.536380 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:25.536961 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:25.537630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:25.538112 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:25.539028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:25.539523 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:25.541486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:25.560085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 272/549] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:25.563208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:25.568104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba2c7e-4ef5-441c-bf8e-c80f92896e7e None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:25.660494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20840-4c0a-4520-9f7f-fddd111ec642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:25.661349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20840-4c0a-4520-9f7f-fddd111ec642 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:25.661635 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20840-4c0a-4520-9f7f-fddd111ec642 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:25.661912 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20840-4c0a-4520-9f7f-fddd111ec642 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:25.676596 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028f3b6-7006-49ed-bbd3-4f2d07cfc8a5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:25.692676 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad20840-4c0a-4520-9f7f-fddd111ec642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-2ad20840-4c0a-4520-9f7f-fddd111ec642 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:25.708383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:25.709450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:25.715143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 278/550] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:25.721074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:25.722153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:25.722658 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:25.723151 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:25.732822 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20840-4c0a-4520-9f7f-fddd111ec642 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:25.733578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:25.735376 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:25.753486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:25.754631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:25.755787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:25.763914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 273/551] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:25.765828 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:25.870247 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d97c0f-1962-435f-b05f-bf54ee41adc6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:25.934743 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:25.936475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:25.937135 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:25.939467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:25.940950 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:25.941285 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20840-4c0a-4520-9f7f-fddd111ec642 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:25.943552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:25.945341 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.009484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:26.010775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.011868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.012395 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.013364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:26.013882 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:26.015463 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.027789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 274/552] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:29:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:26.029062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 279/553] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:26.035119 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:26.036541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:26.151362 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72196abe-0192-4d6e-be59-83a28234eaf6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:26.190890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6adf7-7229-4b8f-9bbc-e4c65db0f56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:26.191967 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6adf7-7229-4b8f-9bbc-e4c65db0f56a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.192478 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6adf7-7229-4b8f-9bbc-e4c65db0f56a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.192966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6adf7-7229-4b8f-9bbc-e4c65db0f56a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.231439 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e1a68-7667-4e72-93ca-97bbefa896d9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:26.274002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6adf7-7229-4b8f-9bbc-e4c65db0f56a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:26.276497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6adf7-7229-4b8f-9bbc-e4c65db0f56a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.281664 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:26.282505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.282789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.283064 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.306313 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:26.307952 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:26.340712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:26.341852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:26.343362 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:26.343362 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:26.343362 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:26.343362 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:26.343362 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 275/554] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:26.348650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:26.431165 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 280/555] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:26.436858 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6adf7-7229-4b8f-9bbc-e4c65db0f56a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:26.471655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9445fab-2014-47c1-91fe-d777e2426463 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:26.517964 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a042c0-79c5-4e49-8497-d2671ca5035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:26.518819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a042c0-79c5-4e49-8497-d2671ca5035a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.519202 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a042c0-79c5-4e49-8497-d2671ca5035a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.519578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a042c0-79c5-4e49-8497-d2671ca5035a None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.520548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a042c0-79c5-4e49-8497-d2671ca5035a None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:26.520969 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a042c0-79c5-4e49-8497-d2671ca5035a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:26.522454 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a042c0-79c5-4e49-8497-d2671ca5035a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.556141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 276/556] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:26.561866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde11c-5f06-46f4-a0ca-1e9fa5ea20f3 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.562292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde11c-5f06-46f4-a0ca-1e9fa5ea20f3 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.562673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bde11c-5f06-46f4-a0ca-1e9fa5ea20f3 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.564503 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 277/557] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:26.565627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bde11c-5f06-46f4-a0ca-1e9fa5ea20f3 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:26.597635 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6adf7-7229-4b8f-9bbc-e4c65db0f56a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:26.633694 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58938e13-5404-4e22-bebe-3318c5ab9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:26.635443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938e13-5404-4e22-bebe-3318c5ab9d9d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.635738 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938e13-5404-4e22-bebe-3318c5ab9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.636056 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938e13-5404-4e22-bebe-3318c5ab9d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.646346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58938e13-5404-4e22-bebe-3318c5ab9d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:26.647843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58938e13-5404-4e22-bebe-3318c5ab9d9d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-58938e13-5404-4e22-bebe-3318c5ab9d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:26.665778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:26.666820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:26.667929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:26.667929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:26.667929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:26.667929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:26.667929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 281/558] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:26.668250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473499-9d9b-41fb-b412-4c2ffbf5452f None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.668778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473499-9d9b-41fb-b412-4c2ffbf5452f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.668778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5473499-9d9b-41fb-b412-4c2ffbf5452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.687296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bde11c-5f06-46f4-a0ca-1e9fa5ea20f3 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:26.687698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-d5473499-9d9b-41fb-b412-4c2ffbf5452f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:26.688938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-d5473499-9d9b-41fb-b412-4c2ffbf5452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:26.722699 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39296a6-4962-45cd-abe7-8d877297617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:26.723460 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39296a6-4962-45cd-abe7-8d877297617d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.723746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39296a6-4962-45cd-abe7-8d877297617d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.724054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39296a6-4962-45cd-abe7-8d877297617d None admin] PATH_INFO: `/v3/users/nova` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.732052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39296a6-4962-45cd-abe7-8d877297617d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:26.733518 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39296a6-4962-45cd-abe7-8d877297617d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-f39296a6-4962-45cd-abe7-8d877297617d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:26.752706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:26.753994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 278/559] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:29:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:26.755688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f1328-2a5a-4424-9fa4-866fccac8865 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.756509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f1328-2a5a-4424-9fa4-866fccac8865 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.756509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f1328-2a5a-4424-9fa4-866fccac8865 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.761983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 279/560] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:26.761983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f1328-2a5a-4424-9fa4-866fccac8865 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:26.768897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 282/561] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:26.776911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5473499-9d9b-41fb-b412-4c2ffbf5452f None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:26.870746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f1328-2a5a-4424-9fa4-866fccac8865 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:26.887394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5473499-9d9b-41fb-b412-4c2ffbf5452f None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:26.905679 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f1e3f-e75b-4cd4-9b60-9d8c2d469ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:26.906351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1e3f-e75b-4cd4-9b60-9d8c2d469ff8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.906633 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1e3f-e75b-4cd4-9b60-9d8c2d469ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.906930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f1e3f-e75b-4cd4-9b60-9d8c2d469ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.907638 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f1e3f-e75b-4cd4-9b60-9d8c2d469ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:26.907972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f1e3f-e75b-4cd4-9b60-9d8c2d469ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:26.909346 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f1e3f-e75b-4cd4-9b60-9d8c2d469ff8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.921517 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 280/562] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:26.922721 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7dcf3-3f6b-471d-8874-94375c0283c7 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.923015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7dcf3-3f6b-471d-8874-94375c0283c7 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.923294 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7dcf3-3f6b-471d-8874-94375c0283c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.933037 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:26.934019 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:26.934500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:26.935376 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:26.936768 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:26.937295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:26.938984 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:26.940419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-4ac7dcf3-3f6b-471d-8874-94375c0283c7 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:26.941630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-4ac7dcf3-3f6b-471d-8874-94375c0283c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:26.964519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 283/563] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:29:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:26.964519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.015529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 281/564] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:27.016541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7dcf3-3f6b-471d-8874-94375c0283c7 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.066775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cdf1-990d-4b53-87a6-b99201f33be8 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.100870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e869-e7ab-489d-80d2-730ff9ebad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.101665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e869-e7ab-489d-80d2-730ff9ebad32 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.101944 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e869-e7ab-489d-80d2-730ff9ebad32 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.102220 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1e869-e7ab-489d-80d2-730ff9ebad32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.112709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1e869-e7ab-489d-80d2-730ff9ebad32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:27.112944 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7dcf3-3f6b-471d-8874-94375c0283c7 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-98c1e869-e7ab-489d-80d2-730ff9ebad32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:27.121098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:27.122488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:27.123880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:27.127164 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 284/565] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:27.127948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e869-e7ab-489d-80d2-730ff9ebad32 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.147542 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd16c-e868-4e3b-bc25-2a68610fb360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.148379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd16c-e868-4e3b-bc25-2a68610fb360 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.148665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd16c-e868-4e3b-bc25-2a68610fb360 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.148943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd16c-e868-4e3b-bc25-2a68610fb360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.156927 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd16c-e868-4e3b-bc25-2a68610fb360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.158379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd16c-e868-4e3b-bc25-2a68610fb360 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-a1ecd16c-e868-4e3b-bc25-2a68610fb360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:27.172649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:27.173816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 282/566] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:27.175093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b42a14-bfe0-4e4d-9e67-0dbecfcc99c9 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.175916 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b42a14-bfe0-4e4d-9e67-0dbecfcc99c9 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.175916 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b42a14-bfe0-4e4d-9e67-0dbecfcc99c9 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.177039 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 283/567] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:27.179806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b42a14-bfe0-4e4d-9e67-0dbecfcc99c9 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.235106 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1e869-e7ab-489d-80d2-730ff9ebad32 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.266569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.267355 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.267634 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.267937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.278772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b42a14-bfe0-4e4d-9e67-0dbecfcc99c9 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.279451 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.282524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:27.299749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:27.305686 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:27.307343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:27.307343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:27.307343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:27.307343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:27.307343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 285/568] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:27.307343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.313229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd944f63-5bdc-4731-b637-a27f4a77163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.314034 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944f63-5bdc-4731-b637-a27f4a77163d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.314317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944f63-5bdc-4731-b637-a27f4a77163d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.314593 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944f63-5bdc-4731-b637-a27f4a77163d None admin] PATH_INFO: `/v3/roles/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.325081 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd944f63-5bdc-4731-b637-a27f4a77163d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-dd944f63-5bdc-4731-b637-a27f4a77163d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:27.332879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:27.334104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 284/569] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:27.340809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd944f63-5bdc-4731-b637-a27f4a77163d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.412516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c246b5-7695-42e8-b8c4-71052c140d78 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.433556 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd944f63-5bdc-4731-b637-a27f4a77163d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.444668 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086ea4f-5dc7-467f-b2ed-dce45e9345af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.445334 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ea4f-5dc7-467f-b2ed-dce45e9345af None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.445616 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ea4f-5dc7-467f-b2ed-dce45e9345af None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.445890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ea4f-5dc7-467f-b2ed-dce45e9345af None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.446640 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086ea4f-5dc7-467f-b2ed-dce45e9345af None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:27.446945 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086ea4f-5dc7-467f-b2ed-dce45e9345af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.448350 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086ea4f-5dc7-467f-b2ed-dce45e9345af None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:27.456265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 286/570] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:27.457490 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed127-e749-42de-b99d-dc52ca664872 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.457786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed127-e749-42de-b99d-dc52ca664872 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.458070 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ed127-e749-42de-b99d-dc52ca664872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.466194 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.466849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.467127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.467398 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.468219 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:27.468525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.469943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:27.474563 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-0d6ed127-e749-42de-b99d-dc52ca664872 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:27.475784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-0d6ed127-e749-42de-b99d-dc52ca664872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:27.482213 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 285/571] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:27.483005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.540547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 287/572] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:27.541337 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ed127-e749-42de-b99d-dc52ca664872 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.588233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c30bba-8b73-4f07-83b9-f8c7b4b2eef4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.621931 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.622604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.622886 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.623164 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.623921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:27.624234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.625604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:27.636648 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 286/573] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:27.637091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ed127-e749-42de-b99d-dc52ca664872 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.637442 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.671092 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.671784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.672072 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.672354 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.673110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:27.673419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.674800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:27.683151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 288/574] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:27.683946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.733929 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629f89e-764e-4390-a05d-d76cbeb33c05 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.765902 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.766693 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.766967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.767232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.777358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.778792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:27.779752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53231279-fe04-4e78-afef-83eb5792c16b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:27.795938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:27.796993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:27.797992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:27.797992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:27.797992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:27.797992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:27.797992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 287/575] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:27.797992 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.814705 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.815622 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.815933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.816211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.817044 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=c2295621846d482fb6f705097415611e) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:27.817359 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.818776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:27.824996 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 289/576] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/role_assignments?user.id=c2295621846d482fb6f705097415611e&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:27.825777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.910329 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4271e3-e5b3-4dc8-b025-5a0e91710dcb None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.938005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ba4b0-a1c0-4f2e-9790-06f110590bad None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:27.948624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b771e73-a00b-429d-a950-0e50e58e7b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.949730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771e73-a00b-429d-a950-0e50e58e7b74 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.950176 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771e73-a00b-429d-a950-0e50e58e7b74 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.950611 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b771e73-a00b-429d-a950-0e50e58e7b74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.962837 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b771e73-a00b-429d-a950-0e50e58e7b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-6b771e73-a00b-429d-a950-0e50e58e7b74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:27.970745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:27.972159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:27.973133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 288/577] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:27.973934 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b771e73-a00b-429d-a950-0e50e58e7b74 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:27.980819 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:27.981646 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:27.981926 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:27.982202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:27.989714 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:27.991195 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:28.007447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:28.008547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 290/578] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:28.010444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.085470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b771e73-a00b-429d-a950-0e50e58e7b74 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.113067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a81e9-d7e8-4752-b7d9-9b583be6c5f3 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.119313 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.120204 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.120483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.120754 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.131025 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.132517 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.149317 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.150192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.150481 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.150759 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.151497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:28.151832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:28.152492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:28.153430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:28.154451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:28.154451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:28.154451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:28.154451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:28.155264 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.158545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 289/579] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:28.159308 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.169643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 291/580] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:28.170395 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.261998 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a46fd6-0a59-47e2-9a11-dc9f9fd70591 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.271902 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12684d5d-b287-4717-9f64-0fec8afefaf3 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.296405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.297099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.297350 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.297625 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.298365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:28.298748 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.300044 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.306071 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.306753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.307037 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.307314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.308168 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:28.308528 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.314073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 290/581] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:28.314073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.314315 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.328447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 292/582] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:28.329279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.413773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8b853-130f-4c83-a589-ab8f142a9c21 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.432431 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1043d1-ac97-4957-ab65-5335568e454a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.447653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.448382 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.448666 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.448938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.449655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:28.449959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.451313 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.466857 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 291/583] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:28.466857 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.470233 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.471050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.471331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.471604 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.479589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.481070 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:28.496224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:28.497445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:29:28.498483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:28.502135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 293/584] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:28.502949 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.568437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c8a5a-b33b-444d-83de-0b65839b8b02 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.605052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.605847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.606137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.606410 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.612082 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9cca7-b9e9-4ca0-acc5-1b7d9622ce7d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.616376 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.617828 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:28.637129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:28.638184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:28.639185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:28.639185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:28.639185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:28.639185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:28.639185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 292/585] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:28.639185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.658667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e46133-2a89-4bb2-827c-4e3701368041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.659561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e46133-2a89-4bb2-827c-4e3701368041 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.659876 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e46133-2a89-4bb2-827c-4e3701368041 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.660154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e46133-2a89-4bb2-827c-4e3701368041 None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/4be3545ab61f47aab2897c713fcc1c85/roles/0dc5507e726a48198da466396f551a22` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.674897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e46133-2a89-4bb2-827c-4e3701368041 None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=4be3545ab61f47aab2897c713fcc1c85, role_id=0dc5507e726a48198da466396f551a22)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.676404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e46133-2a89-4bb2-827c-4e3701368041 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.695802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 294/586] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:29:28 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/4be3545ab61f47aab2897c713fcc1c85/roles/0dc5507e726a48198da466396f551a22 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:28.695802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e46133-2a89-4bb2-827c-4e3701368041 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.749339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa70084-4ecf-43c6-a270-c165d774baad None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.795221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.796244 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.796862 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.797141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] PATH_INFO: `/v3/users/glance` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.807970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.810247 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.812385 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e46133-2a89-4bb2-827c-4e3701368041 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:28.831447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:28.832595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:29:28.833677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:28.837978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 293/587] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:28.837978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.854339 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.855025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.855302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.855634 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.856611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:28.856922 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.858426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:28.879112 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 295/588] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:28.880029 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:28.955309 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806efdb-cb02-4612-8f34-f10d7704029b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.993155 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aced7d-85ee-4a39-bdc1-7684693a7bf5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:28.996874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:28.996874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:28.997123 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:28.997356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:28.998087 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:28.998392 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:28.999795 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.012501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 294/589] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:29.013258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.032211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.033277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.033788 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.034292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.035370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:29.035952 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.037623 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.056631 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 296/590] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:29:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:29.057823 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.128424 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75e71f-68f2-4bc7-8f98-116304485ec8 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.161665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4535c-f774-48ca-8786-02f1cfda77f5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.166496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.167301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.167587 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.167895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.180012 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.182078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.200496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:29.200870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:29.201831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:29.202861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:29.202861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:29.202861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:29.202861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:29.202861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 295/591] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:29.203573 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.204593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.205104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.205660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.214331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.216161 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:29.232119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:29.233272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:29:29.234343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:29.237200 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 297/592] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:29.238224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.317249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17a062-133c-4c45-b9e0-9dcddd6980ea None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.342884 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa20e6b-1c50-482b-b8df-2c4d1107f551 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.354161 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.354914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.355246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.355529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.366680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.368077 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.381835 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.382926 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.383440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.385258 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.386213 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:29.386744 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:29.387646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:29.388842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:29.389840 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:29.389840 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:29.389840 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:29.389840 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:29.391232 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.393601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 296/593] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:29.394615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.404541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 298/594] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:29.405680 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.506041 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f69464-bcc8-4303-9e8b-f5bc41a1eeac None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.508929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40827f5-b17d-4224-b12e-e6c332b7b5d3 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.542267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.542951 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.543289 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.543613 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.544458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:29.544768 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.546197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.546523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.547433 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.547970 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.548475 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.549436 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:29.549979 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.552168 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.566381 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 297/595] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:29.567268 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.567809 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 299/596] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:29.572405 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.676555 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee795ac-8bdf-43a8-97b2-643d93a9bf37 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.677916 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f08f4-10bd-496b-a17e-6544fe7d22fd None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.713973 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.714357 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.715170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.715453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.715731 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.716184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.716820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.717335 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.723028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.724861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.729018 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.730681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:29.739479 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:29.740773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:29.741843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:29.741843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:29.741843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:29.741843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:29.741843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:29.741843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:29.741843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:29.741843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:29.747519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 298/597] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:29.748455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:29.753914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:29.754879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:29.755937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:29.755937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:29.755937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:29.755937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:29.758209 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 300/598] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:29.760014 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.854414 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3bf7-7379-4cdb-820a-e00945f868c8 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.864230 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1985e69-733d-4b94-b67b-a366a7d3e00e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:29.890483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.890980 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.891261 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.891536 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.900194 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.901802 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.904725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:29.905804 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:29.906322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:29.906830 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:29.907885 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:29.908486 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:29.910250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:29.918730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:29.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:29.921035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:29.921035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:29.921035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:29.921035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:29.921035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:29.921035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:29.921035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:29.921035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:29.924931 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 299/599] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:29.926011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:29.930417 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 301/600] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:29.931755 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:30.039854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cbf8f-d8f3-4cb7-aaf5-b48192c635eb None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:30.040879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b9985-dfe9-4d6d-911d-373386f3478b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:30.077054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:30.077507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:30.077733 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.078003 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.078282 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.079196 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:30.079322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.079507 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:30.080047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.080543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.080933 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:30.081785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:30.082322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:30.083986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:30.093941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 300/601] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:30.094669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:30.098019 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 302/602] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:30.099151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:30.200532 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61ff29-b77d-4255-9e2f-d144bc9fc5fb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:30.200771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093bb5-9608-45b0-a546-1a26fa565a93 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:30.236263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8416487-c8c1-4a5c-bd8a-205fee3987fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:30.237297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416487-c8c1-4a5c-bd8a-205fee3987fa None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.237662 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416487-c8c1-4a5c-bd8a-205fee3987fa None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.238015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416487-c8c1-4a5c-bd8a-205fee3987fa None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/18b014c40d954881b8fa19f9e1d9b09a/roles/0dc5507e726a48198da466396f551a22` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.238259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:30.239124 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.239523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.239860 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.248752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:30.250295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:30.254024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8416487-c8c1-4a5c-bd8a-205fee3987fa None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=18b014c40d954881b8fa19f9e1d9b09a, role_id=0dc5507e726a48198da466396f551a22)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:30.255532 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8416487-c8c1-4a5c-bd8a-205fee3987fa None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:30.265653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:30.266852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:30.268073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:30.268073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:30.268073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:30.268073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:30.268073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:30.268073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:30.268073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:30.268073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:30.269037 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 303/603] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:30.269800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:30.288055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 301/604] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:29:30 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/18b014c40d954881b8fa19f9e1d9b09a/roles/0dc5507e726a48198da466396f551a22 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:30.288055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66219dfa-be3e-43c2-abe6-9b1ab6e003f0 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.288055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66219dfa-be3e-43c2-abe6-9b1ab6e003f0 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.288055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66219dfa-be3e-43c2-abe6-9b1ab6e003f0 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.288055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 302/605] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:30.288055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66219dfa-be3e-43c2-abe6-9b1ab6e003f0 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:30.418191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66219dfa-be3e-43c2-abe6-9b1ab6e003f0 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:30.424083 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007247-adc4-4dc9-b5b5-5abfba8dc24a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:30.457050 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2fa17-7bf0-48ec-8a2e-808b4d8c4eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:30.458292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2fa17-7bf0-48ec-8a2e-808b4d8c4eed None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.458860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2fa17-7bf0-48ec-8a2e-808b4d8c4eed None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.459141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2fa17-7bf0-48ec-8a2e-808b4d8c4eed None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.460217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2fa17-7bf0-48ec-8a2e-808b4d8c4eed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:30.460583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2fa17-7bf0-48ec-8a2e-808b4d8c4eed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:30.463429 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2fa17-7bf0-48ec-8a2e-808b4d8c4eed None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:30.470421 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b82452-b3cc-4a2f-b634-eba8100070a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:30.471490 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b82452-b3cc-4a2f-b634-eba8100070a2 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.472381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b82452-b3cc-4a2f-b634-eba8100070a2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.472664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b82452-b3cc-4a2f-b634-eba8100070a2 None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/2243309aa6e34df780759918f87ae043/roles/0dc5507e726a48198da466396f551a22` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.484698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 303/606] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:30.486661 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e833-abfb-4881-abdf-642c1ac839bd None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.487069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e833-abfb-4881-abdf-642c1ac839bd None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.487453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46e833-abfb-4881-abdf-642c1ac839bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.499292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b82452-b3cc-4a2f-b634-eba8100070a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=2243309aa6e34df780759918f87ae043, role_id=0dc5507e726a48198da466396f551a22)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:30.500793 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b82452-b3cc-4a2f-b634-eba8100070a2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:30.508521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-4e46e833-abfb-4881-abdf-642c1ac839bd None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:30.510842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-4e46e833-abfb-4881-abdf-642c1ac839bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:30.517969 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 304/607] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:29:30 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/2243309aa6e34df780759918f87ae043/roles/0dc5507e726a48198da466396f551a22 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:30.518992 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b82452-b3cc-4a2f-b634-eba8100070a2 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:30.595944 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 304/608] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:30.636827 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46e833-abfb-4881-abdf-642c1ac839bd None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:30.644581 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b82452-b3cc-4a2f-b634-eba8100070a2 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:30.683061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3045-4aae-44e7-a29f-72e90bc37851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:30.684323 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3045-4aae-44e7-a29f-72e90bc37851 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.684774 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3045-4aae-44e7-a29f-72e90bc37851 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.685252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3045-4aae-44e7-a29f-72e90bc37851 None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/ff6dfa76a7a14d09a88235482b3e68d8/roles/0dc5507e726a48198da466396f551a22` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.716307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a3045-4aae-44e7-a29f-72e90bc37851 None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=ff6dfa76a7a14d09a88235482b3e68d8, role_id=0dc5507e726a48198da466396f551a22)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:30.721011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a3045-4aae-44e7-a29f-72e90bc37851 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:30.740615 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 305/609] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:29:30 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/ff6dfa76a7a14d09a88235482b3e68d8/roles/0dc5507e726a48198da466396f551a22 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:30.831066 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46e833-abfb-4881-abdf-642c1ac839bd None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:30.886401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8703a6-a289-4dc6-a659-21285dc358ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:30.887424 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8703a6-a289-4dc6-a659-21285dc358ad None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:30.887793 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8703a6-a289-4dc6-a659-21285dc358ad None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:30.888180 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8703a6-a289-4dc6-a659-21285dc358ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:30.912746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8703a6-a289-4dc6-a659-21285dc358ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-cd8703a6-a289-4dc6-a659-21285dc358ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:30.922585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:30.923941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:30.925124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:30.926899 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 305/610] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:30.933834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3045-4aae-44e7-a29f-72e90bc37851 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:31.064696 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3045-4aae-44e7-a29f-72e90bc37851 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:31.100756 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e58d-2491-4a3f-8ab3-2820de9bd39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:31.101717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e58d-2491-4a3f-8ab3-2820de9bd39a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:31.102166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e58d-2491-4a3f-8ab3-2820de9bd39a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:31.102812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e58d-2491-4a3f-8ab3-2820de9bd39a None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:31.103889 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9e58d-2491-4a3f-8ab3-2820de9bd39a None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:31.104365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9e58d-2491-4a3f-8ab3-2820de9bd39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:31.105897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9e58d-2491-4a3f-8ab3-2820de9bd39a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:31.114966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 306/611] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:31.120831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8703a6-a289-4dc6-a659-21285dc358ad None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:31.137358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fb57-e205-438f-bce1-6ef6d905f977 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:31.137861 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fb57-e205-438f-bce1-6ef6d905f977 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:31.138184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fb57-e205-438f-bce1-6ef6d905f977 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:31.139680 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 307/612] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:31.145422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210e9c-e88f-4129-8563-267c07823622 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:31.145785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210e9c-e88f-4129-8563-267c07823622 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:31.146137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210e9c-e88f-4129-8563-267c07823622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:31.166267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-c3210e9c-e88f-4129-8563-267c07823622 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:31.168313 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-c3210e9c-e88f-4129-8563-267c07823622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:31.288320 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 308/613] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:29:31.299702 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8703a6-a289-4dc6-a659-21285dc358ad None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:31.345255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3210e9c-e88f-4129-8563-267c07823622 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:31.348091 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:31.348972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:31.349367 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:31.349708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:31.363184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:31.364493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:31.396358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:31.397379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:31.398368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:31.398368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:31.398368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:31.398368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:31.402232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 306/614] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:31.408717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:31.535955 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3210e9c-e88f-4129-8563-267c07823622 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:31.589797 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286acab-3d71-4046-97f1-957e75d7e587 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:31.600278 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2908e6d-fd3d-4205-9315-c406b812f71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:31.601296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908e6d-fd3d-4205-9315-c406b812f71c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:31.601743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908e6d-fd3d-4205-9315-c406b812f71c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:31.602181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908e6d-fd3d-4205-9315-c406b812f71c None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:31.619916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2908e6d-fd3d-4205-9315-c406b812f71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-c2908e6d-fd3d-4205-9315-c406b812f71c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:31.628679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:31.629976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:31.631131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:31.639973 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 309/615] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:31.644623 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2908e6d-fd3d-4205-9315-c406b812f71c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:31.661779 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:31.662675 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:31.663138 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:31.663572 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:31.664521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:31.665560 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:31.667327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:31.690451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 307/616] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:31.700701 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:31.833496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2908e6d-fd3d-4205-9315-c406b812f71c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:31.875546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35fd7-5a22-4870-82bb-4fab92bbfbca None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:31.889804 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:31.890479 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:31.890757 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:31.891029 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:31.891791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:31.892104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:31.893469 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:31.912330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 310/617] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:31.914400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:31.941427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:31.942228 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:31.942507 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:31.942780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:31.955876 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:31.957347 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:31.977148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:31.978997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:31.980156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 308/618] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:31.984890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:32.086316 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2015e26-c603-4f4e-bfd0-2327bd1e8c61 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:32.115516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560264f6-90da-4148-914d-feb18e1714b2 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:32.122567 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:32.123259 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:32.123540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:32.123854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:32.124708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:32.125021 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:32.126453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:32.145403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 309/619] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:29:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:32.151655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:32.154327 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:32.155393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:32.155915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:32.156393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:32.167889 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:32.169592 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:32.187115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:32.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:32.189202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:32.189202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:32.189202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:32.189202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:32.191712 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 311/620] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:32.198050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:32.289500 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12c581-4800-4fe3-9fe9-0c1aae67f9bd None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:32.338397 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a73965-5630-4079-97f3-18ad1e77b40f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:32.365450 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:32.366267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:32.366552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:32.367082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:32.375095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:32.376123 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:32.376622 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:32.377114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:32.378082 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:32.378600 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:32.380434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:32.394031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 312/621] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:32.398481 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:32.398481 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:32.399818 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:32.440354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:32.441511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:32.442496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:32.442496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:32.442496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:32.442496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:32.442496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 310/622] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:32.448433 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:32.524096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df743f63-67e0-4d1a-89b2-90c0497e0c0e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:32.560454 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:32.562129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:32.562633 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:32.563126 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] PATH_INFO: `/v3/users/nova` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:32.571039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:32.573583 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:32.589214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:32.590316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:32.591394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:32.594106 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 313/623] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:29:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:32.599638 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:32.690894 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b8ac-ffcb-442e-8c12-a9a1660bb03e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:32.703402 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ac4a0-c859-453b-90b8-151853e94cab None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:32.740991 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:32.742070 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:32.742558 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:32.743615 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:32.744857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:32.745530 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:32.747175 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:32.767405 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 314/624] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:29:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:32.773126 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:32.773542 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:32.774960 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:32.775319 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:32.775656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:32.776448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:32.776815 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:32.778266 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:32.805244 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 311/625] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:32.810720 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:32.878427 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b027690-9775-4d51-a55e-e212f33d618b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:32.915098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f950d18-afd1-403f-afcb-15a6cea92dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:32.916170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f950d18-afd1-403f-afcb-15a6cea92dcc None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:32.916666 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f950d18-afd1-403f-afcb-15a6cea92dcc None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:32.917164 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f950d18-afd1-403f-afcb-15a6cea92dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:32.987834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f950d18-afd1-403f-afcb-15a6cea92dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:32.989698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f950d18-afd1-403f-afcb-15a6cea92dcc None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:33.022483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ff9f8-8565-4e6c-b819-393955901cbc None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:33.064496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:33.065566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.065855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.066787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.073819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:33.075286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:33.090231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:33.091297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:33.092598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 312/626] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:33.104899 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:33.107246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 315/627] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:29:33.112821 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f950d18-afd1-403f-afcb-15a6cea92dcc None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:33.257613 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f950d18-afd1-403f-afcb-15a6cea92dcc None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:33.299014 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e7d4d-d5e3-4d37-8ec8-0db55e7941b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:33.300191 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7d4d-d5e3-4d37-8ec8-0db55e7941b8 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.300564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa36eb-737b-44bb-9f3d-1d07420d49be None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:33.300872 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7d4d-d5e3-4d37-8ec8-0db55e7941b8 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.301327 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7d4d-d5e3-4d37-8ec8-0db55e7941b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.313471 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e7d4d-d5e3-4d37-8ec8-0db55e7941b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:33.316228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e7d4d-d5e3-4d37-8ec8-0db55e7941b8 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-d90e7d4d-d5e3-4d37-8ec8-0db55e7941b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:33.340404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:33.341437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:33.342432 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:33.342432 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:33.342432 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:33.342432 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:33.349216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 316/628] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:33.351200 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e074c2-0d1f-4a77-8658-a090df7535d9 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.352143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e074c2-0d1f-4a77-8658-a090df7535d9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.353233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872aa5e9-d42f-4a4b-80f8-249ffe7a01de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:33.353852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e074c2-0d1f-4a77-8658-a090df7535d9 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.362845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aa5e9-d42f-4a4b-80f8-249ffe7a01de None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.362845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aa5e9-d42f-4a4b-80f8-249ffe7a01de None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.362845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aa5e9-d42f-4a4b-80f8-249ffe7a01de None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.362845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aa5e9-d42f-4a4b-80f8-249ffe7a01de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:33.362845 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aa5e9-d42f-4a4b-80f8-249ffe7a01de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:33.363370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aa5e9-d42f-4a4b-80f8-249ffe7a01de None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:33.363695 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 317/629] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:33.364912 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e074c2-0d1f-4a77-8658-a090df7535d9 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:33.388575 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 313/630] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:33.389933 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfaad6-78a0-4ac5-a06b-5516cd4f9962 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.390228 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfaad6-78a0-4ac5-a06b-5516cd4f9962 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.390512 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfaad6-78a0-4ac5-a06b-5516cd4f9962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.413807 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-d3cfaad6-78a0-4ac5-a06b-5516cd4f9962 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:33.415609 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-d3cfaad6-78a0-4ac5-a06b-5516cd4f9962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:33.507883 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 314/631] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:33.507883 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfaad6-78a0-4ac5-a06b-5516cd4f9962 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:33.542597 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e074c2-0d1f-4a77-8658-a090df7535d9 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:33.580783 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7608-ab40-41fa-98d6-eeeeb9148cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:33.581603 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7608-ab40-41fa-98d6-eeeeb9148cc1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.581790 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7608-ab40-41fa-98d6-eeeeb9148cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.582060 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7608-ab40-41fa-98d6-eeeeb9148cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.582841 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7608-ab40-41fa-98d6-eeeeb9148cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:33.583152 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7608-ab40-41fa-98d6-eeeeb9148cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:33.584665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7608-ab40-41fa-98d6-eeeeb9148cc1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:33.597501 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 318/632] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:33.598931 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7d9d-94c2-4336-a81c-e9ca0001aafe None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.599302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7d9d-94c2-4336-a81c-e9ca0001aafe None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.599655 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e7d9d-94c2-4336-a81c-e9ca0001aafe None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.601012 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 319/633] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:33.601785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e7d9d-94c2-4336-a81c-e9ca0001aafe None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:33.619207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfaad6-78a0-4ac5-a06b-5516cd4f9962 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:33.655819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a6032-0d13-4fcf-aa15-901263b0b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:33.656780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6032-0d13-4fcf-aa15-901263b0b4c4 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.657059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6032-0d13-4fcf-aa15-901263b0b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.657383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6032-0d13-4fcf-aa15-901263b0b4c4 None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/c2295621846d482fb6f705097415611e/roles/0dc5507e726a48198da466396f551a22` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.672456 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a6032-0d13-4fcf-aa15-901263b0b4c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=c2295621846d482fb6f705097415611e, role_id=0dc5507e726a48198da466396f551a22)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:33.673901 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a6032-0d13-4fcf-aa15-901263b0b4c4 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:33.687895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 315/634] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:29:33 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/c2295621846d482fb6f705097415611e/roles/0dc5507e726a48198da466396f551a22 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:33.689314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da9a1-45a5-4c9b-9faa-98118cf7c4da None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.689609 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da9a1-45a5-4c9b-9faa-98118cf7c4da None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.689890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da9a1-45a5-4c9b-9faa-98118cf7c4da None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.691742 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 316/635] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:33.692531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da9a1-45a5-4c9b-9faa-98118cf7c4da None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:33.722387 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e7d9d-94c2-4336-a81c-e9ca0001aafe None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:33.761749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed86a0f-0597-4b31-9195-f80f72b17136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:33.762519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86a0f-0597-4b31-9195-f80f72b17136 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.762831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86a0f-0597-4b31-9195-f80f72b17136 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.763115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed86a0f-0597-4b31-9195-f80f72b17136 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.775665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed86a0f-0597-4b31-9195-f80f72b17136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-6ed86a0f-0597-4b31-9195-f80f72b17136 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:33.784508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:33.785703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:33.786688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 320/636] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:33.787474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dabbf-d3c1-4bef-9862-ca2a5ec540cd None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.787474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dabbf-d3c1-4bef-9862-ca2a5ec540cd None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.787640 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dabbf-d3c1-4bef-9862-ca2a5ec540cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.805104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-d53dabbf-d3c1-4bef-9862-ca2a5ec540cd None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:33.806389 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-d53dabbf-d3c1-4bef-9862-ca2a5ec540cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:33.816596 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da9a1-45a5-4c9b-9faa-98118cf7c4da None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:33.854566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:33.855397 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.855684 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.855997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.863318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:33.864891 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:33.881617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:33.882737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:33.884547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:33.884547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:33.884547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:33.884547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:33.884547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:33.884547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:33.884547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:33.884547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:33.885300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 321/637] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:33.885300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caab23-63bc-4a40-8ce2-5f2691bc6623 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:33.886150 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 317/638] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:33.886150 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:33.891302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caab23-63bc-4a40-8ce2-5f2691bc6623 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:33.891302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caab23-63bc-4a40-8ce2-5f2691bc6623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:33.909576 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-b6caab23-63bc-4a40-8ce2-5f2691bc6623 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:33.911086 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-b6caab23-63bc-4a40-8ce2-5f2691bc6623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:33.982156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 322/639] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:33.983336 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caab23-63bc-4a40-8ce2-5f2691bc6623 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.009241 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc89b2c-6363-4768-9440-c6cb3f61957a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.049560 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.050271 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.050632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.050984 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.051847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:34.052231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.053779 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:34.067260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 318/640] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:34.067260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.096651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caab23-63bc-4a40-8ce2-5f2691bc6623 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.132396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.133069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.133353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.133777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.134789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:34.135104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.136618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:34.148729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 323/641] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:34.150198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.175160 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96468abc-d299-4d5c-b0f1-55ed1fd29a2f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.210549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c4b5c-f98b-41c4-bb14-f0641b4d2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.211353 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4b5c-f98b-41c4-bb14-f0641b4d2da1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.211629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4b5c-f98b-41c4-bb14-f0641b4d2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.212941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4b5c-f98b-41c4-bb14-f0641b4d2da1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.223309 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c4b5c-f98b-41c4-bb14-f0641b4d2da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-d45c4b5c-f98b-41c4-bb14-f0641b4d2da1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:34.232352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:34.233412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 319/642] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:34.239449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c4b5c-f98b-41c4-bb14-f0641b4d2da1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.259607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f512-cfa2-4a44-8928-425eb86ed0b5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.298820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750b2cc-304d-4feb-a6f6-7a10870edd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.299703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b2cc-304d-4feb-a6f6-7a10870edd65 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.299954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b2cc-304d-4feb-a6f6-7a10870edd65 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.300235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b2cc-304d-4feb-a6f6-7a10870edd65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.310438 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750b2cc-304d-4feb-a6f6-7a10870edd65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-1750b2cc-304d-4feb-a6f6-7a10870edd65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:34.318491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:34.324649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 324/643] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:34.325911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750b2cc-304d-4feb-a6f6-7a10870edd65 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.344938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c4b5c-f98b-41c4-bb14-f0641b4d2da1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.386792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.388100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.388100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.388383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.399972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.402001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:34.420420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:34.421655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:34.422882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:34.422882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:34.422882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:34.422882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:34.423162 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750b2cc-304d-4feb-a6f6-7a10870edd65 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.428071 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 320/644] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:34.429047 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.459369 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.460062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.460344 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.460620 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.461465 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=4be3545ab61f47aab2897c713fcc1c85) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:34.461919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.463569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:34.469941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 325/645] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/role_assignments?user.id=4be3545ab61f47aab2897c713fcc1c85&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:34.470767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.548047 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ac1eb-7a2c-440d-84a8-af3ce065f972 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.586616 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.588821 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.589336 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.589803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.590720 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:34.591175 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.592823 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:34.594041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4300fce-3d04-46f8-b9fa-3bd715b0da82 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.603953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 321/646] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:34.605151 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.636667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.637707 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.638166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.638543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.639601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:34.640063 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.649283 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:34.664484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 326/647] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:34.665812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.735644 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee696d2-d8fb-40b4-95c9-f2ba68c4cf8e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.781074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.781844 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.782185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.782525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.783325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:34.783713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.785221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:34.788584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b935b28-eea3-40c8-9e26-8c6ab28438da None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.799656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 322/648] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:34.800396 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.831562 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.832395 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.832674 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.832953 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.845248 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.846668 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:34.865516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:34.866776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:34.868167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:34.868167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:34.868167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:34.868167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:34.868167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 327/649] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:34.872200 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:34.928386 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414731e9-f679-4239-903b-6a2cd8399ef5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.970649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:34.971705 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:34.972172 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:34.972624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:34.984046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:34.984301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050f6c-fd12-43a9-8edc-e7d0eece4470 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:34.985913 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:35.004971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:35.006209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:35.007408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:35.007408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:35.007408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:35.007408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:35.010660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 323/650] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:35.011742 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.020379 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.021434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.021434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.021730 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] PATH_INFO: `/v3/users/glance` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.030180 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.031793 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:35.047015 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:35.048353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:29:35.049775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:35.052994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 328/651] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:35.054254 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.124514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c35cf-091d-4c76-a386-186c4163d368 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.157128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2e87-455c-42f7-87f6-9ef5d1836175 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.160628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.161513 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.161961 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.162389 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.163282 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:35.163756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.166471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.178475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 324/652] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:35.179378 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.192904 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.193580 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.193866 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.194147 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.194887 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:35.195197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.196816 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.209261 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 329/653] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:35.210106 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.285508 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d1cf3-2a90-4ffe-8754-75fb20d2a257 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.319697 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e52b60-777e-434e-a2f0-046d28b0fd38 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.322277 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.322958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.323243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.323525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.324426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:35.324737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.326170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.352150 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 325/654] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:35.354362 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.356803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.357614 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.357902 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.358488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.366172 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.367630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:35.386093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:35.387670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 330/655] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:35.389308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.466100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485600-e500-41d3-aba0-f4212f75bc2e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.494764 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbea9-5676-4744-8a0a-b89dcdcdb15d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.502299 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.503395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.503668 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.512561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.514009 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:35.530156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:35.531495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:29:35.532595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:35.533202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073623-bbe8-483b-b685-6c147531547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.533311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 326/656] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:35.533981 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073623-bbe8-483b-b685-6c147531547c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.533981 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073623-bbe8-483b-b685-6c147531547c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.534299 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.534476 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64073623-bbe8-483b-b685-6c147531547c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.606351 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64073623-bbe8-483b-b685-6c147531547c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.607844 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64073623-bbe8-483b-b685-6c147531547c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.639542 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883805a6-8bba-4d8e-a063-9a8335402976 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.676024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.676704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.676983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.677261 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.678116 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:35.678423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.679892 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.698849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 327/657] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:35.699817 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.710625 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 331/658] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:35.711557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073623-bbe8-483b-b685-6c147531547c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.810168 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3959d-ac96-4272-b997-ca542cd30e1d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.814415 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64073623-bbe8-483b-b685-6c147531547c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:35.848818 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.849613 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.849901 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.850283 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.851315 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:35.851565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.853277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16eeb1-005a-4191-8d0c-c2ac5b358f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:35.854292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16eeb1-005a-4191-8d0c-c2ac5b358f92 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:35.854546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.854742 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16eeb1-005a-4191-8d0c-c2ac5b358f92 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:35.854900 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16eeb1-005a-4191-8d0c-c2ac5b358f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:35.876092 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 328/659] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:35.877146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:35.929038 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16eeb1-005a-4191-8d0c-c2ac5b358f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:35.931053 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16eeb1-005a-4191-8d0c-c2ac5b358f92 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:35.983867 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac2f59-c388-4164-ac53-5c086fbe3b70 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.020299 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.021101 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.021382 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.021659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.033364 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.034816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.036181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 332/660] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:36.037042 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16eeb1-005a-4191-8d0c-c2ac5b358f92 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:36.054065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:36.056624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:36.058997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:36.058997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:36.058997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:36.058997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:36.064633 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 329/661] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:36.064633 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.140198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16eeb1-005a-4191-8d0c-c2ac5b358f92 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.163596 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e609f35-15bd-4516-9305-b4ca5ffc872d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.174227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76d969-a0ae-4bdc-8ad8-8cf838d67ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.174874 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76d969-a0ae-4bdc-8ad8-8cf838d67ee2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.175164 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76d969-a0ae-4bdc-8ad8-8cf838d67ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.175434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76d969-a0ae-4bdc-8ad8-8cf838d67ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.200491 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.201385 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.201772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.202052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.213394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.215019 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:36.232987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:36.234042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:36.235080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:36.235080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:36.235080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:36.235080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:36.235080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 330/662] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:36.235080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.248425 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76d969-a0ae-4bdc-8ad8-8cf838d67ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.249902 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76d969-a0ae-4bdc-8ad8-8cf838d67ee2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.340295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbf09f-3246-49d9-9d9e-c05c99d13756 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.347140 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 333/663] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:36.348528 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475862-3c83-4cd8-9df8-688793a2f1f0 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.348811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475862-3c83-4cd8-9df8-688793a2f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.349084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475862-3c83-4cd8-9df8-688793a2f1f0 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.350553 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 334/664] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:36.354105 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475862-3c83-4cd8-9df8-688793a2f1f0 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.386275 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.386956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.387236 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.387511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.388287 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:36.388599 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.389969 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.403545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 331/665] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:36.404401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.472577 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475862-3c83-4cd8-9df8-688793a2f1f0 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.506793 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb05db3-2237-4b98-86cd-c418c65de08c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.507002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176ec31-c1b8-445d-bf1a-f2ddac82afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.507670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ec31-c1b8-445d-bf1a-f2ddac82afc9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.507985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ec31-c1b8-445d-bf1a-f2ddac82afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.508271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176ec31-c1b8-445d-bf1a-f2ddac82afc9 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.509564 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ec31-c1b8-445d-bf1a-f2ddac82afc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:36.509973 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ec31-c1b8-445d-bf1a-f2ddac82afc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.511359 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176ec31-c1b8-445d-bf1a-f2ddac82afc9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.527424 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 335/666] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:36.527424 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2cb1-f45c-46f1-8535-4385fc1e73b9 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.527424 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2cb1-f45c-46f1-8535-4385fc1e73b9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.527424 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2cb1-f45c-46f1-8535-4385fc1e73b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.541615 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-24db2cb1-f45c-46f1-8535-4385fc1e73b9 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:36.542800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-24db2cb1-f45c-46f1-8535-4385fc1e73b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:36.545440 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.546243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.546521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.546797 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.559733 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.561404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:36.580217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:36.581258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:36.587137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:36.587137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:36.587137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:36.587137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:36.587137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 332/667] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:36.587137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.615536 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 336/668] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:36.617005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db2cb1-f45c-46f1-8535-4385fc1e73b9 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.704408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43706bb6-0dfe-406e-bc45-7d1b4e88e256 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.723872 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db2cb1-f45c-46f1-8535-4385fc1e73b9 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.740760 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.741568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.741854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.742131 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.750127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.751584 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.758291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.759257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.759560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.759873 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:36.766427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:36.767703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 333/669] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:36.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.772918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.774548 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:36.791267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:36.792419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:36.793423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 337/670] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:36.794638 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.880642 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932280b-10f6-4a13-8069-3433ff12c4ce None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.894425 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb2436-c6a0-4e35-87b3-c7e20c33f0cb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:36.916165 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.917107 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.917390 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.917671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.918411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:36.918718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:36.920132 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:36.929314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea18298-a9ec-472a-857d-a26c2e257a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:36.930321 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18298-a9ec-472a-857d-a26c2e257a95 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:36.931407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18298-a9ec-472a-857d-a26c2e257a95 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:36.931884 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18298-a9ec-472a-857d-a26c2e257a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:36.932359 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 334/671] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:36.933168 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:36.947648 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea18298-a9ec-472a-857d-a26c2e257a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-bea18298-a9ec-472a-857d-a26c2e257a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:36.956523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:36.957780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:36.958862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:36.961047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 338/672] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:36.962505 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea18298-a9ec-472a-857d-a26c2e257a95 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.033338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7bd59-a80b-46cc-b9d4-917b03ec5597 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.059753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea18298-a9ec-472a-857d-a26c2e257a95 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.065554 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.066214 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.066500 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.066769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.067548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:37.067887 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.069310 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.080865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 335/673] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:37.081651 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.094002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b712003-63c5-4d94-8299-274c0f60eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.094666 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712003-63c5-4d94-8299-274c0f60eef5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.094955 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712003-63c5-4d94-8299-274c0f60eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.095232 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712003-63c5-4d94-8299-274c0f60eef5 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.096064 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b712003-63c5-4d94-8299-274c0f60eef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:37.096374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b712003-63c5-4d94-8299-274c0f60eef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.097801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b712003-63c5-4d94-8299-274c0f60eef5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.110249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 339/674] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:37.111565 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011a9df-a0ed-4209-97a9-0e667d39cbaf None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.111884 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011a9df-a0ed-4209-97a9-0e667d39cbaf None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.112166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011a9df-a0ed-4209-97a9-0e667d39cbaf None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.115427 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 340/675] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:37.115427 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011a9df-a0ed-4209-97a9-0e667d39cbaf None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.179222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c195-b67e-4c01-bba0-f86c7ded56a6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.209948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011a9df-a0ed-4209-97a9-0e667d39cbaf None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.212209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.213316 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.213601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.213877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.220502 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.221947 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:37.236571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:37.237594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:37.238591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 336/676] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:37.239134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.245868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.246535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.246819 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.247096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.247907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:37.248221 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.249583 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.257493 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 341/677] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:37.258279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.338690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cc4ab-7faa-48f8-91a4-519e3afdbe39 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.355203 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26997dde-1af8-4c77-9c7d-3189938e8d21 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.371865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a16a1-e70f-49d3-89e6-6dd77b11f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.372537 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a16a1-e70f-49d3-89e6-6dd77b11f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.372818 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a16a1-e70f-49d3-89e6-6dd77b11f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.373089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a16a1-e70f-49d3-89e6-6dd77b11f1f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.373929 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a16a1-e70f-49d3-89e6-6dd77b11f1f6 None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=2243309aa6e34df780759918f87ae043) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:37.374240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a16a1-e70f-49d3-89e6-6dd77b11f1f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.375672 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a16a1-e70f-49d3-89e6-6dd77b11f1f6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.381568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 337/678] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/role_assignments?user.id=2243309aa6e34df780759918f87ae043&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:37.382748 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d348-0fd2-437c-8127-1f1ad5839532 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.383038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d348-0fd2-437c-8127-1f1ad5839532 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.383314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d348-0fd2-437c-8127-1f1ad5839532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.390593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.391272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.391556 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.391927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.392792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=18b014c40d954881b8fa19f9e1d9b09a) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:37.393111 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.394593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.402669 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 342/679] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/role_assignments?user.id=18b014c40d954881b8fa19f9e1d9b09a&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:37.403555 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.411025 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-7055d348-0fd2-437c-8127-1f1ad5839532 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:37.412345 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-7055d348-0fd2-437c-8127-1f1ad5839532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:37.500398 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 338/680] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:37.500398 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d348-0fd2-437c-8127-1f1ad5839532 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.573390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbafa54-1a97-4b07-9bcb-a47ed3345069 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.616488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.618538 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.618951 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.619236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.620095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:37.620406 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.621871 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.639406 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 343/681] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:37.640243 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.641355 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d348-0fd2-437c-8127-1f1ad5839532 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.682612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.683421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.683705 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.684010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.699205 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.700737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:37.724075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:37.725128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:37.726144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:37.726144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:37.726144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:37.726144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:37.726144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 339/682] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:37.727130 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.764356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef9f20-0ff4-4fb0-acf1-03357d30c056 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.799091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae7b17-b8ff-473f-ac0b-7f17579fd652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.800270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae7b17-b8ff-473f-ac0b-7f17579fd652 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.800757 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae7b17-b8ff-473f-ac0b-7f17579fd652 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.801228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae7b17-b8ff-473f-ac0b-7f17579fd652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.812465 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae7b17-b8ff-473f-ac0b-7f17579fd652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-09ae7b17-b8ff-473f-ac0b-7f17579fd652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:37.820599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:37.822416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:37.823358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:37.829891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 344/683] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:37.829891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae7b17-b8ff-473f-ac0b-7f17579fd652 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.834123 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b658e-4387-47e2-a81d-25ffeb5d5c08 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.870059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.870647 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.870940 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.871221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.872107 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=ff6dfa76a7a14d09a88235482b3e68d8) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:37.872422 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.873861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.880452 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 340/684] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/role_assignments?user.id=ff6dfa76a7a14d09a88235482b3e68d8&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:37.881394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:37.941508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae7b17-b8ff-473f-ac0b-7f17579fd652 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:37.978811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:37.979930 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:37.980460 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:37.980946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:37.981918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:37.982471 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:37.984141 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:37.999022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 345/685] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:38.009448 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:38.012637 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b2e45-8697-4253-a050-0502e8e8b0c5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:38.052275 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:38.052975 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:38.053288 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:38.053816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:38.054323 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:38.054635 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:38.056263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:38.067158 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 341/686] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:38.075636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:38.168700 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd4ddd-9107-437d-9ea6-61baf2d81d7f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:38.218197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:38.219807 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:38.220099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:38.220427 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:38.221465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946ba15-0d09-40eb-9d25-98519582f3a4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:38.233473 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:38.235317 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:38.254596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:38.255684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:38.257009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 346/687] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:38.262217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:38.273789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:38.274635 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:38.274921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:38.275327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:38.304747 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:38.306839 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:38.348222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:38.349534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:38.350869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:38.350869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:38.350869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:38.350869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:38.350869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 342/688] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:38.357572 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:38.376894 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6b1a2-6c4e-4e6e-b982-546171bfa2f1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:38.415579 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:38.416616 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:38.417060 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:38.417530 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:38.418621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:38.419157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:38.420839 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:38.440905 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 347/689] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:29:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:38.448985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:38.540817 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f55a5-8ea2-4a20-bf0b-fcdca6b75507 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:38.576128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:38.576799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:38.577085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:38.577348 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:38.578073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:38.578378 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:38.579748 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:38.591912 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 343/690] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:38.597247 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:38.667514 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85934dc3-dfb5-41f7-97a9-c0dcd54236a6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:38.701490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e007369-cf93-4634-9082-38ab24e8781e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:38.741189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caee5d-5e51-416b-9e1d-13b879c18f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:38.742550 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caee5d-5e51-416b-9e1d-13b879c18f4d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:38.744156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caee5d-5e51-416b-9e1d-13b879c18f4d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:38.745075 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caee5d-5e51-416b-9e1d-13b879c18f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:38.750756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:38.751744 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:38.752222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:38.752673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:38.770364 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:38.772146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:38.793249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:38.794601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:38.795910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:38.798993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 344/691] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:29:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:38.809711 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:38.882802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caee5d-5e51-416b-9e1d-13b879c18f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:38.884812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1caee5d-5e51-416b-9e1d-13b879c18f4d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:38.992198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 348/692] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:38.998158 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caee5d-5e51-416b-9e1d-13b879c18f4d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:39.005947 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c103-4650-47ff-b2a2-c1dd4af22108 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:39.070086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:39.071810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:39.072261 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:39.072763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:39.073789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:39.074261 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:39.075889 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:39.099216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caee5d-5e51-416b-9e1d-13b879c18f4d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:39.114220 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 345/693] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:29:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:39.121198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:39.143799 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:39.143799 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:39.143799 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:39.143799 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:39.153335 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:39.154826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:39.173108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:39.174186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:39.175814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:39.175814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:39.175814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:39.175814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:39.175814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 349/694] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:39.179979 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:39.241281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313acdf-ccf2-44fa-8972-e50247e0d208 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:39.279002 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8880e79-0eda-4d40-9380-3f695626b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:39.280054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8880e79-0eda-4d40-9380-3f695626b1cb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:39.280585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8880e79-0eda-4d40-9380-3f695626b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:39.281074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8880e79-0eda-4d40-9380-3f695626b1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:39.353745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8880e79-0eda-4d40-9380-3f695626b1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:39.355609 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8880e79-0eda-4d40-9380-3f695626b1cb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:39.402741 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553838a-9700-4946-9ccb-381a1e5fe624 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:39.463084 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 346/695] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:39.468990 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8880e79-0eda-4d40-9380-3f695626b1cb None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:39.487226 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:39.488306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:39.488804 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:39.489293 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:39.490255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:39.490773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:39.494560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:39.526028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 350/696] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:39.531301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:39.596539 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8880e79-0eda-4d40-9380-3f695626b1cb None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:39.632545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:39.634613 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:39.635224 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:39.635799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:39.646834 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:39.648618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:39.668314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:39.669368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:39.670418 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:39.670418 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:39.670418 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:39.670418 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:39.672795 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 347/697] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:39.677989 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:39.798742 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ef364-6afc-452a-80d1-d46ba1f0aa54 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:39.806154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48869-fd9a-4ab0-831b-e1ceea72b4eb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:39.845780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:39.846832 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:39.847360 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:39.847889 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:39.848879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:39.853181 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:39.854852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:39.877834 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 348/698] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:39.883986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a71134-e340-4d63-805a-9d3d7976a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:39.885415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:39.886864 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a71134-e340-4d63-805a-9d3d7976a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:39.891283 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a71134-e340-4d63-805a-9d3d7976a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:39.891954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a71134-e340-4d63-805a-9d3d7976a5b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:39.909458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a71134-e340-4d63-805a-9d3d7976a5b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:39.912100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a71134-e340-4d63-805a-9d3d7976a5b6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-a0a71134-e340-4d63-805a-9d3d7976a5b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:39.934084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:39.935144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:39.936183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:39.936183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:39.936183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:39.936183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:39.936183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:39.936183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:39.936183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:39.936183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:39.940772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 351/699] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:39.942268 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0eda4-6621-42e2-854e-42f256c6c3a9 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:39.942394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0eda4-6621-42e2-854e-42f256c6c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:39.942647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0eda4-6621-42e2-854e-42f256c6c3a9 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:39.944221 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 352/700] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:39.944933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0eda4-6621-42e2-854e-42f256c6c3a9 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:40.030475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8d71d-21af-4a74-8638-ffb1e3ddbc9b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.058613 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0eda4-6621-42e2-854e-42f256c6c3a9 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.074077 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f582bd-6687-4470-a781-854eb8834a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:40.075867 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f582bd-6687-4470-a781-854eb8834a36 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.076368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f582bd-6687-4470-a781-854eb8834a36 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.077019 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f582bd-6687-4470-a781-854eb8834a36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.086016 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f582bd-6687-4470-a781-854eb8834a36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:40.089407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f582bd-6687-4470-a781-854eb8834a36 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:40.096389 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:40.097080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.097431 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.097710 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.098618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:40.098901 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:40.100440 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-f6f582bd-6687-4470-a781-854eb8834a36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:40.109985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:40.111046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:40.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:40.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:40.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:40.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:40.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:40.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:40.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:40.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:40.116178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 349/701] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:40.118487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f629e-bc62-46fc-8b3a-1f4875cccd84 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.119058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f629e-bc62-46fc-8b3a-1f4875cccd84 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.119898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f629e-bc62-46fc-8b3a-1f4875cccd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.122231 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 353/702] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:40.124747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:40.142419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-f24f629e-bc62-46fc-8b3a-1f4875cccd84 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:40.143716 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-f24f629e-bc62-46fc-8b3a-1f4875cccd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:40.214006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 350/703] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:40.219546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f629e-bc62-46fc-8b3a-1f4875cccd84 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:40.252968 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c3c10-e198-4741-817f-151bba341fe4 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.293384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:40.294161 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.294518 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.294870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.295829 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:40.296234 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:40.298135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:40.311409 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 354/704] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:40.312206 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:40.349914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f629e-bc62-46fc-8b3a-1f4875cccd84 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.388923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9888ab8-8190-4c54-b6b1-939c37f6c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:40.389598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888ab8-8190-4c54-b6b1-939c37f6c70d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.390050 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888ab8-8190-4c54-b6b1-939c37f6c70d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.390330 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888ab8-8190-4c54-b6b1-939c37f6c70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.391999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9888ab8-8190-4c54-b6b1-939c37f6c70d None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=c2295621846d482fb6f705097415611e) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:40.392318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9888ab8-8190-4c54-b6b1-939c37f6c70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:40.393761 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9888ab8-8190-4c54-b6b1-939c37f6c70d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:40.412366 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 351/705] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:40 2022] GET /identity/v3/role_assignments?user.id=c2295621846d482fb6f705097415611e&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:40.415230 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b14f2-4956-4f2d-a755-06165360968d None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.416133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b14f2-4956-4f2d-a755-06165360968d None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.416431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b14f2-4956-4f2d-a755-06165360968d None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.420242 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 352/706] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:40.421475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b14f2-4956-4f2d-a755-06165360968d None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:40.430099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a70c5-efff-4d84-bae7-e7d6f414f758 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.482523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba87c1-bb9b-4f25-a408-064ceec57894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:40.483347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba87c1-bb9b-4f25-a408-064ceec57894 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.483629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba87c1-bb9b-4f25-a408-064ceec57894 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.483934 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba87c1-bb9b-4f25-a408-064ceec57894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.500184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba87c1-bb9b-4f25-a408-064ceec57894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:40.501976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba87c1-bb9b-4f25-a408-064ceec57894 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-94ba87c1-bb9b-4f25-a408-064ceec57894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:40.527959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:40.529068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:40.530760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:40.530760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:40.530760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:40.530760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:40.530760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 355/707] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:40.531076 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe18a-bc22-4b83-8441-c9cb852c10aa None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.531185 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe18a-bc22-4b83-8441-c9cb852c10aa None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.531444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe18a-bc22-4b83-8441-c9cb852c10aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.549553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b14f2-4956-4f2d-a755-06165360968d None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.556206 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-e60fe18a-bc22-4b83-8441-c9cb852c10aa None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:40.557976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-e60fe18a-bc22-4b83-8441-c9cb852c10aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:40.607043 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:40.608007 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.608290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.608550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.609415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=4be3545ab61f47aab2897c713fcc1c85) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:40.609724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:40.612169 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:40.619359 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 353/708] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:40 2022] GET /identity/v3/role_assignments?user.id=4be3545ab61f47aab2897c713fcc1c85&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=8cf832105b2949f6b11e06b208146326 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:40.620905 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:40.650294 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 356/709] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:40.676565 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe18a-bc22-4b83-8441-c9cb852c10aa None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:40.737644 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617ac4c-6291-403b-b24d-6429ad85a071 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.783856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40036868-38eb-4749-872b-1fbd46d7f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:40.784637 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40036868-38eb-4749-872b-1fbd46d7f871 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.784921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40036868-38eb-4749-872b-1fbd46d7f871 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.785197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40036868-38eb-4749-872b-1fbd46d7f871 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.785945 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40036868-38eb-4749-872b-1fbd46d7f871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:40.786253 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40036868-38eb-4749-872b-1fbd46d7f871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:40.787890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40036868-38eb-4749-872b-1fbd46d7f871 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:40.802497 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 354/710] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:40.804029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354224a8-82b7-4a46-a0ab-315eeaa82fc6 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.804317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354224a8-82b7-4a46-a0ab-315eeaa82fc6 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.804590 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354224a8-82b7-4a46-a0ab-315eeaa82fc6 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.806965 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe18a-bc22-4b83-8441-c9cb852c10aa None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.807464 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 355/711] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:40.811059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354224a8-82b7-4a46-a0ab-315eeaa82fc6 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:40.862039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91fa8b-2907-4176-a6f0-38bacc8033a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:40.862510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa8b-2907-4176-a6f0-38bacc8033a9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.862795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa8b-2907-4176-a6f0-38bacc8033a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.863048 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fa8b-2907-4176-a6f0-38bacc8033a9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.863732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91fa8b-2907-4176-a6f0-38bacc8033a9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:40.865147 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91fa8b-2907-4176-a6f0-38bacc8033a9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-7e91fa8b-2907-4176-a6f0-38bacc8033a9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:40.884964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:40.887393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:40.889535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 357/712] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:29:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:40.892081 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2ff4e-98f1-4310-b2c7-92c4e072e294 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:40.892081 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2ff4e-98f1-4310-b2c7-92c4e072e294 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:40.892081 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2ff4e-98f1-4310-b2c7-92c4e072e294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:40.910390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-1fb2ff4e-98f1-4310-b2c7-92c4e072e294 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:40.911570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-1fb2ff4e-98f1-4310-b2c7-92c4e072e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:40.961241 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354224a8-82b7-4a46-a0ab-315eeaa82fc6 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:40.991981 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 358/713] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:40.992904 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2ff4e-98f1-4310-b2c7-92c4e072e294 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:41.031260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f7455-4b56-4fcf-aaf9-30ba6f74e319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:41.032500 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f7455-4b56-4fcf-aaf9-30ba6f74e319 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:41.032954 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f7455-4b56-4fcf-aaf9-30ba6f74e319 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:41.033354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f7455-4b56-4fcf-aaf9-30ba6f74e319 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:41.034439 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f7455-4b56-4fcf-aaf9-30ba6f74e319 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:41.035930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f7455-4b56-4fcf-aaf9-30ba6f74e319 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:41.060339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 356/714] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:29:40 2022] POST /identity/v3/users => generated 254 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:29:41.061303 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f7455-4b56-4fcf-aaf9-30ba6f74e319 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:41.153571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2ff4e-98f1-4310-b2c7-92c4e072e294 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:41.194305 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f7455-4b56-4fcf-aaf9-30ba6f74e319 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:41.238046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:41.239317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:41.239857 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:41.240370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] PATH_INFO: `/v3/services/network` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:41.241311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:41.243223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:41.259562 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:41.261018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:41.262189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:41.265253 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 357/715] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:41 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:41.271564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:41.341257 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:41.341952 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:41.342232 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:41.342806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:41.343226 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:41.343535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:41.344985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:41.357102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 359/716] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:29:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:41.361753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:41.393693 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd488-9e4f-4ef8-9358-506b66c1cbb1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:41.433121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:41.433805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:41.434083 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:41.434359 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:41.435074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] RBAC: Adding query filter params (name=network) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:41.435383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:41.436795 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:41.443648 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 358/717] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:29:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:41.453745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:41.524789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b858f7c-e3b4-43dd-915b-67c3800db2ed None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:41.566449 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5cad7-5d92-47ae-9413-8feefc461a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:41.567128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5cad7-5d92-47ae-9413-8feefc461a0a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:41.567410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5cad7-5d92-47ae-9413-8feefc461a0a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:41.567943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5cad7-5d92-47ae-9413-8feefc461a0a None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:41.568508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5cad7-5d92-47ae-9413-8feefc461a0a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:41.568815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5cad7-5d92-47ae-9413-8feefc461a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:41.570250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5cad7-5d92-47ae-9413-8feefc461a0a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:41.576709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 360/718] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:29:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:41.578371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d191-872f-4d96-af3c-994383715046 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:41.620386 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600f4e6-13a3-48d7-861f-b1e540681138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:41.621091 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f4e6-13a3-48d7-861f-b1e540681138 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:41.621411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f4e6-13a3-48d7-861f-b1e540681138 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:41.621698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f4e6-13a3-48d7-861f-b1e540681138 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:41.622439 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f4e6-13a3-48d7-861f-b1e540681138 None admin] RBAC: Adding query filter params (type=network) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:41.622756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f4e6-13a3-48d7-861f-b1e540681138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:41.624228 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f4e6-13a3-48d7-861f-b1e540681138 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:41.632293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 359/719] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:29:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:43.416985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa798-2b87-4102-94c6-d0f6c3d7f003 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:43.417962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa798-2b87-4102-94c6-d0f6c3d7f003 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:43.418458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa798-2b87-4102-94c6-d0f6c3d7f003 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:43.420406 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 361/720] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:43.429414 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6176-8ba7-4831-9516-5d90545c46ab None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:43.430467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6176-8ba7-4831-9516-5d90545c46ab None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:43.431004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f6176-8ba7-4831-9516-5d90545c46ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:43.454419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-4c5f6176-8ba7-4831-9516-5d90545c46ab None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:43.456024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-4c5f6176-8ba7-4831-9516-5d90545c46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:43.556611 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 360/721] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:43.597214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aa798-2b87-4102-94c6-d0f6c3d7f003 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:43.669164 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab97d1-a23c-40f5-9311-a62330247d05 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:43.669777 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab97d1-a23c-40f5-9311-a62330247d05 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:43.670281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab97d1-a23c-40f5-9311-a62330247d05 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:43.674212 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 361/722] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:43.686152 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba954c-3c3b-4f26-a11e-5512882a6749 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:43.686749 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba954c-3c3b-4f26-a11e-5512882a6749 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:43.687257 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba954c-3c3b-4f26-a11e-5512882a6749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:43.716343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-76ba954c-3c3b-4f26-a11e-5512882a6749 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:43.719537 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-76ba954c-3c3b-4f26-a11e-5512882a6749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:43.759361 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aa798-2b87-4102-94c6-d0f6c3d7f003 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:43.828511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 362/723] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:43.837689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417492a-ab51-42d6-aa60-1c67274c5674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:43.838799 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417492a-ab51-42d6-aa60-1c67274c5674 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:43.839295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417492a-ab51-42d6-aa60-1c67274c5674 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:43.839800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417492a-ab51-42d6-aa60-1c67274c5674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:43.851400 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba954c-3c3b-4f26-a11e-5512882a6749 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:43.860389 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417492a-ab51-42d6-aa60-1c67274c5674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-e417492a-ab51-42d6-aa60-1c67274c5674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:43.871444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:43.872578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:43.873632 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:43.876946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 362/724] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:43.885201 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417492a-ab51-42d6-aa60-1c67274c5674 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:43.959689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba954c-3c3b-4f26-a11e-5512882a6749 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:43.996490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e397bc-46cd-494e-b014-ff139dbd6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:43.997252 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e397bc-46cd-494e-b014-ff139dbd6541 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:43.997605 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e397bc-46cd-494e-b014-ff139dbd6541 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:43.997949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e397bc-46cd-494e-b014-ff139dbd6541 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.010668 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e397bc-46cd-494e-b014-ff139dbd6541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-94e397bc-46cd-494e-b014-ff139dbd6541 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:44.018718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:44.019919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:44.021178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 363/725] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:44.026803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e397bc-46cd-494e-b014-ff139dbd6541 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.121977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417492a-ab51-42d6-aa60-1c67274c5674 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.135797 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e397bc-46cd-494e-b014-ff139dbd6541 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.189022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.189707 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.189996 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.190510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.191273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:44.191680 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:44.193132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:44.197852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.198601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.198888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.199172 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.199961 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:44.200271 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:44.201657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:44.218267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 363/726] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:44.220341 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 364/727] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:44.224942 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.229844 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.332473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056f1df-763a-4e9b-84a1-5a16cc06cdaf None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.332711 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e9f2a-b971-432a-acf8-07de2610467a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.373601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fbc04-db93-4a39-ad99-0e8294bd9b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.374536 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbc04-db93-4a39-ad99-0e8294bd9b2f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.374816 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbc04-db93-4a39-ad99-0e8294bd9b2f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.375001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.375154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fbc04-db93-4a39-ad99-0e8294bd9b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.375753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.376057 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.376327 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.388432 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fbc04-db93-4a39-ad99-0e8294bd9b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:44.390132 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fbc04-db93-4a39-ad99-0e8294bd9b2f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:44.392443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:44.394123 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-1c6fbc04-db93-4a39-ad99-0e8294bd9b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:44.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:44.408805 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:44.409810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:44.409810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:44.409810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:44.409810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:44.409810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 365/728] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:44.410548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b8b76-b225-4bcb-bfad-5d6e75230847 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.410888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b8b76-b225-4bcb-bfad-5d6e75230847 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.411162 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b8b76-b225-4bcb-bfad-5d6e75230847 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.412746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 366/729] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:44.416938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:44.418368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:44.419398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:44.419398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:44.419398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:44.419398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:44.421029 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 364/730] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:44.425188 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e07247-94d7-41c1-874c-b9959cacce19 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.426184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.426858 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e07247-94d7-41c1-874c-b9959cacce19 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.427138 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e07247-94d7-41c1-874c-b9959cacce19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.445490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-92e07247-94d7-41c1-874c-b9959cacce19 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:44.446879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-92e07247-94d7-41c1-874c-b9959cacce19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:44.515088 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 367/731] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:44.516371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e07247-94d7-41c1-874c-b9959cacce19 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.532104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b499f-9f08-4346-9c37-f78ab4248b2c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.566735 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef0883-5b79-41af-975c-e52480279f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.567407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef0883-5b79-41af-975c-e52480279f6c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.567691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef0883-5b79-41af-975c-e52480279f6c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.568007 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef0883-5b79-41af-975c-e52480279f6c None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.568737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef0883-5b79-41af-975c-e52480279f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:44.569047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef0883-5b79-41af-975c-e52480279f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:44.570422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef0883-5b79-41af-975c-e52480279f6c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:44.583011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 365/732] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:44.584671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4844-433a-4a05-9d21-f478cdbfa1d1 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.585178 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4844-433a-4a05-9d21-f478cdbfa1d1 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.585642 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e4844-433a-4a05-9d21-f478cdbfa1d1 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.591354 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 366/733] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:44.592522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e4844-433a-4a05-9d21-f478cdbfa1d1 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.640740 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e07247-94d7-41c1-874c-b9959cacce19 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.674807 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.675488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.675819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.676082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.676815 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:44.677125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:44.678494 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:44.694787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 368/734] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:44.694787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.700831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e4844-433a-4a05-9d21-f478cdbfa1d1 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.734032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904af91-c6f2-418e-b963-9042053bf365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.734831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904af91-c6f2-418e-b963-9042053bf365 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.735113 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904af91-c6f2-418e-b963-9042053bf365 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.735383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904af91-c6f2-418e-b963-9042053bf365 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.746903 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904af91-c6f2-418e-b963-9042053bf365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-0904af91-c6f2-418e-b963-9042053bf365 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:44.759610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:44.760907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:44.761831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:44.766265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 367/735] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:44.767982 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b1b6-c1be-48f5-b3ce-7ac9c9987bfd None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.768269 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b1b6-c1be-48f5-b3ce-7ac9c9987bfd None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.768547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3b1b6-c1be-48f5-b3ce-7ac9c9987bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.785712 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-9eb3b1b6-c1be-48f5-b3ce-7ac9c9987bfd None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:44.786897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-9eb3b1b6-c1be-48f5-b3ce-7ac9c9987bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:44.809723 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbfd8a-89d7-45d9-b5d9-4857d99a26a9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.842553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.843345 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.843849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.844131 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.851408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:44.853542 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:44.854507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 368/736] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:44.855364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3b1b6-c1be-48f5-b3ce-7ac9c9987bfd None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:44.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:44.868829 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:44.869896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:44.873244 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 369/737] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:44.874054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:44.954039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3b1b6-c1be-48f5-b3ce-7ac9c9987bfd None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.969628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec9f80-eab4-4ef5-b0a0-2cdedaffcf91 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:44.986985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4fcd3-b980-426a-9d4c-ee5b5186c879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:44.987813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4fcd3-b980-426a-9d4c-ee5b5186c879 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:44.988114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4fcd3-b980-426a-9d4c-ee5b5186c879 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:44.988391 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4fcd3-b980-426a-9d4c-ee5b5186c879 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:44.995386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4fcd3-b980-426a-9d4c-ee5b5186c879 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:44.996869 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4fcd3-b980-426a-9d4c-ee5b5186c879 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.001440 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.002105 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.002389 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.002668 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.003419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:45.003731 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.005113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-feb4fcd3-b980-426a-9d4c-ee5b5186c879 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:45.011494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:45.012688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:45.013752 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 369/738] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:45.014426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01800-18c2-4a0b-970b-2e4e985b5c24 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.014426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01800-18c2-4a0b-970b-2e4e985b5c24 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.014426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01800-18c2-4a0b-970b-2e4e985b5c24 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.015850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 370/739] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:45.017652 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 370/740] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:45.017774 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f01800-18c2-4a0b-970b-2e4e985b5c24 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.017869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.115746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05d363-1470-4a70-8fc2-df5360d682a0 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.119646 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f01800-18c2-4a0b-970b-2e4e985b5c24 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.148097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ad73f-72aa-4f02-adfd-3357338a6499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.148759 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ad73f-72aa-4f02-adfd-3357338a6499 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.149616 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ad73f-72aa-4f02-adfd-3357338a6499 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.149977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ad73f-72aa-4f02-adfd-3357338a6499 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.150695 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ad73f-72aa-4f02-adfd-3357338a6499 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.152435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ad73f-72aa-4f02-adfd-3357338a6499 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.152594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.153264 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.153651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.153936 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.154781 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:45.155094 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.156538 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.167128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 371/741] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:29:45 2022] POST /identity/v3/services => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:29:45.167988 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ad73f-72aa-4f02-adfd-3357338a6499 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.180595 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 371/742] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:45.180595 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.287295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0662fc-d11b-4de0-a421-95d2c893816d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.292426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ad73f-72aa-4f02-adfd-3357338a6499 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.326731 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.328188 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.328659 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.328817 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432bae5-ac17-466f-a277-46fa81f6569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.329302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.329510 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432bae5-ac17-466f-a277-46fa81f6569d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.329810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432bae5-ac17-466f-a277-46fa81f6569d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.330091 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432bae5-ac17-466f-a277-46fa81f6569d None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.330960 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432bae5-ac17-466f-a277-46fa81f6569d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:45.331276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432bae5-ac17-466f-a277-46fa81f6569d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.332781 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432bae5-ac17-466f-a277-46fa81f6569d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.342210 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.344133 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.353792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 372/743] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:45.355336 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915576e-9629-4990-b226-42285707a8a7 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.355629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915576e-9629-4990-b226-42285707a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.355941 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915576e-9629-4990-b226-42285707a8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:45.365005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:45.366153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:45.367311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:45.367311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:45.367311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:45.367311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:45.369169 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 372/744] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:45.370120 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.374949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-8915576e-9629-4990-b226-42285707a8a7 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:45.376404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-8915576e-9629-4990-b226-42285707a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:45.447290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 373/745] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:29:45.447953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915576e-9629-4990-b226-42285707a8a7 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.481930 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f114ea-089a-429d-8003-23b3bdd77a84 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.517040 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.517811 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.518094 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.518376 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.528680 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.530142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.545093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915576e-9629-4990-b226-42285707a8a7 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:45.547617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:45.548706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:45.554474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:45.554474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:45.554474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:45.554474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:45.554474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 373/746] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:45.554474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.593338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233c853-b3b7-4c09-b95c-7d9e0004a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.593997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233c853-b3b7-4c09-b95c-7d9e0004a943 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.594371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233c853-b3b7-4c09-b95c-7d9e0004a943 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.594725 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233c853-b3b7-4c09-b95c-7d9e0004a943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.676315 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa14e-b4f8-4408-8344-7af1542a1713 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.676575 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233c853-b3b7-4c09-b95c-7d9e0004a943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.677914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233c853-b3b7-4c09-b95c-7d9e0004a943 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.730657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.731366 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.731646 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.731951 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.732692 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:45.733001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.734519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.747433 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 374/747] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:45.748367 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.802179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 374/748] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:29:45.802179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233c853-b3b7-4c09-b95c-7d9e0004a943 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.860156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd1adf-b2e7-476d-9688-0f990da25522 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.893231 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee054b-e11c-43cd-8b8c-3593ab747b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.894218 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee054b-e11c-43cd-8b8c-3593ab747b30 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.894698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee054b-e11c-43cd-8b8c-3593ab747b30 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.895167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee054b-e11c-43cd-8b8c-3593ab747b30 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.896178 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee054b-e11c-43cd-8b8c-3593ab747b30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.896543 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233c853-b3b7-4c09-b95c-7d9e0004a943 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:45.897958 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee054b-e11c-43cd-8b8c-3593ab747b30 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.916286 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 375/749] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:29:45 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:29:45.917153 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee054b-e11c-43cd-8b8c-3593ab747b30 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:45.968612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:45.970193 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:45.970753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:45.971608 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:45.972910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:45.973610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:45.975538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:45.994089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 375/750] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:45.995447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.041219 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee054b-e11c-43cd-8b8c-3593ab747b30 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.082869 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.084231 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.085240 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.085674 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.097476 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.099728 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:46.120069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:46.121340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:29:46.122584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:46.124952 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 376/751] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:46.125908 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.127435 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee45919-44f9-4b7e-8124-cd48c7769086 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.177072 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.178152 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.178605 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.178909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.190431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.192375 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:46.215569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:46.216655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:46.217663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:46.217663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:46.217663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:46.217663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:46.217663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 376/752] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:46.218493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.256055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cf041-dead-438e-abdf-207f81ecc16d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.299086 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.300423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.300706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.300981 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.317304 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.319205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.334300 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2d41d-48c7-4d22-8b7f-9689a030d4b5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:46.339689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:46.340740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:46.341753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 377/753] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:46.342296 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.380641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.381641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.382118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.382606 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.384412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:46.384930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.386573 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.405286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 377/754] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:29:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:46.406515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.463002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39342e8-4b49-4046-9783-0e5873de0b5d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.497585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.498235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.498522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.498789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.499513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:46.499842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.501199 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.513349 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cfdfa-4147-4471-add0-53736fa24ba8 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.518146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 378/755] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:46.519068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.550879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.551934 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.552449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.552936 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.554127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:46.554639 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.556532 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.574677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 378/756] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:46.575922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.622030 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786183e-ba4f-4cb6-a23e-4b9ec6c719b7 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.656381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634b8d9-c1ed-433f-a7bf-46a4c8f5208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.656972 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634b8d9-c1ed-433f-a7bf-46a4c8f5208b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.657253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634b8d9-c1ed-433f-a7bf-46a4c8f5208b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634b8d9-c1ed-433f-a7bf-46a4c8f5208b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.681062 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270edda-86bb-4fe6-86e3-9b23133a2407 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.717053 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.718261 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.718795 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.719297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.726391 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634b8d9-c1ed-433f-a7bf-46a4c8f5208b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.726654 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.728131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634b8d9-c1ed-433f-a7bf-46a4c8f5208b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.728789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:46.744958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:46.746004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:46.747008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:46.747008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:46.747008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:46.747008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:46.747008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:46.747008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:46.747008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:46.747008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:46.754114 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 379/757] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:46.755207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.834668 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 379/758] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:29:46.835627 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634b8d9-c1ed-433f-a7bf-46a4c8f5208b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:46.945251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634b8d9-c1ed-433f-a7bf-46a4c8f5208b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:46.981025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:46.981695 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:46.981972 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:46.982283 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:46.983027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:46.983333 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:46.984919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:46.990753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fefb5-ae95-46e5-a818-ba0783d6f1d6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:47.001919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 380/759] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:47.001919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:47.031886 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01deca5-da2b-4fc3-bece-c074ced8effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:47.033133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01deca5-da2b-4fc3-bece-c074ced8effb None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:47.033622 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01deca5-da2b-4fc3-bece-c074ced8effb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:47.034100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01deca5-da2b-4fc3-bece-c074ced8effb None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/4be3545ab61f47aab2897c713fcc1c85/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:47.036367 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01deca5-da2b-4fc3-bece-c074ced8effb None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=4be3545ab61f47aab2897c713fcc1c85, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:47.038109 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01deca5-da2b-4fc3-bece-c074ced8effb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:47.055900 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 380/760] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:29:46 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/4be3545ab61f47aab2897c713fcc1c85/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:47.060285 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01deca5-da2b-4fc3-bece-c074ced8effb None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:47.105480 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7e18-9308-4e64-abff-cb1d1b7c9e8d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:47.143198 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:47.144051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:47.144331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:47.144604 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:47.157238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:47.163800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:47.179214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:47.181062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:47.182348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:47.182348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:47.182348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:47.182348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:47.182348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 381/761] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:47.187698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:47.252209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01deca5-da2b-4fc3-bece-c074ced8effb None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:47.294013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:47.294806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:47.295086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:47.295357 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:47.296421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=c2295621846d482fb6f705097415611e) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:47.296743 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:47.298364 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:47.304708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 381/762] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:47 2022] GET /identity/v3/role_assignments?user.id=c2295621846d482fb6f705097415611e&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=8cf832105b2949f6b11e06b208146326 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:47.372592 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396420d-b57b-4399-a721-d0d5e6bc2e9c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:47.414336 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e5179-9e98-4a15-986d-c48d04493217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:47.416428 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5179-9e98-4a15-986d-c48d04493217 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:47.416944 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5179-9e98-4a15-986d-c48d04493217 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:47.417436 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5179-9e98-4a15-986d-c48d04493217 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:47.418384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e5179-9e98-4a15-986d-c48d04493217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:47.418911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e5179-9e98-4a15-986d-c48d04493217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:47.420569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e5179-9e98-4a15-986d-c48d04493217 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:47.435851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 382/763] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:47.442679 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:47.574894 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cba5fd-9f35-4a81-babc-5f782f516848 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:47.575410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cba5fd-9f35-4a81-babc-5f782f516848 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:47.575410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cba5fd-9f35-4a81-babc-5f782f516848 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:47.578268 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 383/764] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:47.582379 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14298-0806-43f9-a808-b434159b206e None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:47.582672 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14298-0806-43f9-a808-b434159b206e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:47.582957 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14298-0806-43f9-a808-b434159b206e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:47.585201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434fb6-8634-4b48-92aa-41c24d03e6cd None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:47.600778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-14e14298-0806-43f9-a808-b434159b206e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:47.602601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-14e14298-0806-43f9-a808-b434159b206e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:47.646746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:47.647940 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:47.648430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:47.649543 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:47.665473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:47.667432 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:47.675883 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 384/765] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:47.692553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:47.693566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:47.694673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:47.694673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:47.694673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:47.694673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:47.694673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:47.694673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:47.694673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:47.694673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:47.699786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e14298-0806-43f9-a808-b434159b206e None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:47.701652 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 382/766] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:47.706869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:47.799301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e14298-0806-43f9-a808-b434159b206e None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:47.834591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:47.835327 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:47.835618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:47.835928 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:47.837288 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:47.838670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:47.851222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:47.853002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:47.853933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:47.858080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 385/767] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:29:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:47.859398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:47.931337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f859f-1e5d-493c-883d-d9545932df56 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:47.983251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a78b-1169-41b8-b90f-e75fc99f16f9 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:48.018222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:48.018896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.019181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.019459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.020206 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:48.020517 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:48.021268 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:48.021905 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:48.022372 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.022869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.023357 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.025306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:48.025846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:48.035785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:48.035973 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 386/768] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:29:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:48.035973 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:48.052997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 383/769] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:48.058557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:48.136943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9663c7e-daa3-4356-84f5-c3db2de73a0b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:48.171524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:48.172233 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.172518 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.172796 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.173517 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:48.173826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:48.175206 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:48.185677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 387/770] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:29:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:48.187050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:48.276692 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5008a-b07f-4189-ac36-7cb7440bec97 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:48.290404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1a19f-6fa8-4ce7-a394-cf2d9722dbec None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:48.329628 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:48.330307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.330588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.330865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.335795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] RBAC: Adding query filter params (interface=public, service_id=8e170e085f9447f98c8ccb096e03ac1b, region_id=RegionOne) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:48.335795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:48.335795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:48.347873 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 388/771] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:29:48 2022] GET /identity/v3/endpoints?service_id=8e170e085f9447f98c8ccb096e03ac1b&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:48.349184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:48.373258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8def0c-31b7-416a-9eae-92f91df4673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:48.373935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8def0c-31b7-416a-9eae-92f91df4673e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.374269 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8def0c-31b7-416a-9eae-92f91df4673e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.374540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8def0c-31b7-416a-9eae-92f91df4673e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.375438 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8def0c-31b7-416a-9eae-92f91df4673e None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=c38e81573ddf4e9289ffd3b73a0aa226) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:48.375749 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8def0c-31b7-416a-9eae-92f91df4673e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:48.377307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8def0c-31b7-416a-9eae-92f91df4673e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:48.392668 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 384/772] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:48 2022] GET /identity/v3/role_assignments?user.id=c38e81573ddf4e9289ffd3b73a0aa226&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:48.470971 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95cc78-f2a9-4682-9c82-8820182407ab None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:48.512305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470d77-cfd6-4593-8b96-e141e4022cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:48.513010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470d77-cfd6-4593-8b96-e141e4022cd1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.513298 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470d77-cfd6-4593-8b96-e141e4022cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.513575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470d77-cfd6-4593-8b96-e141e4022cd1 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.514287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470d77-cfd6-4593-8b96-e141e4022cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:48.515730 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470d77-cfd6-4593-8b96-e141e4022cd1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:48.526621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 389/773] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:29:48 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:48.634543 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124f6-7210-4753-bcad-889ef117da93 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.635113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124f6-7210-4753-bcad-889ef117da93 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.635113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124f6-7210-4753-bcad-889ef117da93 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.636550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 385/774] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:48.642569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a54e-bfa6-4578-9f2a-0aaa97469411 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.643073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a54e-bfa6-4578-9f2a-0aaa97469411 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.643178 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a54e-bfa6-4578-9f2a-0aaa97469411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.665659 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-65c2a54e-bfa6-4578-9f2a-0aaa97469411 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:48.666921 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-65c2a54e-bfa6-4578-9f2a-0aaa97469411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:48.756636 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 390/775] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:48.806755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3124f6-7210-4753-bcad-889ef117da93 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:48.921656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3124f6-7210-4753-bcad-889ef117da93 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:48.966354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:48.967164 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:48.967440 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:48.967732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] PATH_INFO: `/v3/services/network` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:48.968406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:48.969819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:48.983653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:48.986017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:48.987677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 386/776] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:48 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:48.996897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2a54e-bfa6-4578-9f2a-0aaa97469411 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:49.147095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2a54e-bfa6-4578-9f2a-0aaa97469411 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:49.195353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:49.196957 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:49.197230 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:49.197506 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:49.198233 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] RBAC: Adding query filter params (name=network) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:49.198541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:49.199948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:49.207850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 391/777] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:29:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:49.213449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:49.354269 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05038ff-989f-41b3-85e5-5e2107e391a0 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:49.411347 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:49.412053 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:49.412345 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:49.412604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:49.413321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] RBAC: Adding query filter params (type=network) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:49.413625 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:49.415950 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:49.421569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 387/778] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:29:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:49.427439 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:49.563535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d060d-2949-4150-9db4-74651b42747e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:49.602959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f116ae3-cde3-425e-b1c3-0471bdd4f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:49.603633 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f116ae3-cde3-425e-b1c3-0471bdd4f837 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:49.603943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f116ae3-cde3-425e-b1c3-0471bdd4f837 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:49.604217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f116ae3-cde3-425e-b1c3-0471bdd4f837 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:49.605030 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f116ae3-cde3-425e-b1c3-0471bdd4f837 None admin] RBAC: Adding query filter params (interface=public, service_id=dc8175b6971b4c4c9194b4950c2ee7a1, region_id=RegionOne) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:49.605343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f116ae3-cde3-425e-b1c3-0471bdd4f837 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:49.606712 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f116ae3-cde3-425e-b1c3-0471bdd4f837 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:49.612256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 392/779] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:29:49 2022] GET /identity/v3/endpoints?service_id=dc8175b6971b4c4c9194b4950c2ee7a1&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:49.617873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:49.751207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146794fa-1cfc-48f9-8042-4b888d391802 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:49.787102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b31e5-9b23-4010-92aa-54fd25722e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:49.788077 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b31e5-9b23-4010-92aa-54fd25722e06 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:49.788548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b31e5-9b23-4010-92aa-54fd25722e06 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:49.788993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b31e5-9b23-4010-92aa-54fd25722e06 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:49.789994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b31e5-9b23-4010-92aa-54fd25722e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:49.791605 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b31e5-9b23-4010-92aa-54fd25722e06 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:49.797548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 388/780] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:29:49 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:50.065962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26649e7-54d1-4391-9c90-e4cbe8ceb07a None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:50.067189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26649e7-54d1-4391-9c90-e4cbe8ceb07a None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:50.067740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26649e7-54d1-4391-9c90-e4cbe8ceb07a None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:50.069878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 393/781] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:50.075903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70373f87-7916-411c-acbc-6f58e0d62e8e None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:50.076551 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70373f87-7916-411c-acbc-6f58e0d62e8e None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:50.077043 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70373f87-7916-411c-acbc-6f58e0d62e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:50.095062 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-70373f87-7916-411c-acbc-6f58e0d62e8e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:50.096685 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-70373f87-7916-411c-acbc-6f58e0d62e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:50.173773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 389/782] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:50.198002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26649e7-54d1-4391-9c90-e4cbe8ceb07a None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:50.310466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26649e7-54d1-4391-9c90-e4cbe8ceb07a None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:50.344267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074f3fd-ab3d-46bd-adbe-300ca754115b None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:50.344884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074f3fd-ab3d-46bd-adbe-300ca754115b None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:50.345465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074f3fd-ab3d-46bd-adbe-300ca754115b None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:50.347340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 390/783] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:50.353032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc409b6-9053-4283-ac9d-91d22ef820ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:50.353655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b3dcf-5759-4e85-8bda-caa5a4088e8e None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:50.353847 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc409b6-9053-4283-ac9d-91d22ef820ab None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:50.354108 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc409b6-9053-4283-ac9d-91d22ef820ab None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:50.354381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc409b6-9053-4283-ac9d-91d22ef820ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:50.354780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b3dcf-5759-4e85-8bda-caa5a4088e8e None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:50.355274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b3dcf-5759-4e85-8bda-caa5a4088e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:50.376349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc409b6-9053-4283-ac9d-91d22ef820ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-1fc409b6-9053-4283-ac9d-91d22ef820ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:50.390766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:50.391891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:50.392877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:50.395207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-236b3dcf-5759-4e85-8bda-caa5a4088e8e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:50.396670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-236b3dcf-5759-4e85-8bda-caa5a4088e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:50.400093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 394/784] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:50.407170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc409b6-9053-4283-ac9d-91d22ef820ab None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:50.531087 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 391/785] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:50.553666 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b3dcf-5759-4e85-8bda-caa5a4088e8e None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:50.622134 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc409b6-9053-4283-ac9d-91d22ef820ab None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:50.679986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b3dcf-5759-4e85-8bda-caa5a4088e8e None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:50.696998 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:50.697685 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:50.698011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:50.698306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:50.699091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:50.699399 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:50.700805 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:50.719147 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 395/786] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:50.719550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83814c58-fc76-4b53-b3be-9d2604f16bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:50.720659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814c58-fc76-4b53-b3be-9d2604f16bc4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:50.721156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814c58-fc76-4b53-b3be-9d2604f16bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:50.721670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814c58-fc76-4b53-b3be-9d2604f16bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:50.724329 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:50.735565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83814c58-fc76-4b53-b3be-9d2604f16bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-83814c58-fc76-4b53-b3be-9d2604f16bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:50.744653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:50.745722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:50.746657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:50.749517 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 392/787] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:50.755593 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83814c58-fc76-4b53-b3be-9d2604f16bc4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:50.866081 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83814c58-fc76-4b53-b3be-9d2604f16bc4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:50.901948 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:50.903002 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:50.903516 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:50.904054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:50.905050 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:50.905595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:50.907188 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:50.917680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 393/788] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:50.923895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:50.999569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9714a-9848-4c3e-bdf3-ead7c90d3177 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.033300 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb750-3c50-4217-a0c9-879b620f7f9d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.069856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.071411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.071985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.072518 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.083809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.085665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.091084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c7f65-06e9-4f87-9c74-c86b20b80944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.091924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c7f65-06e9-4f87-9c74-c86b20b80944 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.092203 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c7f65-06e9-4f87-9c74-c86b20b80944 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.092472 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c7f65-06e9-4f87-9c74-c86b20b80944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:51.106022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:51.107082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:51.108128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:51.108128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:51.108128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:51.108128 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:51.110444 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 394/789] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:51.116053 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c7f65-06e9-4f87-9c74-c86b20b80944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.117195 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.120160 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c7f65-06e9-4f87-9c74-c86b20b80944 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-0d8c7f65-06e9-4f87-9c74-c86b20b80944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:51.167322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:51.168407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:51.169418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:51.169418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:51.169418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:51.169418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:51.169418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 396/790] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:51.171466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293377-86d5-4249-a447-6213ff231a70 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.171961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293377-86d5-4249-a447-6213ff231a70 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.175561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293377-86d5-4249-a447-6213ff231a70 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.176255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 397/791] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:51.177425 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0293377-86d5-4249-a447-6213ff231a70 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.244358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5d5ee-87c5-4fa7-a76e-2d4711372e44 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.279932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f819e-1663-4a2a-a208-4e6d2950d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.280613 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f819e-1663-4a2a-a208-4e6d2950d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.280954 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f819e-1663-4a2a-a208-4e6d2950d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.281240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f819e-1663-4a2a-a208-4e6d2950d2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.281999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f819e-1663-4a2a-a208-4e6d2950d2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:51.282667 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f819e-1663-4a2a-a208-4e6d2950d2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.283844 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f819e-1663-4a2a-a208-4e6d2950d2a8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.297183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 395/792] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:51.298558 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78defc-955c-4239-8395-2b4510cd0c77 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.298851 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78defc-955c-4239-8395-2b4510cd0c77 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.299127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78defc-955c-4239-8395-2b4510cd0c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.310864 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0293377-86d5-4249-a447-6213ff231a70 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.322086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-ab78defc-955c-4239-8395-2b4510cd0c77 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:51.323348 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-ab78defc-955c-4239-8395-2b4510cd0c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:51.347072 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.348187 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.348723 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.349202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.350147 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:51.350656 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.352466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.365154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 398/793] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:51.366368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.393689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 396/794] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:51.395316 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d696-42d5-462e-a369-28ec346ed6bd None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.395775 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d696-42d5-462e-a369-28ec346ed6bd None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.396094 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d696-42d5-462e-a369-28ec346ed6bd None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.401645 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 397/795] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:51.401645 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d696-42d5-462e-a369-28ec346ed6bd None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.483055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23c1f-a5b4-47cd-b66f-2790dcd96b9d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.513060 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188d696-42d5-462e-a369-28ec346ed6bd None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.517483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3706-69ec-4277-81b4-f2a6fd5a8d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.518292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3706-69ec-4277-81b4-f2a6fd5a8d1d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.518578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3706-69ec-4277-81b4-f2a6fd5a8d1d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.518853 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3706-69ec-4277-81b4-f2a6fd5a8d1d None admin] PATH_INFO: `/v3/users/swift` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.526562 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b3706-69ec-4277-81b4-f2a6fd5a8d1d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.528072 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b3706-69ec-4277-81b4-f2a6fd5a8d1d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-3f5b3706-69ec-4277-81b4-f2a6fd5a8d1d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:51.542717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:51.543879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:51.544946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 399/796] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:51.545606 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ef4d9-b690-490b-be7b-039a150cc974 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.545606 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ef4d9-b690-490b-be7b-039a150cc974 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.545740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ef4d9-b690-490b-be7b-039a150cc974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.553188 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.554163 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.554453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.554732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.562740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-618ef4d9-b690-490b-be7b-039a150cc974 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:51.563026 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.563949 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-618ef4d9-b690-490b-be7b-039a150cc974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:51.564289 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:51.579734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:51.587001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 398/797] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:51.589325 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.645532 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 400/798] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:51.646625 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ef4d9-b690-490b-be7b-039a150cc974 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.687139 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccf841-ea6a-4741-a219-5664cf844725 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.724137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595c78-604d-435d-a0f1-c23bd1b618e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.725008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595c78-604d-435d-a0f1-c23bd1b618e5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.725298 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595c78-604d-435d-a0f1-c23bd1b618e5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.725574 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595c78-604d-435d-a0f1-c23bd1b618e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.735681 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb595c78-604d-435d-a0f1-c23bd1b618e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-eb595c78-604d-435d-a0f1-c23bd1b618e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:51.743419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:51.744670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:51.745641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 399/799] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:51.746423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595c78-604d-435d-a0f1-c23bd1b618e5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.765177 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ef4d9-b690-490b-be7b-039a150cc974 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.798454 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.799122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.799401 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.799670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.800541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:51.800857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.802272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.824476 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 401/800] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:51.824476 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.850323 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595c78-604d-435d-a0f1-c23bd1b618e5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.884796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.885475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.885761 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.886036 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.886888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:51.887202 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.888677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.910711 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 400/801] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:51.910711 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:51.919451 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71704eb9-1884-4a0a-a04b-94bbe3951201 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:51.952908 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:51.953719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:51.953998 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:51.954268 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:51.954922 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:51.956319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:51.968878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:51.969948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:51.970937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 402/802] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:51.972069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.015567 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6a685-113b-4f07-a528-24d62a8d254c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.049269 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.049949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.050236 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.050516 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.051277 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:52.051592 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.053097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.061842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 401/803] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:52.062787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.075636 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ea213-ef16-4759-bc07-8b09fc0710c1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.109729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.110529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.110812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.111084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.122637 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.124113 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:52.141146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:52.142251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:52.143353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:52.143353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:52.143353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:52.143353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:52.143353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 403/804] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:52.143353 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.171078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc961e1f-e501-4e3d-b844-0e05a1ac2814 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.203687 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3953da-e0ff-41d6-ac98-52809bbaec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.204377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3953da-e0ff-41d6-ac98-52809bbaec5a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.204661 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3953da-e0ff-41d6-ac98-52809bbaec5a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.204938 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3953da-e0ff-41d6-ac98-52809bbaec5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.243119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c258ae1-3fff-4b0a-ab70-7c58f2981de5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.277916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.278276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3953da-e0ff-41d6-ac98-52809bbaec5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.278748 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.279130 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.279505 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.279729 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3953da-e0ff-41d6-ac98-52809bbaec5a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.280443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:52.280872 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.282339 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.286992 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 404/805] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:52.287986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.385030 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 402/806] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:29:52.386152 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3953da-e0ff-41d6-ac98-52809bbaec5a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.395693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16a463-32be-4ee0-ba47-c2ca672ad93d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.436639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.437458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.437754 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.438086 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.449424 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.450910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:52.467836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:52.469033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:52.470277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:52.470277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:52.470277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:52.470277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:52.472184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 405/807] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:52.473282 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.493251 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3953da-e0ff-41d6-ac98-52809bbaec5a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.526773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.527436 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.527712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.528055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.528734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:52.529093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.530475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.541976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 403/808] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:52.542792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.585186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9349d-ac8d-4cce-9b2b-8204ca20a0dd None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.619530 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.620228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.620512 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.620789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.621503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:52.621813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.623186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.627933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 406/809] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:52.628710 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.641208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1595235-feeb-4513-8f2f-8b1730715f46 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.673339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.674124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.674401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.674670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.685361 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.686786 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:52.703446 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:52.704632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:52.710566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:52.710566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:52.710566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:52.710566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:52.710566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 404/810] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:52.710566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.725605 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69d03d-beb8-4792-9b6f-f5c791f08700 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.758964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609947c-4796-4552-8944-a04980097bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.759617 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609947c-4796-4552-8944-a04980097bee None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.760055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609947c-4796-4552-8944-a04980097bee None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.760326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609947c-4796-4552-8944-a04980097bee None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.761046 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609947c-4796-4552-8944-a04980097bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:52.761348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609947c-4796-4552-8944-a04980097bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.762692 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609947c-4796-4552-8944-a04980097bee None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.774457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 407/811] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:52.775994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffe49-2e9d-4648-8cf8-673371f84af0 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.776280 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffe49-2e9d-4648-8cf8-673371f84af0 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.776553 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffe49-2e9d-4648-8cf8-673371f84af0 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.777947 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 408/812] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:52.779891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ffe49-2e9d-4648-8cf8-673371f84af0 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.806493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0c091-6b51-4986-95c5-6a86546fedee None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.838796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.839581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.839897 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.840162 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.846966 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.848464 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:52.864813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:52.866403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 405/813] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:52.867467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.883969 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ffe49-2e9d-4648-8cf8-673371f84af0 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:52.918121 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906089-3c61-471e-801e-14ac68af201f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:52.918753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906089-3c61-471e-801e-14ac68af201f None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:52.919029 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906089-3c61-471e-801e-14ac68af201f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:52.919301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906089-3c61-471e-801e-14ac68af201f None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:52.920069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906089-3c61-471e-801e-14ac68af201f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:52.921422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906089-3c61-471e-801e-14ac68af201f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:52.940698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 409/814] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:29:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:29:52.941513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906089-3c61-471e-801e-14ac68af201f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:52.974802 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d934a-8bc2-4f89-95f8-9661ae5ad936 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.018923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac3955-67d5-4d57-bf25-d1ec50b94acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.019931 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac3955-67d5-4d57-bf25-d1ec50b94acb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.020364 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac3955-67d5-4d57-bf25-d1ec50b94acb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.020814 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac3955-67d5-4d57-bf25-d1ec50b94acb None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.021715 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac3955-67d5-4d57-bf25-d1ec50b94acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:53.022176 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac3955-67d5-4d57-bf25-d1ec50b94acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.024240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac3955-67d5-4d57-bf25-d1ec50b94acb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.042665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 406/815] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:53.042665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12819-54eb-49fa-bb2b-7717250e0cea None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.042665 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12819-54eb-49fa-bb2b-7717250e0cea None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.043144 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c12819-54eb-49fa-bb2b-7717250e0cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.056441 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906089-3c61-471e-801e-14ac68af201f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.061394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-67c12819-54eb-49fa-bb2b-7717250e0cea None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:53.062615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-67c12819-54eb-49fa-bb2b-7717250e0cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:53.093863 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.094876 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.095265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.095645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.104943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.106622 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:53.122249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:53.124176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 410/816] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:29:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:53.130813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.137153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 407/817] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:53.138385 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12819-54eb-49fa-bb2b-7717250e0cea None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.229478 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4717fb6-259b-47cc-8036-7aa3b1b3f6e1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.237547 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c12819-54eb-49fa-bb2b-7717250e0cea None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.263024 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.263884 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.264299 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.264676 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.265577 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:53.265988 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.267516 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.271789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.272594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.272874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.273147 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.280612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.282104 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.286483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 411/818] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:53.287488 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:53.296736 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:53.297888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 408/819] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:53.304051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.402539 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3dedd-a6e9-48f6-a85d-74393ad02c78 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.404453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df1c0-d240-480a-8216-7884d5dbbe76 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.438468 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.439137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.439417 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.439625 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.439743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.440808 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:53.440930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.441113 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.441413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.441784 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] PATH_INFO: `/v3/services/network` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.442543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.442643 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.444091 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:53.455820 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:53.457011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:29:53.457946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:53.460082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 409/820] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:53.461111 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.462855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 412/821] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:53.463966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.567034 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e0e1a-47b5-457e-88b3-e7335f697763 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.568275 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cf6da-496d-4236-9b17-e8138ae3427b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.601545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9061-07d5-4475-9e5a-eb98ad07ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.601821 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.602523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.602673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9061-07d5-4475-9e5a-eb98ad07ca2c None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.602775 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9061-07d5-4475-9e5a-eb98ad07ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.602877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.603045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9061-07d5-4475-9e5a-eb98ad07ca2c None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/c2295621846d482fb6f705097415611e/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.603254 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.604320 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:53.604666 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.605012 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9061-07d5-4475-9e5a-eb98ad07ca2c None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=c2295621846d482fb6f705097415611e, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.606222 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.606434 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9061-07d5-4475-9e5a-eb98ad07ca2c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.619853 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 413/822] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:53.621169 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 410/823] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:29:53 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/c2295621846d482fb6f705097415611e/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:53.625365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.632954 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9061-07d5-4475-9e5a-eb98ad07ca2c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.741271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043204ea-33f1-45c1-8c07-a74f38cd68bf None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.749482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9061-07d5-4475-9e5a-eb98ad07ca2c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.780372 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.781336 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.781336 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.781640 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.782295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] RBAC: Adding query filter params (name=network) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:53.782601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.784016 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.790370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 414/824] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:53.791520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.792649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.793732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.794230 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.794732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.806955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.808841 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:53.829597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:53.830880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:53.832148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:53.832148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:53.832148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:53.832148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:53.833214 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 411/825] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:53.834125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:53.912593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1671c-83f5-4263-9271-fe4d09b8c33d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.947520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:53.948221 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:53.948506 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:53.948784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:53.949619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=4be3545ab61f47aab2897c713fcc1c85) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:53.949931 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:53.951013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da113d6-3a7e-48cf-a0a0-22791a3392ad None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:53.951480 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:53.958374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 415/826] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/role_assignments?user.id=4be3545ab61f47aab2897c713fcc1c85&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=8cf832105b2949f6b11e06b208146326 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:53.963883 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:54.028651 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:54.029601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:54.030066 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:54.030489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:54.031352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] RBAC: Adding query filter params (type=network) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:54.031827 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:54.033367 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:54.042653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 412/827] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:54.048337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:54.067755 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cc593-9c37-4687-a414-eca23f892308 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:54.106643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:54.107244 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:54.107528 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:54.107825 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:54.108572 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:54.108878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:54.110336 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:54.124757 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 416/828] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:54.130314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:54.241543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7edd5-50cf-4464-a86c-71d65e891cc6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:54.243691 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a53547-21cd-4a50-bcc9-db5c10ad21d9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:54.285068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:54.285875 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:54.286160 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:54.286437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:54.288960 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44ecd-5e76-4e7f-9b6c-3eb501f3d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:54.290549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44ecd-5e76-4e7f-9b6c-3eb501f3d748 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:54.291011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44ecd-5e76-4e7f-9b6c-3eb501f3d748 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:54.291604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44ecd-5e76-4e7f-9b6c-3eb501f3d748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:54.292578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa44ecd-5e76-4e7f-9b6c-3eb501f3d748 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:54.295216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa44ecd-5e76-4e7f-9b6c-3eb501f3d748 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:54.295364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:54.295791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:54.313139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:54.314419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:54.315937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 417/829] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:54.320658 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:54.324851 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 413/830] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:29:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:29:54.454526 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a291f4d-bf28-4c80-a363-8c25eb75b21a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:54.509697 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff3072-5967-44da-b665-b37da9b93d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:54.510612 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff3072-5967-44da-b665-b37da9b93d27 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:54.511008 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff3072-5967-44da-b665-b37da9b93d27 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:54.511420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff3072-5967-44da-b665-b37da9b93d27 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:54.512408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff3072-5967-44da-b665-b37da9b93d27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:54.512836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff3072-5967-44da-b665-b37da9b93d27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:54.514489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff3072-5967-44da-b665-b37da9b93d27 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:54.528486 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 418/831] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:54.534429 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44ecd-5e76-4e7f-9b6c-3eb501f3d748 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:54.644282 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44ecd-5e76-4e7f-9b6c-3eb501f3d748 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:54.682171 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c914ec-37c3-4c23-9b66-0f0da930ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:54.683069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c914ec-37c3-4c23-9b66-0f0da930ef6c None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:54.683349 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c914ec-37c3-4c23-9b66-0f0da930ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:54.683621 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c914ec-37c3-4c23-9b66-0f0da930ef6c None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/c38e81573ddf4e9289ffd3b73a0aa226/roles/0dc5507e726a48198da466396f551a22` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:54.699426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c914ec-37c3-4c23-9b66-0f0da930ef6c None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=c38e81573ddf4e9289ffd3b73a0aa226, role_id=0dc5507e726a48198da466396f551a22)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:54.700914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c914ec-37c3-4c23-9b66-0f0da930ef6c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:54.718506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 414/832] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:29:54 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/c38e81573ddf4e9289ffd3b73a0aa226/roles/0dc5507e726a48198da466396f551a22 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:29:55.355714 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872637e0-db8d-4053-b8a0-91e84c36c4a0 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:55.356308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872637e0-db8d-4053-b8a0-91e84c36c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:55.356308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872637e0-db8d-4053-b8a0-91e84c36c4a0 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:55.357934 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 419/833] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:55.363429 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4d59-d528-44db-87a1-503ad1563403 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:55.363904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4d59-d528-44db-87a1-503ad1563403 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:55.364125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a4d59-d528-44db-87a1-503ad1563403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:55.387796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-bc2a4d59-d528-44db-87a1-503ad1563403 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:55.387796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-bc2a4d59-d528-44db-87a1-503ad1563403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:55.462788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 415/834] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:55.483361 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872637e0-db8d-4053-b8a0-91e84c36c4a0 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:55.598320 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872637e0-db8d-4053-b8a0-91e84c36c4a0 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:55.635984 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:55.637191 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:55.637712 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:55.638208 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:55.639104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:55.640720 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:55.653803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:55.654974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:29:55.655975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:55.663868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 420/835] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:29:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:55.667313 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4d59-d528-44db-87a1-503ad1563403 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:55.770534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a4d59-d528-44db-87a1-503ad1563403 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:55.809050 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1bfd4-e58d-444e-9b6a-ee0c3839e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:55.810113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bfd4-e58d-444e-9b6a-ee0c3839e29b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:55.810620 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bfd4-e58d-444e-9b6a-ee0c3839e29b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:55.811112 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1bfd4-e58d-444e-9b6a-ee0c3839e29b None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:55.812082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1bfd4-e58d-444e-9b6a-ee0c3839e29b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:55.812613 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1bfd4-e58d-444e-9b6a-ee0c3839e29b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:55.814219 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1bfd4-e58d-444e-9b6a-ee0c3839e29b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:55.823944 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 416/836] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:29:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:55.825504 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:55.930834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4e8c6-7b28-4ed4-8070-1d9ebeaf89b7 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:55.972303 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8af66e-4e7c-4ab7-baa9-a1237f05fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:55.973605 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8af66e-4e7c-4ab7-baa9-a1237f05fc12 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:55.974164 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8af66e-4e7c-4ab7-baa9-a1237f05fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:55.974663 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8af66e-4e7c-4ab7-baa9-a1237f05fc12 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:55.975626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8af66e-4e7c-4ab7-baa9-a1237f05fc12 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:55.976215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8af66e-4e7c-4ab7-baa9-a1237f05fc12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:55.978282 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8af66e-4e7c-4ab7-baa9-a1237f05fc12 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:55.989244 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 421/837] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:29:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:56.155045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc383-1ca4-4bac-b87c-22325f1237f0 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:56.155434 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc383-1ca4-4bac-b87c-22325f1237f0 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:56.155860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc383-1ca4-4bac-b87c-22325f1237f0 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:56.157723 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 417/838] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:56.163393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a602a-3623-44bc-ac81-e7bd631fde11 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:56.163919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a602a-3623-44bc-ac81-e7bd631fde11 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:56.164407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a602a-3623-44bc-ac81-e7bd631fde11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:56.183823 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-758a602a-3623-44bc-ac81-e7bd631fde11 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:56.185260 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-758a602a-3623-44bc-ac81-e7bd631fde11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:56.254663 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 422/839] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:56.278576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc383-1ca4-4bac-b87c-22325f1237f0 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:56.390539 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc383-1ca4-4bac-b87c-22325f1237f0 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:56.425935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01a9f-6153-4acf-9fb5-43ed19e8da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:56.427033 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01a9f-6153-4acf-9fb5-43ed19e8da51 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:56.427469 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01a9f-6153-4acf-9fb5-43ed19e8da51 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:56.427974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01a9f-6153-4acf-9fb5-43ed19e8da51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:56.440776 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e01a9f-6153-4acf-9fb5-43ed19e8da51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-24e01a9f-6153-4acf-9fb5-43ed19e8da51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:56.448993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:56.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:29:56.451401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:56.454202 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 418/840] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:56.460595 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a602a-3623-44bc-ac81-e7bd631fde11 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:56.567214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a602a-3623-44bc-ac81-e7bd631fde11 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:56.603532 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97532e4a-a64c-4cb6-8e03-338a3a3eeecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:56.604248 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532e4a-a64c-4cb6-8e03-338a3a3eeecd None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:56.604590 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532e4a-a64c-4cb6-8e03-338a3a3eeecd None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:56.604868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532e4a-a64c-4cb6-8e03-338a3a3eeecd None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:56.605626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97532e4a-a64c-4cb6-8e03-338a3a3eeecd None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:56.605937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97532e4a-a64c-4cb6-8e03-338a3a3eeecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:56.607323 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97532e4a-a64c-4cb6-8e03-338a3a3eeecd None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:56.616413 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 423/841] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:29:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:56.625197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01a9f-6153-4acf-9fb5-43ed19e8da51 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:56.655135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153bade-20f2-4c64-ac3a-e02befb7c6ec None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:56.655474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153bade-20f2-4c64-ac3a-e02befb7c6ec None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:56.655707 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153bade-20f2-4c64-ac3a-e02befb7c6ec None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:56.658185 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 424/842] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:29:56.665609 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0299a0-08ac-495a-93d8-c526caa30e8c None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:56.665899 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0299a0-08ac-495a-93d8-c526caa30e8c None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:56.666177 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0299a0-08ac-495a-93d8-c526caa30e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:56.687857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-6f0299a0-08ac-495a-93d8-c526caa30e8c None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:56.689361 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-6f0299a0-08ac-495a-93d8-c526caa30e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:56.737077 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01a9f-6153-4acf-9fb5-43ed19e8da51 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:56.772931 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 425/843] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:29:56.788480 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:56.789310 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:56.789590 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:56.789863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:56.798942 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0299a0-08ac-495a-93d8-c526caa30e8c None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:56.801431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:56.802966 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:56.822143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:56.823142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:56.824203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:56.824203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:56.824203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:56.824203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:56.824203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 419/844] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:56.829136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:56.923466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0299a0-08ac-495a-93d8-c526caa30e8c None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:56.943873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f190a-f9cf-4ee0-99a4-de3937379950 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:56.965486 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:56.967721 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:56.968091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:56.968374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:56.969092 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:56.970587 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:56.985342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:56.986557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:56.994850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 426/845] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:29:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:56.998789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:57.002259 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.003102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.003449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.003815 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.005295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:57.005295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:57.006376 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:57.019262 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 420/846] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:57.024994 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:57.130334 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb424c00-2c20-48d9-9f29-16be08c1d03d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:57.137889 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db595e22-3acb-4a29-9fa9-c778ebd3a03e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:57.172569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2919d-8020-41c1-a873-39cba3d43ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.173571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2919d-8020-41c1-a873-39cba3d43ea3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.173926 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2919d-8020-41c1-a873-39cba3d43ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.174406 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2919d-8020-41c1-a873-39cba3d43ea3 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.175034 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2919d-8020-41c1-a873-39cba3d43ea3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:57.175416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2919d-8020-41c1-a873-39cba3d43ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:57.176897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2919d-8020-41c1-a873-39cba3d43ea3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:57.187473 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 427/847] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:29:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:57.187680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2d500-eff5-4ef4-95dc-44efe151ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.187680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d500-eff5-4ef4-95dc-44efe151ed74 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.187943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e443-2d3a-4e63-83aa-4607bd9747c9 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.188040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d500-eff5-4ef4-95dc-44efe151ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.188142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e443-2d3a-4e63-83aa-4607bd9747c9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.188235 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d500-eff5-4ef4-95dc-44efe151ed74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.188334 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e443-2d3a-4e63-83aa-4607bd9747c9 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.188334 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 428/848] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:57.192225 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e443-2d3a-4e63-83aa-4607bd9747c9 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:57.200042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2d500-eff5-4ef4-95dc-44efe151ed74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:57.201505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2d500-eff5-4ef4-95dc-44efe151ed74 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-b1c2d500-eff5-4ef4-95dc-44efe151ed74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:57.217201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:57.218301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:29:57.219623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:57.223827 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 421/849] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:29:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:57.225090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89925249-7b73-412d-bd4a-a4ebd86362d5 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.225378 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89925249-7b73-412d-bd4a-a4ebd86362d5 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.225650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89925249-7b73-412d-bd4a-a4ebd86362d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.248437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-89925249-7b73-412d-bd4a-a4ebd86362d5 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:57.249766 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-89925249-7b73-412d-bd4a-a4ebd86362d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:57.312373 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e443-2d3a-4e63-83aa-4607bd9747c9 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:57.334275 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 422/850] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:57.335020 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89925249-7b73-412d-bd4a-a4ebd86362d5 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:57.351339 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.353728 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.354228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.354718 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.356031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:57.356919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:57.359729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:57.366661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 429/851] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:29:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:57.368676 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:57.486097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89925249-7b73-412d-bd4a-a4ebd86362d5 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:57.526308 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e25c6-927f-4359-98cd-d9f543c0fd6f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:57.538139 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.539125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.539663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.540175 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.541241 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:57.541813 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:57.543802 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:57.568426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec09f-7bd9-4961-869b-e7fea0c215d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.569371 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec09f-7bd9-4961-869b-e7fea0c215d5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.569776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec09f-7bd9-4961-869b-e7fea0c215d5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.570068 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfec09f-7bd9-4961-869b-e7fea0c215d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.575671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 423/852] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:29:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:57.577150 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:57.594610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfec09f-7bd9-4961-869b-e7fea0c215d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-ccfec09f-7bd9-4961-869b-e7fea0c215d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:29:57.606507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:57.607915 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:57.609629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 430/853] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:29:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:57.615979 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec09f-7bd9-4961-869b-e7fea0c215d5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:57.710706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14495bd4-9ade-4058-8026-90a5325df789 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:57.738355 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfec09f-7bd9-4961-869b-e7fea0c215d5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:57.754125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3479e4-73a4-4d44-a5a7-5b9b5d9b620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.754791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3479e4-73a4-4d44-a5a7-5b9b5d9b620a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.755072 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3479e4-73a4-4d44-a5a7-5b9b5d9b620a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.755352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3479e4-73a4-4d44-a5a7-5b9b5d9b620a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.779657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.782221 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.782502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.782781 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:57.784568 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:57.784880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:57.787172 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:57.796936 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 431/854] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:29:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:57.803601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:57.852506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3479e4-73a4-4d44-a5a7-5b9b5d9b620a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:57.855565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3479e4-73a4-4d44-a5a7-5b9b5d9b620a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:57.949785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0a3e6-9273-4c98-b3b9-05d33026419f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:57.998457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:57.999264 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:57.999548 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:57.999884 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.002457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 424/855] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:29:58.013221 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.014689 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.017087 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3479e4-73a4-4d44-a5a7-5b9b5d9b620a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:58.033236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:58.034305 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:58.035307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:58.035307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:58.035307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:58.035307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:58.035307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 432/856] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:58.040256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.130015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3479e4-73a4-4d44-a5a7-5b9b5d9b620a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.153116 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0d17-e28b-4b79-b389-bb89dceff6e0 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.167252 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.168220 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.168578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.168949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.180393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.181960 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.187615 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.188317 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.188596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.188870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.189597 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:58.189899 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.191503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:58.201198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:58.203379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:58.205698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:58.205698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:58.205698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:58.205698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:58.209794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 425/858] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:58.210089 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 433/858] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:58.210274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.210442 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.320032 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f47a7e-984a-4592-a1c8-8bbe4a454a7b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.331652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13986abf-6fd7-4a41-b54f-1892e406a065 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.358810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.359488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.359811 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.360063 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.360811 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:58.361124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.362514 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.385228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc4552-7abe-4f75-b62d-b9259c789202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.385228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc4552-7abe-4f75-b62d-b9259c789202 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.385228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc4552-7abe-4f75-b62d-b9259c789202 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.385228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc4552-7abe-4f75-b62d-b9259c789202 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.385981 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 426/859] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:58.387047 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.390722 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc4552-7abe-4f75-b62d-b9259c789202 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.392340 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc4552-7abe-4f75-b62d-b9259c789202 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-55fc4552-7abe-4f75-b62d-b9259c789202 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:29:58.416719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:58.419163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 434/860] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164d520-66da-4c4b-84f3-3d4685748c0f None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.421652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164d520-66da-4c4b-84f3-3d4685748c0f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.428168 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164d520-66da-4c4b-84f3-3d4685748c0f None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.428168 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 435/861] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:58.428168 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164d520-66da-4c4b-84f3-3d4685748c0f None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.513153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcd3f3-1898-49f4-b229-1321af4cf31c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.526807 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164d520-66da-4c4b-84f3-3d4685748c0f None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.546292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c95db8-6556-4bb5-83d4-b136d89bc8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.547090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c95db8-6556-4bb5-83d4-b136d89bc8a1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.547374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c95db8-6556-4bb5-83d4-b136d89bc8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.547649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c95db8-6556-4bb5-83d4-b136d89bc8a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.554423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c95db8-6556-4bb5-83d4-b136d89bc8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.556486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c95db8-6556-4bb5-83d4-b136d89bc8a1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.563599 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.564292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.564569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.564838 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.565933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:58.566236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.567639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-29c95db8-6556-4bb5-83d4-b136d89bc8a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:58.571146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:58.572170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:58.573772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 427/862] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:58.574358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd3bc1-5f8d-4cf0-b498-b77ca9942285 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.574358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd3bc1-5f8d-4cf0-b498-b77ca9942285 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.574520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd3bc1-5f8d-4cf0-b498-b77ca9942285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.594684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 436/863] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:58.594920 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-f3dd3bc1-5f8d-4cf0-b498-b77ca9942285 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:58.595031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.595132 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-f3dd3bc1-5f8d-4cf0-b498-b77ca9942285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:58.661231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 428/864] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:29:58.662086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd3bc1-5f8d-4cf0-b498-b77ca9942285 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.706255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e86b4-48a9-4665-8405-0d80b2ca9e51 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.744597 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.745280 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.745567 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.745847 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.746649 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:58.746959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.748520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.761115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 437/865] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:58.762057 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:58.782179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd3bc1-5f8d-4cf0-b498-b77ca9942285 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.817459 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8cda-ad92-4f7b-8849-d5e029e84460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.818118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8cda-ad92-4f7b-8849-d5e029e84460 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.818408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8cda-ad92-4f7b-8849-d5e029e84460 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.818715 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8cda-ad92-4f7b-8849-d5e029e84460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.860396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cabde-1682-4b97-83a7-196c2680af51 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:58.886114 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb8cda-ad92-4f7b-8849-d5e029e84460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.887568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb8cda-ad92-4f7b-8849-d5e029e84460 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.894795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa9ab8-3d31-4829-97c0-39a69986a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:58.895474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9ab8-3d31-4829-97c0-39a69986a980 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:58.895773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9ab8-3d31-4829-97c0-39a69986a980 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:58.896066 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9ab8-3d31-4829-97c0-39a69986a980 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:58.896851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa9ab8-3d31-4829-97c0-39a69986a980 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:58.898216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa9ab8-3d31-4829-97c0-39a69986a980 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:58.917332 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 438/866] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:29:58 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:29:58.918695 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa9ab8-3d31-4829-97c0-39a69986a980 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:59.039984 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 429/867] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:29:59.045296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8cda-ad92-4f7b-8849-d5e029e84460 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:59.064964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa9ab8-3d31-4829-97c0-39a69986a980 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:59.105479 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:59.107232 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:59.108107 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:59.108556 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:59.109576 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=c2295621846d482fb6f705097415611e) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:59.110110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:59.113472 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:59.121054 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 439/868] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:58 2022] GET /identity/v3/role_assignments?user.id=c2295621846d482fb6f705097415611e&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=8cf832105b2949f6b11e06b208146326 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:59.189464 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8cda-ad92-4f7b-8849-d5e029e84460 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:59.230210 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:59.231337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:59.231815 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:59.232264 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:59.244162 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:59.245927 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:29:59.267040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:59.268356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:59.269571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:29:59.269571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:29:59.269571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:29:59.269571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:59.275825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 430/869] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:59.278926 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:59.391050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482925-a6c3-469b-9838-aca34d4fe767 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:59.427778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:59.428483 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:59.428768 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:59.429049 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:59.429877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:59.430676 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:59.432091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:59.449524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 440/870] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:29:59.452843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:59.559137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d160c-9210-4e47-bc27-96eab4cc2293 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:59.594703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b4fa4-4f23-43eb-8965-e658bae5bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:59.595532 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4fa4-4f23-43eb-8965-e658bae5bf85 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:59.595843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4fa4-4f23-43eb-8965-e658bae5bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:59.596122 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4fa4-4f23-43eb-8965-e658bae5bf85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:59.604321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b4fa4-4f23-43eb-8965-e658bae5bf85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:59.605826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b4fa4-4f23-43eb-8965-e658bae5bf85 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-3b0b4fa4-4f23-43eb-8965-e658bae5bf85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:29:59.623074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:29:59.624395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:29:59.625627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:29:59.625627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:29:59.625627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:29:59.625627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:29:59.625627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:29:59.625627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:29:59.625627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:29:59.625627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:29:59.628029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 431/871] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:29:59.634289 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:59.736390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb489b-1bb6-46fb-84f0-2a598b7ab7ed None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:59.772149 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:59.772818 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:59.773093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:59.773364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:59.774945 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:59.775251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:59.776705 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:59.792674 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758be5-5db2-4ab9-b97d-2cb4c5ddaa1f None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:59.792970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758be5-5db2-4ab9-b97d-2cb4c5ddaa1f None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:59.793222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09758be5-5db2-4ab9-b97d-2cb4c5ddaa1f None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:59.794318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 441/872] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:29:59.795067 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 432/873] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:29:59.795626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:59.800357 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740c868-a3c5-445d-a0eb-c35fcca13926 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:59.800645 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740c868-a3c5-445d-a0eb-c35fcca13926 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:59.800921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740c868-a3c5-445d-a0eb-c35fcca13926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:59.818297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-c740c868-a3c5-445d-a0eb-c35fcca13926 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:29:59.819494 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-c740c868-a3c5-445d-a0eb-c35fcca13926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:29:59.895964 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 433/874] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:29:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:29:59.896782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad652297-f437-478b-98ad-7ee8b832077a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:29:59.912602 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740c868-a3c5-445d-a0eb-c35fcca13926 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:29:59.932393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b2b35-e496-4049-9bda-754f48e7f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:29:59.933110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2b35-e496-4049-9bda-754f48e7f617 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:29:59.933393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2b35-e496-4049-9bda-754f48e7f617 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:29:59.933667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b2b35-e496-4049-9bda-754f48e7f617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:29:59.934502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b2b35-e496-4049-9bda-754f48e7f617 None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=c38e81573ddf4e9289ffd3b73a0aa226) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:29:59.934809 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b2b35-e496-4049-9bda-754f48e7f617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:29:59.936251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b2b35-e496-4049-9bda-754f48e7f617 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:29:59.947902 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 442/875] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:29:59 2022] GET /identity/v3/role_assignments?user.id=c38e81573ddf4e9289ffd3b73a0aa226&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:00.023296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740c868-a3c5-445d-a0eb-c35fcca13926 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:00.062654 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667e38b-53d5-4ef9-b57e-5fac256d3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:00.063341 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667e38b-53d5-4ef9-b57e-5fac256d3665 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:00.063621 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667e38b-53d5-4ef9-b57e-5fac256d3665 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:00.063940 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667e38b-53d5-4ef9-b57e-5fac256d3665 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:00.064685 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667e38b-53d5-4ef9-b57e-5fac256d3665 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:00.066335 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667e38b-53d5-4ef9-b57e-5fac256d3665 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:00.083160 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 434/876] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:29:59 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:30:01.358507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814870-d5ac-405b-931d-8c82c850daad None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.359573 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814870-d5ac-405b-931d-8c82c850daad None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.360128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f814870-d5ac-405b-931d-8c82c850daad None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.362051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 443/877] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:01.378630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16416a-d72c-43ee-8281-09d41cb33bf6 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.379499 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16416a-d72c-43ee-8281-09d41cb33bf6 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.380058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16416a-d72c-43ee-8281-09d41cb33bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.399244 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-bd16416a-d72c-43ee-8281-09d41cb33bf6 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:01.400477 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-bd16416a-d72c-43ee-8281-09d41cb33bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:01.466466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee9d1-ff41-4220-9db3-d891c4734d00 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.466834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee9d1-ff41-4220-9db3-d891c4734d00 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.467053 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee9d1-ff41-4220-9db3-d891c4734d00 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.468664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 444/878] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:01.473829 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d38d7-3ad3-4dc9-a54b-cb37a0f52a63 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.474117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d38d7-3ad3-4dc9-a54b-cb37a0f52a63 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.474397 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d38d7-3ad3-4dc9-a54b-cb37a0f52a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.477132 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 435/879] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:01.494291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-4d5d38d7-3ad3-4dc9-a54b-cb37a0f52a63 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:01.495484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-4d5d38d7-3ad3-4dc9-a54b-cb37a0f52a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:01.500564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16416a-d72c-43ee-8281-09d41cb33bf6 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:01.582777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 445/880] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:01.601124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16416a-d72c-43ee-8281-09d41cb33bf6 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:01.605525 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d38d7-3ad3-4dc9-a54b-cb37a0f52a63 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:01.650239 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:01.651936 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.652458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.653334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.654230 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:01.656520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:01.672293 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:01.673501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:30:01.674467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:01.677656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 436/881] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:30:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:01.691799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:01.719172 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d38d7-3ad3-4dc9-a54b-cb37a0f52a63 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:01.755462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:01.756326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.756607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.756884 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.757547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:01.759698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:01.772102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:01.773259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:01.774767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 446/882] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:01.785414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:01.796642 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e94fb-1d99-4bf2-b8a8-7b2f02774af1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:01.831155 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:01.831905 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.832193 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.832473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.833192 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:01.833556 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:01.834935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:01.840986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 437/883] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:30:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:01.848926 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:01.906574 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43c9a-eed9-4707-b437-7d23ec70431b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:01.942560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:01.943447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.943865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.944290 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.945114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:01.946127 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:01.947623 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:01.953234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d0f61-6f3c-4fab-b0bd-0007e5a742f5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:01.953724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 447/884] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:01.959199 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:01.990566 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:01.991628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:01.992256 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:01.992785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:01.993902 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:01.994452 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:01.996101 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:02.006397 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 438/885] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:30:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:02.007617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:02.063375 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992d74c-1f36-452d-ba97-acbcaf05111a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:02.099576 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:02.100289 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.100573 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.100852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.101614 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:02.102426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:02.103827 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:02.115917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d945ad-2b3c-49dd-a6ca-b5a15de8e4d6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:02.116174 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 448/886] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:02.157780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c13a0-a0cb-465c-9490-8471db7d8449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:02.158910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c13a0-a0cb-465c-9490-8471db7d8449 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.159429 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c13a0-a0cb-465c-9490-8471db7d8449 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.160089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c13a0-a0cb-465c-9490-8471db7d8449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.161201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c13a0-a0cb-465c-9490-8471db7d8449 None admin] RBAC: Adding query filter params (interface=public, service_id=724d0a970b284442a9443e5ffdc32f58, region_id=RegionOne) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:02.161797 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c13a0-a0cb-465c-9490-8471db7d8449 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:02.163481 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c13a0-a0cb-465c-9490-8471db7d8449 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:02.173812 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 439/887] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:30:02 2022] GET /identity/v3/endpoints?service_id=724d0a970b284442a9443e5ffdc32f58&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:02.181022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:02.296566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc57aa4-0677-4cd6-a88c-ae2690566045 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:02.331757 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a73f4-4dc4-40d4-b12e-0e3d506b7326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:02.332466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a73f4-4dc4-40d4-b12e-0e3d506b7326 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.332751 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a73f4-4dc4-40d4-b12e-0e3d506b7326 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.333027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a73f4-4dc4-40d4-b12e-0e3d506b7326 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.333725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a73f4-4dc4-40d4-b12e-0e3d506b7326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:02.335110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a73f4-4dc4-40d4-b12e-0e3d506b7326 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:02.341575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 449/888] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:30:02 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:30:02.378355 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d987-dd5a-4999-a88a-1a59bce241c0 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.379010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d987-dd5a-4999-a88a-1a59bce241c0 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.379010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439d987-dd5a-4999-a88a-1a59bce241c0 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.383803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3991-a73a-4ea2-84ec-1d44a6c08314 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.383803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3991-a73a-4ea2-84ec-1d44a6c08314 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.384426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 450/889] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:02.384534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b3991-a73a-4ea2-84ec-1d44a6c08314 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.384534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 440/890] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:02.387037 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118fd16-1260-4923-83c5-4e88e27cdf3e None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.387319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118fd16-1260-4923-83c5-4e88e27cdf3e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.387605 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118fd16-1260-4923-83c5-4e88e27cdf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.388414 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88df5-c12f-4495-a118-1c59c38e461e None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.388704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88df5-c12f-4495-a118-1c59c38e461e None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.389069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88df5-c12f-4495-a118-1c59c38e461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.406482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-69f88df5-c12f-4495-a118-1c59c38e461e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:02.407060 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-e118fd16-1260-4923-83c5-4e88e27cdf3e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:02.407703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-69f88df5-c12f-4495-a118-1c59c38e461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:02.408356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-e118fd16-1260-4923-83c5-4e88e27cdf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:02.496501 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 451/891] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:02.509018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 441/892] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:02.525856 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118fd16-1260-4923-83c5-4e88e27cdf3e None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:02.533838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f88df5-c12f-4495-a118-1c59c38e461e None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:02.650564 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f88df5-c12f-4495-a118-1c59c38e461e None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:02.655016 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118fd16-1260-4923-83c5-4e88e27cdf3e None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:02.688556 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:02.689401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.689674 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.689944 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.690858 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:02.692248 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:02.698381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9d307-1d10-42cc-b108-daae4594cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:02.699749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9d307-1d10-42cc-b108-daae4594cada None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.700128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9d307-1d10-42cc-b108-daae4594cada None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.700414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9d307-1d10-42cc-b108-daae4594cada None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:02.705370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:02.707519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:02.708860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 442/893] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:30:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:02.716734 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9d307-1d10-42cc-b108-daae4594cada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:02.717058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-a9e9d307-1d10-42cc-b108-daae4594cada None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:02.725467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:02.727732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:02.729384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:02.735820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 452/894] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:30:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:02.735820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9d307-1d10-42cc-b108-daae4594cada None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:02.840241 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9d307-1d10-42cc-b108-daae4594cada None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:02.843966 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7cfb7-7de2-4e55-a615-157d0baf6634 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:02.875082 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:02.875894 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.876239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.876579 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.877408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:02.877775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:02.879272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:02.885666 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:02.886363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:02.886946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:02.887231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:02.887984 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:02.888296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:02.889680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:02.893673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 453/895] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:30:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:02.894935 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:02.899837 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 443/896] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:02.903920 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:03.017299 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa2288-10af-4505-8810-2dc2901fd061 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:03.017646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4497fb0-db19-457c-99d8-e42586777784 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:03.051842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:03.052641 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:03.052918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:03.053114 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:03.053331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:03.053647 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:03.053933 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:03.054213 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:03.054957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:03.055268 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:03.056686 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:03.066092 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:03.066976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 444/897] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:03.067831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:03.068044 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:03.087189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:03.089503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:03.091867 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:03.091867 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:03.091867 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:03.091867 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:03.099786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 454/898] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:03.099786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:03.169860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8391592-fd8f-4440-b702-c51cd2bdd4e8 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:03.198947 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58fa0b-ce63-4c42-9300-3d0258122204 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:03.204404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:03.205072 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:03.205356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:03.205636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:03.206439 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] RBAC: Adding query filter params (interface=public, service_id=f21a400f8c3b4283a706e1bfc823fa98, region_id=RegionOne) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:03.206756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:03.208184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:03.218669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 445/899] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:30:03 2022] GET /identity/v3/endpoints?service_id=f21a400f8c3b4283a706e1bfc823fa98&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:03.219549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:03.236352 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:03.237025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:03.237307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:03.237584 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:03.238313 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:03.238618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:03.240017 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:03.257281 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 455/900] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:03.259301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:03.321913 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954502-5953-40ea-9ea8-1a7aa45769c8 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:03.358317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfcaeb-b06a-4c37-823f-49f02db96320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:03.358999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfcaeb-b06a-4c37-823f-49f02db96320 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:03.359284 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfcaeb-b06a-4c37-823f-49f02db96320 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:03.359560 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfcaeb-b06a-4c37-823f-49f02db96320 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:03.360303 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfcaeb-b06a-4c37-823f-49f02db96320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:03.361696 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfcaeb-b06a-4c37-823f-49f02db96320 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:03.364403 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb02c05-f3fa-44d7-8f9e-d33cfa7b619c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:03.381856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 446/901] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:30:03 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:30:03.404316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:03.405835 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:03.406333 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:03.406798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:03.416711 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:03.418176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:30:03.435792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:03.438238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:30:03.440927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:03.442288 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 456/902] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:30:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:03.447925 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfcaeb-b06a-4c37-823f-49f02db96320 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:03.576482 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfcaeb-b06a-4c37-823f-49f02db96320 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:03.613301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:03.613982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:03.614267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:03.614546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:03.615402 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:03.615713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:03.617243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:03.637943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 447/903] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:30:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:03.643328 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:03.744410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86d946-2bb0-46ce-8a36-5740d02aaf4e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:03.779558 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0646d-941f-4647-ac7d-be25f9f99910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:03.780242 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0646d-941f-4647-ac7d-be25f9f99910 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:03.780522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0646d-941f-4647-ac7d-be25f9f99910 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:03.780792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0646d-941f-4647-ac7d-be25f9f99910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:03.850120 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0646d-941f-4647-ac7d-be25f9f99910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:03.852045 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0646d-941f-4647-ac7d-be25f9f99910 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:03.953626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 457/904] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:03 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:30:03.957197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:04.060914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95862b88-b9cb-4543-be2c-0af5a79b9f9d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:04.098229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:04.099027 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.099310 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.099588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.110746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:04.112371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:04.130097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:04.131154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:04.132187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:04.132187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:04.132187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:04.132187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:04.132187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 448/905] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:04.137455 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0646d-941f-4647-ac7d-be25f9f99910 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:04.243445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0646d-941f-4647-ac7d-be25f9f99910 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:04.278875 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:04.279541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.279848 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.280123 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.280850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:04.281150 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:04.282571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:04.299571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 458/906] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:04.301035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:04.411186 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e172b-fb19-4ce1-b3d3-58a11f8117ab None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:04.447591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf372b4-0b51-433a-ba71-bfa722069137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:04.448417 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf372b4-0b51-433a-ba71-bfa722069137 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.448979 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf372b4-0b51-433a-ba71-bfa722069137 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.448979 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf372b4-0b51-433a-ba71-bfa722069137 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.455800 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf372b4-0b51-433a-ba71-bfa722069137 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:04.457254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf372b4-0b51-433a-ba71-bfa722069137 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-3cf372b4-0b51-433a-ba71-bfa722069137 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:30:04.471374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:04.472408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:04.473455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 449/907] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:04.478946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:04.550753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a4a1-ed3f-4f1f-8770-6fe4af5e196e None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.551403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a4a1-ed3f-4f1f-8770-6fe4af5e196e None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.551966 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a4a1-ed3f-4f1f-8770-6fe4af5e196e None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.553812 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 450/908] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:04.559305 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8c2c-4dfb-420c-a709-20726033249f None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.559929 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8c2c-4dfb-420c-a709-20726033249f None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.560463 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8c2c-4dfb-420c-a709-20726033249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.578689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-522d8c2c-4dfb-420c-a709-20726033249f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:04.579919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-522d8c2c-4dfb-420c-a709-20726033249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:04.594382 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acadeb-5cc5-4682-83e7-d67dd03e3b07 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:04.629785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:04.630454 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.630732 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.631001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.631830 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:04.632140 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:04.634179 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:04.651690 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 451/910] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:04.651940 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 459/910] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:04.654042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d8c2c-4dfb-420c-a709-20726033249f None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:04.674078 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:04.767428 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d8c2c-4dfb-420c-a709-20726033249f None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:04.783713 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad136a1-7932-4fd1-ac8c-a0da0b54c486 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:04.805114 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b74f4e-55d8-4d90-95a2-434075101cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:04.805986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74f4e-55d8-4d90-95a2-434075101cbf None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.806186 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74f4e-55d8-4d90-95a2-434075101cbf None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.806457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74f4e-55d8-4d90-95a2-434075101cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.807288 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b74f4e-55d8-4d90-95a2-434075101cbf None admin] RBAC: Adding query filter params (role.id=3f75309e353c4d65ab7989f035f0514e, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=c38e81573ddf4e9289ffd3b73a0aa226) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:04.807599 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b74f4e-55d8-4d90-95a2-434075101cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:04.809061 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b74f4e-55d8-4d90-95a2-434075101cbf None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:04.821056 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927c2d9-248a-4ca8-887b-f901bdb896e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:04.822132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c2d9-248a-4ca8-887b-f901bdb896e6 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.822633 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c2d9-248a-4ca8-887b-f901bdb896e6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.823115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927c2d9-248a-4ca8-887b-f901bdb896e6 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.824073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927c2d9-248a-4ca8-887b-f901bdb896e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:04.824204 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 452/911] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:04 2022] GET /identity/v3/role_assignments?user.id=c38e81573ddf4e9289ffd3b73a0aa226&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=3f75309e353c4d65ab7989f035f0514e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:04.825851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927c2d9-248a-4ca8-887b-f901bdb896e6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:04.829323 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b0bab-7e46-4e75-8d66-bc159a6e2954 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.829616 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b0bab-7e46-4e75-8d66-bc159a6e2954 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.829902 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b0bab-7e46-4e75-8d66-bc159a6e2954 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.831814 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 453/912] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:04.837978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ae611-060e-4864-a9a7-956830ed45c9 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:04.838631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ae611-060e-4864-a9a7-956830ed45c9 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:04.838934 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ae611-060e-4864-a9a7-956830ed45c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:04.859322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 460/913] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:30:04 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:30:04.859970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-314ae611-060e-4864-a9a7-956830ed45c9 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:04.861279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-314ae611-060e-4864-a9a7-956830ed45c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:04.954683 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 454/914] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:04.978862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927c2d9-248a-4ca8-887b-f901bdb896e6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:05.095158 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927c2d9-248a-4ca8-887b-f901bdb896e6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:05.130431 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:05.131623 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:05.132105 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:05.132541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:05.134224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:05.135784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:05.149002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:05.150502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:05.151485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 461/915] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:30:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:05.157192 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ae611-060e-4864-a9a7-956830ed45c9 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:05.266836 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ae611-060e-4864-a9a7-956830ed45c9 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:05.304049 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:05.305406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:05.306209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:05.306493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:05.307350 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:05.307660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:05.309069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:05.314747 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 455/916] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:30:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:05.321344 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:05.441052 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf8a51-dbf2-456e-8ad2-29c03f46f745 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:05.476297 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2ddce-41ee-46d6-991c-3af30f875083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:05.477002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2ddce-41ee-46d6-991c-3af30f875083 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:05.477282 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2ddce-41ee-46d6-991c-3af30f875083 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:05.477554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2ddce-41ee-46d6-991c-3af30f875083 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:05.478267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2ddce-41ee-46d6-991c-3af30f875083 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:05.478571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2ddce-41ee-46d6-991c-3af30f875083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:05.479964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2ddce-41ee-46d6-991c-3af30f875083 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:05.486916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 462/917] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:30:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:05.492906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:05.602930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda6739-82d2-4ad6-9279-3e8571feeb4a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:05.640415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ada765-647d-4d16-97a8-4a9ccd770798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:05.641083 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ada765-647d-4d16-97a8-4a9ccd770798 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:05.641370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ada765-647d-4d16-97a8-4a9ccd770798 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:05.641650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ada765-647d-4d16-97a8-4a9ccd770798 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:05.642408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ada765-647d-4d16-97a8-4a9ccd770798 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:05.643806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ada765-647d-4d16-97a8-4a9ccd770798 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:05.663753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 456/918] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:30:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:05.777391 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79f2e3-048d-4c14-88ba-082320d41b23 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:05.777743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79f2e3-048d-4c14-88ba-082320d41b23 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:05.777937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79f2e3-048d-4c14-88ba-082320d41b23 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:05.779620 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 463/919] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:05.785339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c4ca-4958-4f25-b2d8-f99c136ace9d None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:05.785628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c4ca-4958-4f25-b2d8-f99c136ace9d None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:05.785910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98c4ca-4958-4f25-b2d8-f99c136ace9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:05.805198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-7b98c4ca-4958-4f25-b2d8-f99c136ace9d None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:05.806622 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-7b98c4ca-4958-4f25-b2d8-f99c136ace9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:05.887835 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 457/920] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:05.910661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79f2e3-048d-4c14-88ba-082320d41b23 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:06.018870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79f2e3-048d-4c14-88ba-082320d41b23 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:06.053713 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:06.054797 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:06.054922 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:06.055167 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:06.055952 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:06.057341 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:06.071585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:06.072745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:06.073724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 464/921] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:30:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:06.081454 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98c4ca-4958-4f25-b2d8-f99c136ace9d None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:06.183710 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98c4ca-4958-4f25-b2d8-f99c136ace9d None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:06.220983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:06.221667 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:06.221998 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:06.222281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:06.223000 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:06.223308 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:06.224716 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:06.230436 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 458/922] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:06.236859 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:06.340286 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa41f7e-9857-427a-9720-460d528c99b0 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:06.382171 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eb341-c439-459e-8319-4277e75565b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:06.383607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eb341-c439-459e-8319-4277e75565b2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:06.384144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eb341-c439-459e-8319-4277e75565b2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:06.384635 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eb341-c439-459e-8319-4277e75565b2 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:06.385566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eb341-c439-459e-8319-4277e75565b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:06.386100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eb341-c439-459e-8319-4277e75565b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:06.387730 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eb341-c439-459e-8319-4277e75565b2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:06.393412 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 465/923] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:06.399903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:06.501758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a81db-db3c-4901-a741-3e242781f1ea None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:06.540387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb5b0d-9c14-4190-bd04-38765bc96fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:06.541379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb5b0d-9c14-4190-bd04-38765bc96fed None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:06.542382 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb5b0d-9c14-4190-bd04-38765bc96fed None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:06.542828 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb5b0d-9c14-4190-bd04-38765bc96fed None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:06.543746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb5b0d-9c14-4190-bd04-38765bc96fed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:06.545327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb5b0d-9c14-4190-bd04-38765bc96fed None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:06.568141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 459/924] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:30:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:07.241149 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de165-0513-4920-bf91-e1c107245338 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.241688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de165-0513-4920-bf91-e1c107245338 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.241688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de165-0513-4920-bf91-e1c107245338 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.243629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 466/925] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:07.249096 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89473815-fd7b-4134-adb8-e264fa6d9ead None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.249391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89473815-fd7b-4134-adb8-e264fa6d9ead None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.249673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89473815-fd7b-4134-adb8-e264fa6d9ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.266778 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-89473815-fd7b-4134-adb8-e264fa6d9ead None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:07.268369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-89473815-fd7b-4134-adb8-e264fa6d9ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:07.268650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776ce5-6c45-4fb5-8f3c-5440719325a2 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.268939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776ce5-6c45-4fb5-8f3c-5440719325a2 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.269217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776ce5-6c45-4fb5-8f3c-5440719325a2 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.270850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 467/926] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:30:07.276549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bca45-28cb-4bb2-96d2-645cb87f88cd None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.276835 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bca45-28cb-4bb2-96d2-645cb87f88cd None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.277106 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bca45-28cb-4bb2-96d2-645cb87f88cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.294005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-d40bca45-28cb-4bb2-96d2-645cb87f88cd None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:07.295183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-d40bca45-28cb-4bb2-96d2-645cb87f88cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:07.365919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 460/927] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:07.369043 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 468/928] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:07.391932 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89473815-fd7b-4134-adb8-e264fa6d9ead None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:07.392842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bca45-28cb-4bb2-96d2-645cb87f88cd None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:07.498866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89473815-fd7b-4134-adb8-e264fa6d9ead None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:07.520550 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bca45-28cb-4bb2-96d2-645cb87f88cd None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:07.540370 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284862ec-4312-4405-9617-53638910c773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:07.542290 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284862ec-4312-4405-9617-53638910c773 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.542803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284862ec-4312-4405-9617-53638910c773 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.543581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284862ec-4312-4405-9617-53638910c773 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.544635 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284862ec-4312-4405-9617-53638910c773 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:07.546871 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284862ec-4312-4405-9617-53638910c773 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:07.555860 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fd4b9-62f2-4a40-a578-2cc104431feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:07.556684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fd4b9-62f2-4a40-a578-2cc104431feb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.556956 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fd4b9-62f2-4a40-a578-2cc104431feb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.557235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fd4b9-62f2-4a40-a578-2cc104431feb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-284862ec-4312-4405-9617-53638910c773 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:07.563246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:07.564343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:07.565540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:07.568416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 461/929] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:07.573886 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fd4b9-62f2-4a40-a578-2cc104431feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:07.575109 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284862ec-4312-4405-9617-53638910c773 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-598fd4b9-62f2-4a40-a578-2cc104431feb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:07.583619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:07.584927 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:07.586777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:07.594682 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 469/930] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:30:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:07.595374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fd4b9-62f2-4a40-a578-2cc104431feb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:07.702915 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284862ec-4312-4405-9617-53638910c773 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:07.709590 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fd4b9-62f2-4a40-a578-2cc104431feb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:07.740774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:07.741434 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.741718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.741995 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.744006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:07.744302 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:07.745699 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:07.755552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:07.755735 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 462/931] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:07.756662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.756920 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:07.757494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.758539 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.759883 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:07.760422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:07.763084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:07.774345 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 470/932] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:30:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:07.780421 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:07.881607 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d123-11d3-4d7b-95aa-0cbafdbcc028 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:07.902747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a303a3-9f26-46db-a54b-c20a602eadf9 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:07.918432 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:07.919106 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.919393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.919839 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.920558 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:07.921230 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:07.922911 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:07.934554 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 463/933] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:07.936555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:07.947180 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:07.948729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:07.949018 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:07.949295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:07.966279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:07.968084 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:07.993342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:07.994429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:08.000383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:08.000383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:08.000383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:08.000383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:08.000383 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 471/934] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:08.004239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.053176 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b559-f98d-4ae9-9b7a-d3f1c55c5e0f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.089369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.090406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.090911 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.091392 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.092444 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] RBAC: Adding query filter params (interface=public, service_id=a9437cb8b93a4e248cf999fa56a2471b, region_id=RegionOne) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:08.092987 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.094582 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.103874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 464/935] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:30:07 2022] GET /identity/v3/endpoints?service_id=a9437cb8b93a4e248cf999fa56a2471b&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:08.106768 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.108499 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e270-6b09-4f89-8177-2dc4a6349ee1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.143615 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b6c9b-a2bd-4b2c-bdd1-63f64207eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.144360 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b6c9b-a2bd-4b2c-bdd1-63f64207eda3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.144702 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b6c9b-a2bd-4b2c-bdd1-63f64207eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.145235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b6c9b-a2bd-4b2c-bdd1-63f64207eda3 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.146039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b6c9b-a2bd-4b2c-bdd1-63f64207eda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:08.146362 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b6c9b-a2bd-4b2c-bdd1-63f64207eda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.147749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b6c9b-a2bd-4b2c-bdd1-63f64207eda3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.165593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 472/936] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:08.165593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aef44-5fc5-4163-a2f8-6b5d3b8ce786 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.165593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aef44-5fc5-4163-a2f8-6b5d3b8ce786 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.165593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aef44-5fc5-4163-a2f8-6b5d3b8ce786 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.165593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 473/937] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:08.168869 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aef44-5fc5-4163-a2f8-6b5d3b8ce786 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.215604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c15e4-587b-430f-901f-ece49af00cbf None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.250604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b2a6f-fb3e-4807-b1ea-75dafe54848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.251307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2a6f-fb3e-4807-b1ea-75dafe54848d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.251589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2a6f-fb3e-4807-b1ea-75dafe54848d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.251895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b2a6f-fb3e-4807-b1ea-75dafe54848d None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.252583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2a6f-fb3e-4807-b1ea-75dafe54848d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.253953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b2a6f-fb3e-4807-b1ea-75dafe54848d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.260068 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 465/938] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:30:08 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:30:08.261173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac1a4-bb17-462f-80f9-543b87deec93 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.261466 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac1a4-bb17-462f-80f9-543b87deec93 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.261743 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceac1a4-bb17-462f-80f9-543b87deec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.280922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-2ceac1a4-bb17-462f-80f9-543b87deec93 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:08.282781 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-2ceac1a4-bb17-462f-80f9-543b87deec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:08.284585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aef44-5fc5-4163-a2f8-6b5d3b8ce786 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.334883 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.336519 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.336821 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.337177 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.348304 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.349769 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:30:08.373644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:08.374782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:30:08.375890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:08.378780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 474/939] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:30:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:08.384498 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.386613 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 466/940] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:08.410279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceac1a4-bb17-462f-80f9-543b87deec93 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.510995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8ff72-028f-40e2-a2c7-a66838632397 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.527544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceac1a4-bb17-462f-80f9-543b87deec93 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.557683 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.559197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.559637 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.560109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.561118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:08.561594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.563228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.563354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.564198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.564578 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.564953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.566029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.568182 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.569080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: WARNING keystone.server.flask.common [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:30:08.586840 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 475/941] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:30:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:08.592671 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.594683 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.sql.core [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:30:08.594683 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:30:08.594683 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [parameters: {'id': '647819ba87034a138c45c7bc985327ef', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:30:08.594683 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=206369) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 647819ba87034a138c45c7bc985327ef.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 647819ba87034a138c45c7bc985327ef. May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application conn.query(q) May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:30:08.611787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application result.read() May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 15:30:08.612763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application next(self.gen) May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application yield resource May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application next(self.gen) May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise self.value May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application session.commit() May 09 15:30:08.613874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self.session.flush() May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application compat.raise_( May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:30:08.615317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:30:08.616393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application conn.query(q) May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application result.read() May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:30:08.620320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [parameters: {'id': '647819ba87034a138c45c7bc985327ef', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:08.622576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:08.624796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 647819ba87034a138c45c7bc985327ef. May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 467/942] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 9 15:30:08 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:08.628581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.735164 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e62e4-f0d9-4e5a-9518-cd1ec2f36fab None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.740193 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1abc19-cfbf-402d-9709-50764e1c304a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.771631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.772292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.772585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.781027 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.782979 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.786105 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.787156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.787667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.788203 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:30:08.799073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:08.800118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:08.801201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 468/943] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:08.802942 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.805074 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.806268 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:08.827342 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:08.828453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:08.829458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:08.829458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:08.829458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:08.829458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:08.831714 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 476/944] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:08.838115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:08.923449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0766a3b-bdd1-4422-872e-8b38e28900fb None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.942027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9134a62-5801-44a6-b4be-a054a13ca3be None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:08.961383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240ee5e-45c4-4bed-a535-ad15c3ae5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.962060 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240ee5e-45c4-4bed-a535-ad15c3ae5dfd None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.962344 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240ee5e-45c4-4bed-a535-ad15c3ae5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.962623 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240ee5e-45c4-4bed-a535-ad15c3ae5dfd None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.963389 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240ee5e-45c4-4bed-a535-ad15c3ae5dfd None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:08.963703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240ee5e-45c4-4bed-a535-ad15c3ae5dfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.965177 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240ee5e-45c4-4bed-a535-ad15c3ae5dfd None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.978554 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:08.979231 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.979524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.979823 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.980567 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:08.980877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:08.982248 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:08.994305 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 469/945] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:30:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:08.994305 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fab09-f6ec-45a6-bdd5-a57bb4befe06 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.994305 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fab09-f6ec-45a6-bdd5-a57bb4befe06 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.994305 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fab09-f6ec-45a6-bdd5-a57bb4befe06 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:08.994923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 470/946] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:08.996850 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4945a-6c01-48aa-9580-d2af80f95213 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:08.997151 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4945a-6c01-48aa-9580-d2af80f95213 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:08.997453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4945a-6c01-48aa-9580-d2af80f95213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:09.004188 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 477/947] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:09.010304 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:09.018255 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-ece4945a-6c01-48aa-9580-d2af80f95213 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:09.020167 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-ece4945a-6c01-48aa-9580-d2af80f95213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:09.108235 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 471/948] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:09.130757 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4945a-6c01-48aa-9580-d2af80f95213 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:09.153777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2329716-5b38-4517-948a-0490a218b763 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:09.192438 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:09.193548 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:09.194009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:09.194458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:09.202298 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:09.204016 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:30:09.219346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:09.220546 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:09.221630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:30:09.221630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:30:09.221630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:30:09.221630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:30:09.221630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:30:09.221630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:30:09.221630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:09.221630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:09.225000 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 478/949] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:09.229238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:09.249607 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4945a-6c01-48aa-9580-d2af80f95213 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:09.292125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:09.293307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:09.293593 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:09.293869 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:09.294538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:09.296526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:09.308865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:09.310015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:09.310972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 472/950] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:09.316487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:09.372608 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de7eb7-2f70-46df-b0ca-ad8cbc199a5f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:09.418664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:09.419528 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:09.419950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:09.420331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:09.421243 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:09.421660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:09.424079 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:09.435092 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca34468-a995-4742-a294-2d0d311cb9ab None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:09.443911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 479/951] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:09.448939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:09.477361 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:09.478356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:09.478866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:09.479384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:09.480414 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] RBAC: Adding query filter params (name=compute) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:09.480944 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:09.482535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:09.488392 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 473/952] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:30:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:09.495627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:09.567859 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396434b-c5ac-4460-befc-0e6507ae902a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:09.600733 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21be73-d42f-489b-ab0e-a574f3005b21 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:09.605758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8af1b-920e-4326-8e00-f2a2b28663ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:09.606920 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8af1b-920e-4326-8e00-f2a2b28663ea None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:09.607447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8af1b-920e-4326-8e00-f2a2b28663ea None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:09.607965 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8af1b-920e-4326-8e00-f2a2b28663ea None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/c38e81573ddf4e9289ffd3b73a0aa226/roles/3f75309e353c4d65ab7989f035f0514e` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:09.610600 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8af1b-920e-4326-8e00-f2a2b28663ea None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=c38e81573ddf4e9289ffd3b73a0aa226, role_id=3f75309e353c4d65ab7989f035f0514e)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:09.612413 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8af1b-920e-4326-8e00-f2a2b28663ea None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:09.631247 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 480/953] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:30:09 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/c38e81573ddf4e9289ffd3b73a0aa226/roles/3f75309e353c4d65ab7989f035f0514e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:30:09.648246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad1ad8-e6a7-4687-9e98-2e40eefb4c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:09.649656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad1ad8-e6a7-4687-9e98-2e40eefb4c46 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:09.650187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad1ad8-e6a7-4687-9e98-2e40eefb4c46 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:09.650650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad1ad8-e6a7-4687-9e98-2e40eefb4c46 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:09.651537 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad1ad8-e6a7-4687-9e98-2e40eefb4c46 None admin] RBAC: Adding query filter params (type=compute) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:09.651984 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad1ad8-e6a7-4687-9e98-2e40eefb4c46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:09.653639 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad1ad8-e6a7-4687-9e98-2e40eefb4c46 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:09.659321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 474/954] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:30:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:10.602586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1efbc-ad6e-4800-a8c7-bae138a2198a None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:10.603154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1efbc-ad6e-4800-a8c7-bae138a2198a None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:10.603154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1efbc-ad6e-4800-a8c7-bae138a2198a None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:10.604753 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 481/955] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:10.610221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43d66-2bad-4b8a-ae75-cd28f9d03835 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:10.610617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43d66-2bad-4b8a-ae75-cd28f9d03835 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:10.610815 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43d66-2bad-4b8a-ae75-cd28f9d03835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:10.630112 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-31c43d66-2bad-4b8a-ae75-cd28f9d03835 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:10.631731 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-31c43d66-2bad-4b8a-ae75-cd28f9d03835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:10.715174 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 475/956] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:10.737092 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1efbc-ad6e-4800-a8c7-bae138a2198a None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:10.853313 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1efbc-ad6e-4800-a8c7-bae138a2198a None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:10.889850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:10.890593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:10.890878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:10.891154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:10.891846 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:10.893228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:10.906386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:10.907537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:10.908529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 482/957] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:10.913683 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43d66-2bad-4b8a-ae75-cd28f9d03835 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:11.018865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43d66-2bad-4b8a-ae75-cd28f9d03835 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:11.052788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:11.053455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.053733 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.054006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:11.055560 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:11.055560 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:11.056937 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:11.061978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 476/958] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:11.067820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:11.172610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1f569-75d9-49fc-a2c7-88d8235fd4c2 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:11.207052 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe6d31-e1fc-4c8a-a673-9d7971b20a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:11.207724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe6d31-e1fc-4c8a-a673-9d7971b20a83 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.208030 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe6d31-e1fc-4c8a-a673-9d7971b20a83 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.208301 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe6d31-e1fc-4c8a-a673-9d7971b20a83 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:11.209008 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe6d31-e1fc-4c8a-a673-9d7971b20a83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:11.209312 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe6d31-e1fc-4c8a-a673-9d7971b20a83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:11.210665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe6d31-e1fc-4c8a-a673-9d7971b20a83 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:11.217046 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 483/959] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:11.222296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:11.330336 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddd5b3-6bd3-48e0-ae15-9127c41700d2 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:11.365927 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac3e36-2b2e-4cb1-a8be-f8ac4aad965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:11.366586 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3e36-2b2e-4cb1-a8be-f8ac4aad965e None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.366866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3e36-2b2e-4cb1-a8be-f8ac4aad965e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.368216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac3e36-2b2e-4cb1-a8be-f8ac4aad965e None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:11.368749 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac3e36-2b2e-4cb1-a8be-f8ac4aad965e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:11.370167 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac3e36-2b2e-4cb1-a8be-f8ac4aad965e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:11.396238 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 477/960] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:30:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:11.493956 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2e42-08cd-438d-9e7d-13906955b40d None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.494314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2e42-08cd-438d-9e7d-13906955b40d None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.494510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2e42-08cd-438d-9e7d-13906955b40d None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:11.496252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 484/961] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:11.501960 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320aaf-ebb3-4667-a31f-ecd836f572d0 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.502249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320aaf-ebb3-4667-a31f-ecd836f572d0 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.502530 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b320aaf-ebb3-4667-a31f-ecd836f572d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:11.520771 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-9b320aaf-ebb3-4667-a31f-ecd836f572d0 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:11.521986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-9b320aaf-ebb3-4667-a31f-ecd836f572d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:11.606318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 478/962] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:11.635502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd2e42-08cd-438d-9e7d-13906955b40d None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:11.738384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd2e42-08cd-438d-9e7d-13906955b40d None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:11.774258 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:11.775734 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.776258 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.776781 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:11.777705 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:11.779425 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:11.781160 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: WARNING keystone.server.flask.common [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:30:11.797098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.sql.core [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:30:11.797098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:30:11.797098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [parameters: {'user_id': '17b6d83aeb87452099c029a48d043afe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:30:11.797098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=206370) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-a2257ae3-bc52-4b60-8877-f077bcff0bb4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application conn.query(q) May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result.read() May 09 15:30:11.805435 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:30:11.806489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application next(self.gen) May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application yield resource May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application next(self.gen) May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise self.value May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application session.commit() May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:30:11.807588 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.session.flush() May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application compat.raise_( May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:30:11.808611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:30:11.809652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application conn.query(q) May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application result.read() May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:30:11.810629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [parameters: {'user_id': '17b6d83aeb87452099c029a48d043afe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:11.811560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 15:30:11.818575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 15:30:11.822006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 15:30:11.822006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 15:30:11.822006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:30:11.822006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:30:11.822006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:30:11.822006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:11.822006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 485/963] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:30:11 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:11.826423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b320aaf-ebb3-4667-a31f-ecd836f572d0 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:11.935397 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b320aaf-ebb3-4667-a31f-ecd836f572d0 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:11.972099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:11.973069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da550b-19c2-46ea-b42b-8df2b0898b7f None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.973359 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da550b-19c2-46ea-b42b-8df2b0898b7f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.973644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da550b-19c2-46ea-b42b-8df2b0898b7f None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:11.973968 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.974449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.974922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:11.983558 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:11.983865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 486/964] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:11.985556 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:11.985699 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f73f2-caf6-424b-b020-84d93ad887bd None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:11.985910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f73f2-caf6-424b-b020-84d93ad887bd None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:11.986273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f73f2-caf6-424b-b020-84d93ad887bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.004170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-3b7f73f2-caf6-424b-b020-84d93ad887bd None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:12.005781 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-3b7f73f2-caf6-424b-b020-84d93ad887bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:30:12.006054 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:12.007058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:30:12.008689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:12.011059 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 479/965] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:30:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:12.016780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:12.092028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 487/966] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:12.093405 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de94d9a-b889-4341-91d3-7e45ac5745f5 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:12.093701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de94d9a-b889-4341-91d3-7e45ac5745f5 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:12.094013 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de94d9a-b889-4341-91d3-7e45ac5745f5 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.095461 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 488/967] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:12.100652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ce47-b032-47fb-80b6-460888252b05 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:12.101133 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ce47-b032-47fb-80b6-460888252b05 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:12.101646 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ce47-b032-47fb-80b6-460888252b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.119195 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-ab69ce47-b032-47fb-80b6-460888252b05 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:12.120402 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-ab69ce47-b032-47fb-80b6-460888252b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:12.126004 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa125d8-adba-49c3-8de7-8e0989a34d81 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:12.161006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:12.161680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:12.161959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:12.162237 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.163047 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:12.163352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:12.165002 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:12.199798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 489/968] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:12.199798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ce47-b032-47fb-80b6-460888252b05 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:12.216078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 480/969] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:30:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:12.216904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:12.329684 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ce47-b032-47fb-80b6-460888252b05 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:12.347549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f5693-ae8f-4e69-9ecb-b2dfb041d3c7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:12.377219 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fce8f4-c103-4b5f-86e2-3dca346b835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:12.378064 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce8f4-c103-4b5f-86e2-3dca346b835d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:12.378351 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce8f4-c103-4b5f-86e2-3dca346b835d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:12.378631 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce8f4-c103-4b5f-86e2-3dca346b835d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.391459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fce8f4-c103-4b5f-86e2-3dca346b835d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:12.395758 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be84d7-91d3-4983-8590-38b4bdf62e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:12.396658 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be84d7-91d3-4983-8590-38b4bdf62e9a None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:12.397122 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be84d7-91d3-4983-8590-38b4bdf62e9a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:12.397571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be84d7-91d3-4983-8590-38b4bdf62e9a None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.399066 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be84d7-91d3-4983-8590-38b4bdf62e9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:12.400785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be84d7-91d3-4983-8590-38b4bdf62e9a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-d2fce8f4-c103-4b5f-86e2-3dca346b835d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:12.400924 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:12.402122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:12.403270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 490/970] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:30:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:12.411912 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fce8f4-c103-4b5f-86e2-3dca346b835d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:12.423592 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 481/971] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:30:12 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:12.537653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fce8f4-c103-4b5f-86e2-3dca346b835d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:12.584459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:12.585437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:12.586565 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:12.586998 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.587968 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:12.588434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:12.590179 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:12.599870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 491/972] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:30:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:12.606312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be84d7-91d3-4983-8590-38b4bdf62e9a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:12.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be84d7-91d3-4983-8590-38b4bdf62e9a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:12.751172 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:12.752385 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:12.752874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:12.753373 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.764501 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:12.766204 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:12.783486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:12.784557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:12.785649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:12.785649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:12.785649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:12.785649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:12.787866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 482/973] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:12.793582 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:12.919214 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615b2c-13b1-42b7-94b5-b13d4fc6cad7 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:12.959873 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:12.960845 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:12.961136 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:12.961408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:12.962143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:12.962450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:12.963840 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:12.981195 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 492/974] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:12.982601 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:13.094005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a219a8-4b96-4e8a-a296-d032730a8619 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:13.128496 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:13.129243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:13.129523 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:13.129799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:13.138763 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:13.140266 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:30:13.156085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:13.157208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:30:13.158279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:13.162061 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 483/975] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:30:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:13.163543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:13.280434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017f5da-d2fc-4f06-825a-ead73636ced9 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:13.314186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:13.314865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:13.315387 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:13.315670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:13.316550 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:13.316861 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:13.318288 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:13.336570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 493/976] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:30:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:13.342061 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:13.448544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029af10-8128-4950-bb55-d3d8409a366d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:13.480847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0735b26-c0d0-4856-ab3d-8b16b8e9e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:13.481494 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0735b26-c0d0-4856-ab3d-8b16b8e9e90a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:13.481776 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0735b26-c0d0-4856-ab3d-8b16b8e9e90a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:13.482049 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0735b26-c0d0-4856-ab3d-8b16b8e9e90a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:13.552034 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0735b26-c0d0-4856-ab3d-8b16b8e9e90a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:13.553420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0735b26-c0d0-4856-ab3d-8b16b8e9e90a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:13.657546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 484/977] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:13 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:30:13.664523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:13.770467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d0141-fa10-4c0c-8b88-dcc9bb751c8c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:13.804153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12163-ec2c-4561-b988-3a6346a882b6 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:13.804948 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12163-ec2c-4561-b988-3a6346a882b6 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:13.805178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12163-ec2c-4561-b988-3a6346a882b6 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:13.806692 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:13.807157 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 485/978] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:30:13.807354 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:13.807607 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:13.807916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:13.811714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7fcd9-6b1f-4274-8145-c7b2afbff440 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:13.812035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7fcd9-6b1f-4274-8145-c7b2afbff440 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:13.812318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7fcd9-6b1f-4274-8145-c7b2afbff440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:13.818985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:13.821119 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:13.829571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-2fe7fcd9-6b1f-4274-8145-c7b2afbff440 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:13.830786 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-2fe7fcd9-6b1f-4274-8145-c7b2afbff440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:13.839001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:13.840192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:13.841216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:13.841216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:13.841216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:13.841216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:13.841216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 494/979] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:13.846437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:13.897880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 486/980] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:13.920139 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7fcd9-6b1f-4274-8145-c7b2afbff440 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:13.948639 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4607f-a060-451e-849f-e7ac2275b885 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:13.985571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:13.986252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:13.986590 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:13.986786 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:13.987510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:13.987845 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:13.989210 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.001994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 495/981] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:14.007413 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:14.025077 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7fcd9-6b1f-4274-8145-c7b2afbff440 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:14.059872 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:14.060680 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.060904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.061183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.061846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:14.063229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:14.076568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:14.077698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:14.078659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 487/982] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:14.083668 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:14.113023 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b22ea9-7999-455f-9535-34becab0df64 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:14.149319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:14.150133 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.150419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.150699 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.157705 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:14.159163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:30:14.173654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:14.174789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:14.175891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 496/983] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:14.180526 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:14.187360 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba00222-8186-4225-9369-4d07663264e1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:14.222584 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:14.223257 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.223544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.223849 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.224569 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:14.224880 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:14.226338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.236224 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 488/984] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:14.236912 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:14.280675 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06a10e-afeb-4ecc-9a2e-abb23e465d5d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:14.314252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:14.314836 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.315114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.315636 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.316457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:14.316762 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:14.318184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.331812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 497/985] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:14.336835 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04151c-0df1-4c6f-9161-7399775f2242 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:14.338691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:14.380755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:14.381437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.381722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.381997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.383252 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:14.383554 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:14.385141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.390981 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 489/986] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:14.396595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:14.450069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababb492-9a3b-421a-85e0-4db376ebf5de None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:14.484261 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:14.484922 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.485201 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.485479 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.486314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] RBAC: Adding query filter params (role.id=3f75309e353c4d65ab7989f035f0514e, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=c38e81573ddf4e9289ffd3b73a0aa226) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:14.486629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:14.488077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.494930 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 498/987] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:14 2022] GET /identity/v3/role_assignments?user.id=c38e81573ddf4e9289ffd3b73a0aa226&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=3f75309e353c4d65ab7989f035f0514e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:14.497250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85258ff4-378f-4dae-a1d4-c219fb8e28d6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:14.533761 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a7aa6-7948-4dbc-a582-ab7355b93092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:14.534456 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a7aa6-7948-4dbc-a582-ab7355b93092 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.534735 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a7aa6-7948-4dbc-a582-ab7355b93092 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.535006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a7aa6-7948-4dbc-a582-ab7355b93092 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.535883 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a7aa6-7948-4dbc-a582-ab7355b93092 None admin] RBAC: Adding query filter params (interface=admin, service_id=a9437cb8b93a4e248cf999fa56a2471b, region_id=RegionOne) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:14.536201 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a7aa6-7948-4dbc-a582-ab7355b93092 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:14.537720 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a7aa6-7948-4dbc-a582-ab7355b93092 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.544086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 490/988] 10.222.0.32 () {56 vars in 1249 bytes} [Mon May 9 15:30:14 2022] GET /identity/v3/endpoints?service_id=a9437cb8b93a4e248cf999fa56a2471b&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:14.549769 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:14.659641 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80c522-235e-4645-8616-03ae0e9a9244 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:14.706408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36801d-6e03-41d0-bfa2-d05e4628d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:14.707090 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36801d-6e03-41d0-bfa2-d05e4628d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.707371 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36801d-6e03-41d0-bfa2-d05e4628d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.708302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36801d-6e03-41d0-bfa2-d05e4628d0c3 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.708420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36801d-6e03-41d0-bfa2-d05e4628d0c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:14.709745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36801d-6e03-41d0-bfa2-d05e4628d0c3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:14.717995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 499/989] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:30:14 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:30:14.738831 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02f3e-08bd-4969-80a7-ef4f0dea0f74 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.739118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02f3e-08bd-4969-80a7-ef4f0dea0f74 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.739396 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db02f3e-08bd-4969-80a7-ef4f0dea0f74 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.740911 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 491/990] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:14.748003 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da67fd-f880-4a98-9680-47a767445e45 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:14.748661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da67fd-f880-4a98-9680-47a767445e45 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:14.749172 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da67fd-f880-4a98-9680-47a767445e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:14.770338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-e9da67fd-f880-4a98-9680-47a767445e45 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:14.771666 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-e9da67fd-f880-4a98-9680-47a767445e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:14.845095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 500/991] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:14.868537 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db02f3e-08bd-4969-80a7-ef4f0dea0f74 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:14.974316 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db02f3e-08bd-4969-80a7-ef4f0dea0f74 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:15.006627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:15.008089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:15.008228 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:15.008485 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] PATH_INFO: `/v3/services/compute` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:15.009143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:15.010511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:15.022187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:15.023881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:15.026052 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 492/992] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:15.030758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da67fd-f880-4a98-9680-47a767445e45 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:15.141842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da67fd-f880-4a98-9680-47a767445e45 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:15.175028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:15.175698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:15.176011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:15.176287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:15.176992 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] RBAC: Adding query filter params (name=compute) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:15.177299 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:15.178669 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:15.184022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 501/993] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:30:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:15.189421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:15.288367 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47fd0a-d32b-4294-8381-1f50fdb91a0a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:15.321909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:15.322585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:15.322863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:15.323136 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:15.323868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:15.324176 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:15.325535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:15.330583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 493/994] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:30:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:15.336897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:15.436017 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8682f-dd55-47da-a744-88b28f834033 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:15.469205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d48297-7b3f-42aa-a2b5-6190484a34a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:15.469862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48297-7b3f-42aa-a2b5-6190484a34a4 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:15.470143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48297-7b3f-42aa-a2b5-6190484a34a4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:15.470416 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d48297-7b3f-42aa-a2b5-6190484a34a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:15.471197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d48297-7b3f-42aa-a2b5-6190484a34a4 None admin] RBAC: Adding query filter params (interface=public, service_id=be0c95cd33814edfa44913fa58f719c1, region_id=RegionOne) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:15.471503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d48297-7b3f-42aa-a2b5-6190484a34a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:15.472891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d48297-7b3f-42aa-a2b5-6190484a34a4 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:15.482898 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 502/995] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:30:15 2022] GET /identity/v3/endpoints?service_id=be0c95cd33814edfa44913fa58f719c1&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:15.484209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:15.582953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455eff18-2ff4-43ec-b10a-02a4277a21b3 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:15.616722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d1705-7f15-4424-b73d-241da581042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:15.618156 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d1705-7f15-4424-b73d-241da581042b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:15.618437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d1705-7f15-4424-b73d-241da581042b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:15.618712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d1705-7f15-4424-b73d-241da581042b None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:15.619387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d1705-7f15-4424-b73d-241da581042b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:15.620780 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d1705-7f15-4424-b73d-241da581042b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:15.631525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 494/996] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:30:15 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:30:16.818964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25d9f2-5bc1-4029-9cf7-666c2f6fc890 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:16.819529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25d9f2-5bc1-4029-9cf7-666c2f6fc890 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:16.819529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25d9f2-5bc1-4029-9cf7-666c2f6fc890 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:16.821596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 503/997] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:16.827194 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b851c-debc-4517-8703-b5873776c7d4 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:16.827649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b851c-debc-4517-8703-b5873776c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:16.827779 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b851c-debc-4517-8703-b5873776c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:16.845211 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-c86b851c-debc-4517-8703-b5873776c7d4 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:16.846387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-c86b851c-debc-4517-8703-b5873776c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:16.912308 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 495/998] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:16.935789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25d9f2-5bc1-4029-9cf7-666c2f6fc890 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:16.986914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d651-5785-4694-96d7-df0f7241177c None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:16.987251 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d651-5785-4694-96d7-df0f7241177c None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:16.987478 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3d651-5785-4694-96d7-df0f7241177c None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:16.989058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 496/999] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:30:16.994614 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f648ca-3f64-4226-b6c2-176dfeb0c568 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:16.994945 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f648ca-3f64-4226-b6c2-176dfeb0c568 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:16.995170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f648ca-3f64-4226-b6c2-176dfeb0c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.015568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-48f648ca-3f64-4226-b6c2-176dfeb0c568 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:17.016782 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-48f648ca-3f64-4226-b6c2-176dfeb0c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:17.037324 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25d9f2-5bc1-4029-9cf7-666c2f6fc890 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:17.078241 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:17.078948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.079231 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.079509 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] PATH_INFO: `/v3/services/image` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.080191 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:17.081552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:17.084804 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 497/1000] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:17.093929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:17.095047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:17.096457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:17.097643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 504/1001] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:30:16 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:17.100986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f648ca-3f64-4226-b6c2-176dfeb0c568 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:17.107429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:17.198237 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f648ca-3f64-4226-b6c2-176dfeb0c568 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:17.204275 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd142-ade3-4b72-9009-efa26900b85d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:17.231948 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:17.232638 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.232895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.233165 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.233868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] RBAC: Adding query filter params (name=image) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:17.234174 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:17.235534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:17.238216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:17.239052 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.239336 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.239612 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.240515 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:17.240624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 498/1002] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:17.241648 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:17.246608 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:17.254445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:17.255566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:30:17.256773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:17.260128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 505/1003] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:30:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:17.261613 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:17.349901 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300db062-525a-4708-9e65-3ded265ac161 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:17.363448 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51585518-e8ff-4786-b71d-3c3a2560d46d None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:17.384741 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:17.385409 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.385694 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.385965 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.386670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] RBAC: Adding query filter params (type=image) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:17.386973 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:17.388374 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:17.403796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 499/1004] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:17.404042 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:17.404042 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.404042 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.404042 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.404434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:17.404434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:17.404434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:17.412213 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 506/1005] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:17.414695 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:17.519053 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085906a7-d232-4184-991f-41b4fdf4451a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:17.555627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef5522-7ab7-4081-bc50-9a8414f83d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:17.556409 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5522-7ab7-4081-bc50-9a8414f83d81 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.556689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5522-7ab7-4081-bc50-9a8414f83d81 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.556960 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5522-7ab7-4081-bc50-9a8414f83d81 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.557676 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef5522-7ab7-4081-bc50-9a8414f83d81 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:17.557982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef5522-7ab7-4081-bc50-9a8414f83d81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:17.559364 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef5522-7ab7-4081-bc50-9a8414f83d81 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:17.571981 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 500/1006] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:30:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:17.572215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:17.672470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836e573-f252-40f3-b881-1ae79966963b None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:17.705622 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7f9d-e688-431e-a677-94c575c8e1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:17.706287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7f9d-e688-431e-a677-94c575c8e1ea None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.706564 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7f9d-e688-431e-a677-94c575c8e1ea None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.706834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7f9d-e688-431e-a677-94c575c8e1ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.707582 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb7f9d-e688-431e-a677-94c575c8e1ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:17.708987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb7f9d-e688-431e-a677-94c575c8e1ea None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:17.735794 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 507/1007] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:30:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:30:17.923705 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c7d7-7fca-444a-b59a-6c640e95fdc7 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.924262 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c7d7-7fca-444a-b59a-6c640e95fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.924262 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47c7d7-7fca-444a-b59a-6c640e95fdc7 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.925602 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 501/1008] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:17.931744 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d1db-bf5b-44f6-a3a5-88a517ce5f75 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:17.932217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d1db-bf5b-44f6-a3a5-88a517ce5f75 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:17.932322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d1db-bf5b-44f6-a3a5-88a517ce5f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:17.949973 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-4100d1db-bf5b-44f6-a3a5-88a517ce5f75 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:17.951213 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-4100d1db-bf5b-44f6-a3a5-88a517ce5f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:18.025156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 508/1009] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:17 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:18.048082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c7d7-7fca-444a-b59a-6c640e95fdc7 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:18.149846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47c7d7-7fca-444a-b59a-6c640e95fdc7 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:18.185086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:18.185882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:18.186162 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:18.186436 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] PATH_INFO: `/v3/services/compute` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:18.187089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:18.188478 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:18.201005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:18.202134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:30:18.203099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:18.207350 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 502/1010] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:18.208379 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d1db-bf5b-44f6-a3a5-88a517ce5f75 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:18.318129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d1db-bf5b-44f6-a3a5-88a517ce5f75 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:18.360463 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:18.361145 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:18.361434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:18.361709 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:18.362430 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] RBAC: Adding query filter params (name=compute) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:18.362738 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:18.364143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:18.374691 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 509/1011] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:30:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:18.377186 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:18.497178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444d955-5b79-4fd8-8d8c-feece82b859c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:18.531546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e208d9f-46ee-4aab-8306-3c7ca4d41ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:18.532260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208d9f-46ee-4aab-8306-3c7ca4d41ee4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:18.532538 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208d9f-46ee-4aab-8306-3c7ca4d41ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:18.532811 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208d9f-46ee-4aab-8306-3c7ca4d41ee4 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:18.533518 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e208d9f-46ee-4aab-8306-3c7ca4d41ee4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:18.533843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e208d9f-46ee-4aab-8306-3c7ca4d41ee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:18.535204 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e208d9f-46ee-4aab-8306-3c7ca4d41ee4 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:18.543823 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 503/1012] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:30:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:18.546763 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:18.648879 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5c41f-ba5c-4d02-95fe-3e32cd1ee751 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:18.705195 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d5d59-ed0a-4d76-b69b-90fe721542b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:18.705874 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5d59-ed0a-4d76-b69b-90fe721542b1 None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:18.706163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5d59-ed0a-4d76-b69b-90fe721542b1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:18.706441 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d5d59-ed0a-4d76-b69b-90fe721542b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:18.707192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d5d59-ed0a-4d76-b69b-90fe721542b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:18.708832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d5d59-ed0a-4d76-b69b-90fe721542b1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:18.746082 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 510/1013] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:30:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:19.700231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241d4f-b14a-49e7-bb67-c7168ac718d6 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:19.700762 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241d4f-b14a-49e7-bb67-c7168ac718d6 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:19.700872 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241d4f-b14a-49e7-bb67-c7168ac718d6 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:19.702326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 504/1014] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:19.707615 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8711-72a0-4c77-92d2-85021161cbe9 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:19.708046 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8711-72a0-4c77-92d2-85021161cbe9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:19.708211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8711-72a0-4c77-92d2-85021161cbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:19.725621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-e9bf8711-72a0-4c77-92d2-85021161cbe9 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:19.727033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-e9bf8711-72a0-4c77-92d2-85021161cbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:19.798992 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 511/1015] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:19 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:19.822447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241d4f-b14a-49e7-bb67-c7168ac718d6 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:19.929207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241d4f-b14a-49e7-bb67-c7168ac718d6 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:19.964340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34573c5f-8fd0-47ba-b7a9-1b0fba5dc1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:19.964940 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573c5f-8fd0-47ba-b7a9-1b0fba5dc1a8 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:19.965223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573c5f-8fd0-47ba-b7a9-1b0fba5dc1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:19.965502 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573c5f-8fd0-47ba-b7a9-1b0fba5dc1a8 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:19.966224 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34573c5f-8fd0-47ba-b7a9-1b0fba5dc1a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:19.967598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34573c5f-8fd0-47ba-b7a9-1b0fba5dc1a8 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:19.982449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 505/1016] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:30:19 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:20.050272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064fec6-c114-4dae-a95b-39ce7bbfec13 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:20.050628 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064fec6-c114-4dae-a95b-39ce7bbfec13 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:20.050844 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064fec6-c114-4dae-a95b-39ce7bbfec13 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:20.052561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 512/1017] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:20.058847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84226-d550-407f-b67a-98fbdf31b306 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:20.059181 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84226-d550-407f-b67a-98fbdf31b306 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:20.059410 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84226-d550-407f-b67a-98fbdf31b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:20.079603 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-46b84226-d550-407f-b67a-98fbdf31b306 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:20.080838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-46b84226-d550-407f-b67a-98fbdf31b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:20.160861 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 506/1018] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:20.183744 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064fec6-c114-4dae-a95b-39ce7bbfec13 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:20.286790 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064fec6-c114-4dae-a95b-39ce7bbfec13 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:20.320802 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958add3-d148-425d-a916-b7a619d146f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:20.321597 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958add3-d148-425d-a916-b7a619d146f3 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:20.321876 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958add3-d148-425d-a916-b7a619d146f3 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:20.322148 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958add3-d148-425d-a916-b7a619d146f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:20.323360 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958add3-d148-425d-a916-b7a619d146f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:20.324826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958add3-d148-425d-a916-b7a619d146f3 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:20.326461 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 513/1019] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:20.332503 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84226-d550-407f-b67a-98fbdf31b306 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:20.435835 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84226-d550-407f-b67a-98fbdf31b306 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:20.471691 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed02723-372f-466f-b02b-86403e964a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:20.472410 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed02723-372f-466f-b02b-86403e964a25 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:20.472691 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed02723-372f-466f-b02b-86403e964a25 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:20.472965 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed02723-372f-466f-b02b-86403e964a25 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:20.473682 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed02723-372f-466f-b02b-86403e964a25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:20.475118 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed02723-372f-466f-b02b-86403e964a25 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:20.508005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 507/1020] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:30:20 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:30:21.178518 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b113181-6c93-4e00-90c5-6248c0956280 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:21.179087 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b113181-6c93-4e00-90c5-6248c0956280 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:21.179087 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b113181-6c93-4e00-90c5-6248c0956280 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:21.181197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 514/1021] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:21.186622 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1882d-6eb9-48f5-be76-0bc880e6569f None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:21.187062 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1882d-6eb9-48f5-be76-0bc880e6569f None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:21.187166 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1882d-6eb9-48f5-be76-0bc880e6569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:21.208922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-4ce1882d-6eb9-48f5-be76-0bc880e6569f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:21.211232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-4ce1882d-6eb9-48f5-be76-0bc880e6569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:21.283782 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 508/1022] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:21.307294 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b113181-6c93-4e00-90c5-6248c0956280 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:21.408771 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b113181-6c93-4e00-90c5-6248c0956280 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:21.445819 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4bea9-205c-40a4-a2ab-1e0390afad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:21.446559 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4bea9-205c-40a4-a2ab-1e0390afad93 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:21.446841 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4bea9-205c-40a4-a2ab-1e0390afad93 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:21.447115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4bea9-205c-40a4-a2ab-1e0390afad93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:21.457112 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4bea9-205c-40a4-a2ab-1e0390afad93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-c5c4bea9-205c-40a4-a2ab-1e0390afad93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:21.465626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:21.466679 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:21.467645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:21.469088 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 515/1023] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:30:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:21.473101 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1882d-6eb9-48f5-be76-0bc880e6569f None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:21.571465 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1882d-6eb9-48f5-be76-0bc880e6569f None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:21.605342 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:21.606358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:21.606857 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:21.607442 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:21.608497 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:21.609037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:21.610634 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:21.619185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 509/1024] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:30:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:21.625141 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4bea9-205c-40a4-a2ab-1e0390afad93 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:21.732853 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4bea9-205c-40a4-a2ab-1e0390afad93 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:21.766725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:21.767530 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:21.767837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:21.768118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:21.779498 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:21.780996 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:21.798400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:21.799437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:21.800937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:21.800937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:21.800937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:21.800937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:21.800937 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 516/1025] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:21.806063 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:21.907557 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fafdb-2100-4eb2-bb7f-9375a32eedc2 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:21.941706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:21.942753 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:21.943255 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:21.945227 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:21.945227 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:21.945546 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:21.946642 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:21.960940 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 510/1026] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:21.966461 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.070531 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039556d-668a-4315-aee4-378a10ac23e7 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:22.103886 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090b9c2-9a05-496a-a5d1-87381499db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:22.104719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b9c2-9a05-496a-a5d1-87381499db17 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.105001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b9c2-9a05-496a-a5d1-87381499db17 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.105277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b9c2-9a05-496a-a5d1-87381499db17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.114099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090b9c2-9a05-496a-a5d1-87381499db17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:22.115579 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090b9c2-9a05-496a-a5d1-87381499db17 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-0090b9c2-9a05-496a-a5d1-87381499db17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:30:22.131489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:22.133270 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:30:22.134370 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:22.135857 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 517/1027] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:30:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:22.139220 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.240595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb447c-c506-43e7-8d2e-e0faac1d3b8f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:22.278542 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:22.279237 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.279522 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.279862 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.280725 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:22.281037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:22.282464 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:22.298073 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232ced3-d4e6-4419-9ecf-132d037af276 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.298592 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232ced3-d4e6-4419-9ecf-132d037af276 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.298792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232ced3-d4e6-4419-9ecf-132d037af276 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.300335 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 518/1028] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:30:22.304022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 511/1029] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:30:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:22.306580 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e169a75-6199-49d8-bdfc-9ee817df9aa0 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.306730 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e169a75-6199-49d8-bdfc-9ee817df9aa0 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.307179 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e169a75-6199-49d8-bdfc-9ee817df9aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.308078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.324861 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-0e169a75-6199-49d8-bdfc-9ee817df9aa0 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:22.325983 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-0e169a75-6199-49d8-bdfc-9ee817df9aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:22.405715 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 519/1030] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:22.419943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe318-3e1f-4d6f-9106-3c6054704a0a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:22.428196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e169a75-6199-49d8-bdfc-9ee817df9aa0 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.455263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c8be2-a35a-42ca-811d-7389d8bf66d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:22.455972 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c8be2-a35a-42ca-811d-7389d8bf66d1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.456256 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c8be2-a35a-42ca-811d-7389d8bf66d1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.456540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c8be2-a35a-42ca-811d-7389d8bf66d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.529800 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c8be2-a35a-42ca-811d-7389d8bf66d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:22.531248 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c8be2-a35a-42ca-811d-7389d8bf66d1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:22.533939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e169a75-6199-49d8-bdfc-9ee817df9aa0 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:22.570260 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:22.571077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.571364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.571638 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] PATH_INFO: `/v3/services/image` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.572374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:22.573783 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:22.587791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:22.588881 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:22.589854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 520/1031] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:30:22 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:22.595905 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.638320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 512/1032] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:22 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:30:22.644452 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c8be2-a35a-42ca-811d-7389d8bf66d1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.725452 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71299fc-c9c7-46c5-984a-e374da60cce0 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:22.752458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c8be2-a35a-42ca-811d-7389d8bf66d1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:22.760291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:22.761035 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.761318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.761590 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.762299 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] RBAC: Adding query filter params (name=image) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:22.762605 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:22.763995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:22.768933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 521/1033] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:22.774422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.786896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:22.787696 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.788031 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.788278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.798462 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:22.800082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:22.818755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:22.820383 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:22.821589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:22.821589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:22.821589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:22.821589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:22.821589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 513/1034] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:22.826039 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.880454 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc523084-ade0-4abf-9f6b-bdb13a06a455 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:22.912682 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d286d4-0d94-47ac-8164-19a3f103e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:22.913348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d286d4-0d94-47ac-8164-19a3f103e474 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.913843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d286d4-0d94-47ac-8164-19a3f103e474 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.913994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d286d4-0d94-47ac-8164-19a3f103e474 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.914785 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d286d4-0d94-47ac-8164-19a3f103e474 None admin] RBAC: Adding query filter params (type=image) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:22.915095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d286d4-0d94-47ac-8164-19a3f103e474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:22.916504 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d286d4-0d94-47ac-8164-19a3f103e474 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:22.920615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf93ffb-a9a2-43d8-9993-9b93dc353356 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:22.921474 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 522/1035] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:22.922731 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1eb5-88fa-4d33-b6a8-338909e6e7ce None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.923012 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1eb5-88fa-4d33-b6a8-338909e6e7ce None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.923285 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1eb5-88fa-4d33-b6a8-338909e6e7ce None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.924549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 523/1036] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:22.927157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1eb5-88fa-4d33-b6a8-338909e6e7ce None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:22.957150 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36ed13-f433-4541-8e41-831ca0c54353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:22.957824 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36ed13-f433-4541-8e41-831ca0c54353 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.958110 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36ed13-f433-4541-8e41-831ca0c54353 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.958390 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36ed13-f433-4541-8e41-831ca0c54353 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.959121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36ed13-f433-4541-8e41-831ca0c54353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:22.959432 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36ed13-f433-4541-8e41-831ca0c54353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:22.960963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36ed13-f433-4541-8e41-831ca0c54353 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:22.972229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 514/1037] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:22.974544 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92877efa-801e-4b51-8d44-078e431154da None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:22.974838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92877efa-801e-4b51-8d44-078e431154da None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:22.975123 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92877efa-801e-4b51-8d44-078e431154da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:22.992679 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-92877efa-801e-4b51-8d44-078e431154da None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:22.993864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-92877efa-801e-4b51-8d44-078e431154da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:23.029253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1eb5-88fa-4d33-b6a8-338909e6e7ce None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:23.058775 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 515/1038] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:23.059624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92877efa-801e-4b51-8d44-078e431154da None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:23.071070 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:23.071739 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:23.072099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:23.072365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:23.073132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] RBAC: Adding query filter params (interface=public, service_id=f5396f6ba3784ee7afd10e650f7fda60, region_id=RegionOne) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:23.073437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:23.074815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:23.084816 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 524/1039] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:30:22 2022] GET /identity/v3/endpoints?service_id=f5396f6ba3784ee7afd10e650f7fda60&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:23.086077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:23.157761 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92877efa-801e-4b51-8d44-078e431154da None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:23.184784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec2c35-d538-4ba2-909f-118b894882b1 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:23.189786 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:23.190825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:23.191100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:23.191368 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:23.198698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:23.200472 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:30:23.214724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:23.215788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 516/1040] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:23.216906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:23.222182 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf70f9-78ca-497e-a0d7-b28695f8c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:23.223061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf70f9-78ca-497e-a0d7-b28695f8c8ef None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:23.223351 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf70f9-78ca-497e-a0d7-b28695f8c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:23.223629 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf70f9-78ca-497e-a0d7-b28695f8c8ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:23.224869 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf70f9-78ca-497e-a0d7-b28695f8c8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:23.227071 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf70f9-78ca-497e-a0d7-b28695f8c8ef None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:23.231812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 525/1041] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:23.231812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf70f9-78ca-497e-a0d7-b28695f8c8ef None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:23.318221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b946bf8-e160-44cb-9431-e882bc93e4ae None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:23.327849 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf70f9-78ca-497e-a0d7-b28695f8c8ef None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:23.355379 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feff043-5618-40de-99f4-b7a576958b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:23.356096 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feff043-5618-40de-99f4-b7a576958b2b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:23.356407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feff043-5618-40de-99f4-b7a576958b2b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:23.356657 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feff043-5618-40de-99f4-b7a576958b2b None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:23.357350 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feff043-5618-40de-99f4-b7a576958b2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:23.358732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feff043-5618-40de-99f4-b7a576958b2b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:23.363348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:23.364142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:23.364498 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:23.364852 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:23.365725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:23.365878 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 517/1042] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:30:23 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:30:23.366723 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feff043-5618-40de-99f4-b7a576958b2b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:23.376309 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:23.378185 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:23.398277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 526/1043] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:30:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:23.409300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:23.515008 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feff043-5618-40de-99f4-b7a576958b2b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:23.562534 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1b0c-df0e-40ad-8228-da24edbd6365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:23.563319 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1b0c-df0e-40ad-8228-da24edbd6365 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:23.563679 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1b0c-df0e-40ad-8228-da24edbd6365 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:23.564095 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1b0c-df0e-40ad-8228-da24edbd6365 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:23.564905 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a1b0c-df0e-40ad-8228-da24edbd6365 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:23.566637 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a1b0c-df0e-40ad-8228-da24edbd6365 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:23.577273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56287d7-94c4-4327-9fa0-76e221e01334 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:23.595159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 518/1044] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:30:23 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:23.661928 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff3f9b-36b9-422a-b1ad-8f35a984d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:23.662532 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff3f9b-36b9-422a-b1ad-8f35a984d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:23.662815 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff3f9b-36b9-422a-b1ad-8f35a984d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:23.663092 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff3f9b-36b9-422a-b1ad-8f35a984d2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:23.665066 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff3f9b-36b9-422a-b1ad-8f35a984d2c0 None admin] RBAC: Adding query filter params (role.id=3f75309e353c4d65ab7989f035f0514e, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=4be3545ab61f47aab2897c713fcc1c85) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:23.665066 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff3f9b-36b9-422a-b1ad-8f35a984d2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:23.667213 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff3f9b-36b9-422a-b1ad-8f35a984d2c0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:23.674461 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 527/1045] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:23 2022] GET /identity/v3/role_assignments?user.id=4be3545ab61f47aab2897c713fcc1c85&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=3f75309e353c4d65ab7989f035f0514e => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:25.714712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28355b8-b400-4444-bedc-dc92f8499735 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:25.715256 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28355b8-b400-4444-bedc-dc92f8499735 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:25.715256 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28355b8-b400-4444-bedc-dc92f8499735 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:25.719825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 519/1046] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:25.721979 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16e48-6475-441c-b60d-a9869f4072c8 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:25.722394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16e48-6475-441c-b60d-a9869f4072c8 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:25.722566 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f16e48-6475-441c-b60d-a9869f4072c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:25.740433 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-71f16e48-6475-441c-b60d-a9869f4072c8 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:25.742135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-71f16e48-6475-441c-b60d-a9869f4072c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:25.810565 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 528/1047] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:25.834937 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28355b8-b400-4444-bedc-dc92f8499735 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:25.951137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28355b8-b400-4444-bedc-dc92f8499735 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:25.995398 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:25.996598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:25.997099 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:25.997585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] PATH_INFO: `/v3/services/image` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:25.998451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.000066 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:26.011863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:26.013029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:30:26.014073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:26.016800 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 520/1048] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:30:25 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:26.022144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb922e-60a3-42b5-8923-a6ee626c7114 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.022295 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.022479 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb922e-60a3-42b5-8923-a6ee626c7114 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.022708 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb922e-60a3-42b5-8923-a6ee626c7114 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.024918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 529/1049] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:26.029792 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2da8-e837-48c3-a719-9141def4f78f None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.030083 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2da8-e837-48c3-a719-9141def4f78f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.030364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2da8-e837-48c3-a719-9141def4f78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.047183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-beeb2da8-e837-48c3-a719-9141def4f78f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:26.048410 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-beeb2da8-e837-48c3-a719-9141def4f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:26.115431 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 530/1050] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:26.117471 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495dfc-7c9a-4dd4-a076-2c749f3f9dcb None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.117832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495dfc-7c9a-4dd4-a076-2c749f3f9dcb None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.118196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495dfc-7c9a-4dd4-a076-2c749f3f9dcb None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.119628 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 531/1051] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:26.122687 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426d91b-6bb6-4d02-b69c-9f8643bcc886 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.125046 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b2b0-659f-4966-91bd-addfe2859d95 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.125333 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b2b0-659f-4966-91bd-addfe2859d95 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.125611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931b2b0-659f-4966-91bd-addfe2859d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.142228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-a931b2b0-659f-4966-91bd-addfe2859d95 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:26.143417 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-a931b2b0-659f-4966-91bd-addfe2859d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:26.156964 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.157637 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.157922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.158203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.158914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] RBAC: Adding query filter params (name=image) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:26.159226 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.160740 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:26.165694 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 521/1052] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:26.166497 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.214782 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 532/1053] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:26.215644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931b2b0-659f-4966-91bd-addfe2859d95 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.271382 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bc9b7-1cc1-4e26-a444-04b0941fcd89 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.305506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79fc89-46ff-4a2f-9730-d904109a07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.306317 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79fc89-46ff-4a2f-9730-d904109a07a4 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.306603 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79fc89-46ff-4a2f-9730-d904109a07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.306881 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79fc89-46ff-4a2f-9730-d904109a07a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.316484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931b2b0-659f-4966-91bd-addfe2859d95 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.317179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79fc89-46ff-4a2f-9730-d904109a07a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-5a79fc89-46ff-4a2f-9730-d904109a07a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:26.325860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:26.326955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 522/1054] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:26.328046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79fc89-46ff-4a2f-9730-d904109a07a4 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.354146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.354818 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.355100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.355377 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.356131 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] RBAC: Adding query filter params (type=image) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:26.356434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.357837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:26.362675 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 533/1055] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:26.363452 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.427900 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79fc89-46ff-4a2f-9730-d904109a07a4 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.462149 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95edc5a-4a65-45b8-9085-148c527f6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.462942 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95edc5a-4a65-45b8-9085-148c527f6f04 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.463228 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95edc5a-4a65-45b8-9085-148c527f6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.463506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95edc5a-4a65-45b8-9085-148c527f6f04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.466659 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25253-0920-4faa-91b8-324a0c019e03 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.473458 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95edc5a-4a65-45b8-9085-148c527f6f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-d95edc5a-4a65-45b8-9085-148c527f6f04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:26.481722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:26.482825 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:26.483830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:26.484573 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 523/1056] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:26.484785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95edc5a-4a65-45b8-9085-148c527f6f04 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.503319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.504333 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.504816 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.505090 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.505843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:26.506152 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.508473 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:26.516414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 534/1057] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:26.517201 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.583070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95edc5a-4a65-45b8-9085-148c527f6f04 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.614066 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f603754-b916-4fc4-8b0d-64aaa8eb4cd5 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.615917 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f85c-de41-4276-bfdc-837fc6eeb668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.617411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f85c-de41-4276-bfdc-837fc6eeb668 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.617411 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f85c-de41-4276-bfdc-837fc6eeb668 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.617952 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f85c-de41-4276-bfdc-837fc6eeb668 None admin] PATH_INFO: `/v3/endpoints` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.618779 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86f85c-de41-4276-bfdc-837fc6eeb668 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.620257 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86f85c-de41-4276-bfdc-837fc6eeb668 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:26.639447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 524/1058] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:30:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:26.640393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f85c-de41-4276-bfdc-837fc6eeb668 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.665757 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.666459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.666745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.667026 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.667839 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:26.668151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.669571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:26.681606 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 535/1059] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:26.687475 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.754467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f85c-de41-4276-bfdc-837fc6eeb668 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.792324 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.793142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.793474 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.793747 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.799844 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f1ca6-effd-46e4-a163-05398e381b1c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.805258 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.806944 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:26.826354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:26.827448 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:26.828506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:26.828506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:26.828506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:26.828506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:26.828506 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 525/1060] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:26.833313 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.842823 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac7d7-b3e5-4dbb-8760-29c7d9c64d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.843701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac7d7-b3e5-4dbb-8760-29c7d9c64d5e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.844102 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac7d7-b3e5-4dbb-8760-29c7d9c64d5e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.844377 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ac7d7-b3e5-4dbb-8760-29c7d9c64d5e None admin] PATH_INFO: `/v3/users/d565dcd0f6d748768ec066be30a03867` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.862728 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ac7d7-b3e5-4dbb-8760-29c7d9c64d5e None admin] RBAC: Authorizing `identity:get_user(user_id=d565dcd0f6d748768ec066be30a03867)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.864365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ac7d7-b3e5-4dbb-8760-29c7d9c64d5e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:26.866006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 536/1061] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/users/d565dcd0f6d748768ec066be30a03867 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:26.871121 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac7d7-b3e5-4dbb-8760-29c7d9c64d5e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:26.948856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883320d-ee3a-4635-96a6-2bc1589c05bc None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.973894 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ac7d7-b3e5-4dbb-8760-29c7d9c64d5e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:26.984473 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:26.985229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:26.985588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:26.985954 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:26.987809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:26.987809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:26.988595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.002401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 526/1062] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:27.009063 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:27.010176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01afbf4-a71f-4e05-8bb4-dce790b2e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:27.010829 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01afbf4-a71f-4e05-8bb4-dce790b2e261 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:27.011106 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01afbf4-a71f-4e05-8bb4-dce790b2e261 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:27.011376 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01afbf4-a71f-4e05-8bb4-dce790b2e261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:27.080332 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01afbf4-a71f-4e05-8bb4-dce790b2e261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:27.081784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01afbf4-a71f-4e05-8bb4-dce790b2e261 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.113002 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2df8c-c3da-475c-b730-909ee713e17f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:27.149206 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:27.150007 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:27.150291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:27.150568 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:27.157959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:27.159396 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:30:27.175394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:27.177769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:27.180830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 527/1063] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:30:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:27.184372 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:27.191217 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 537/1064] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:30:27.197396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01afbf4-a71f-4e05-8bb4-dce790b2e261 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:27.288070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c51cd-49d8-4be6-aa96-23a8c328f8bd None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:27.293985 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01afbf4-a71f-4e05-8bb4-dce790b2e261 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:27.324029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:27.324991 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:27.325424 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:27.325882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:27.326890 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:27.327078 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479979a2-3ce1-499e-8126-4ed8378d221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:27.327529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:27.327978 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479979a2-3ce1-499e-8126-4ed8378d221f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:27.328264 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479979a2-3ce1-499e-8126-4ed8378d221f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:27.328545 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479979a2-3ce1-499e-8126-4ed8378d221f None admin] PATH_INFO: `/v3/projects/fdd85d4848174a28a55ea4a09c5b109e` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:27.329696 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.329834 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479979a2-3ce1-499e-8126-4ed8378d221f None admin] RBAC: Authorizing `identity:get_project(project_id=fdd85d4848174a28a55ea4a09c5b109e)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:27.331155 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479979a2-3ce1-499e-8126-4ed8378d221f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.333096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 538/1065] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:30:27 2022] GET /identity/v3/projects/fdd85d4848174a28a55ea4a09c5b109e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:27.339504 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479979a2-3ce1-499e-8126-4ed8378d221f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:27.354447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 528/1066] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:30:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:27.358984 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:27.449894 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479979a2-3ce1-499e-8126-4ed8378d221f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:27.458237 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeb9f6-52bf-4cc7-a1d9-2139df9bd259 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:27.486221 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:27.486880 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:27.487154 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:27.487421 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:27.488282 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=fdd85d4848174a28a55ea4a09c5b109e, user.id=d565dcd0f6d748768ec066be30a03867) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:27.488591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:27.490007 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.494526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:27.495408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:27.495790 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:27.496153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:27.499801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 539/1067] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:27 2022] GET /identity/v3/role_assignments?user.id=d565dcd0f6d748768ec066be30a03867&scope.project.id=fdd85d4848174a28a55ea4a09c5b109e&role.id=8cf832105b2949f6b11e06b208146326 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:27.511756 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:27.513291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:27.533203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:27.534273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:27.535320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:27.535320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:27.535320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:27.535320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:27.535320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 529/1068] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:27.542369 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:27.651057 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7587-9dc7-4eba-8458-0f4a3d416c44 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:27.689611 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:27.690540 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:27.690825 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:27.691098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:27.691861 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:27.692170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:27.693539 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.706199 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 540/1069] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:27.711944 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:27.812222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a53ece-c165-4783-ab30-2260f2c6ed8e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:27.847090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:27.847914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:27.848196 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:27.848470 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:27.856343 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:27.857790 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:30:27.872281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:27.873337 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:27.879265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 530/1070] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:27.881747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:27.985220 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4c6e-b087-438a-a4c4-2cf4035c2960 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:28.020273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026ae8c-331f-4b89-95e3-17f4073d15e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:28.020944 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ae8c-331f-4b89-95e3-17f4073d15e5 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:28.021226 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ae8c-331f-4b89-95e3-17f4073d15e5 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:28.021503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ae8c-331f-4b89-95e3-17f4073d15e5 None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:28.022295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ae8c-331f-4b89-95e3-17f4073d15e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:28.022603 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ae8c-331f-4b89-95e3-17f4073d15e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:28.024100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ae8c-331f-4b89-95e3-17f4073d15e5 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:28.036091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 541/1071] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:30:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:28.042176 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:28.148653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01cb7a-b126-42fb-a67e-3fe59f92e124 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:28.188505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f72a53-1321-4dff-b307-1550bd158871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:28.189410 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f72a53-1321-4dff-b307-1550bd158871 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:28.189692 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f72a53-1321-4dff-b307-1550bd158871 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:28.189968 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f72a53-1321-4dff-b307-1550bd158871 None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/4be3545ab61f47aab2897c713fcc1c85/roles/3f75309e353c4d65ab7989f035f0514e` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:28.192468 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f72a53-1321-4dff-b307-1550bd158871 None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=4be3545ab61f47aab2897c713fcc1c85, role_id=3f75309e353c4d65ab7989f035f0514e)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:28.193899 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f72a53-1321-4dff-b307-1550bd158871 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:28.212031 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 531/1072] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:30:28 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/4be3545ab61f47aab2897c713fcc1c85/roles/3f75309e353c4d65ab7989f035f0514e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:30:28.970955 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893dfde-f742-4b70-aa0f-57f9726bff61 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:28.971533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893dfde-f742-4b70-aa0f-57f9726bff61 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:28.971533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893dfde-f742-4b70-aa0f-57f9726bff61 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:28.972980 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 542/1073] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:30:28.979148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1aad8-dec3-4d79-bf6c-f073c02041d0 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:28.979611 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1aad8-dec3-4d79-bf6c-f073c02041d0 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:28.979706 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1aad8-dec3-4d79-bf6c-f073c02041d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:28.996466 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-7da1aad8-dec3-4d79-bf6c-f073c02041d0 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:28.997738 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-7da1aad8-dec3-4d79-bf6c-f073c02041d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:29.066430 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 532/1074] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:29.089002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893dfde-f742-4b70-aa0f-57f9726bff61 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:29.187343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893dfde-f742-4b70-aa0f-57f9726bff61 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:29.222964 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb33e-2cbc-4cb8-99d8-9fb68edea1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:29.223545 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb33e-2cbc-4cb8-99d8-9fb68edea1fe None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:29.223860 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb33e-2cbc-4cb8-99d8-9fb68edea1fe None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:29.224145 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb33e-2cbc-4cb8-99d8-9fb68edea1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:29.291266 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bb33e-2cbc-4cb8-99d8-9fb68edea1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:29.292764 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bb33e-2cbc-4cb8-99d8-9fb68edea1fe None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:29.402001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 543/1075] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:30:29.407791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1aad8-dec3-4d79-bf6c-f073c02041d0 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:29.508644 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1aad8-dec3-4d79-bf6c-f073c02041d0 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:29.540778 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad9147-c8fe-461b-becd-abaa56c4309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:29.541571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9147-c8fe-461b-becd-abaa56c4309d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:29.541852 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9147-c8fe-461b-becd-abaa56c4309d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:29.542124 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9147-c8fe-461b-becd-abaa56c4309d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:29.551712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad9147-c8fe-461b-becd-abaa56c4309d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:29.553169 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad9147-c8fe-461b-becd-abaa56c4309d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4dad9147-c8fe-461b-becd-abaa56c4309d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:29.570956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:29.577328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:29.578750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:29.578750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:29.578750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:29.578750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:29.578750 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 533/1076] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:29.580541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb33e-2cbc-4cb8-99d8-9fb68edea1fe None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:29.696631 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb33e-2cbc-4cb8-99d8-9fb68edea1fe None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:29.732804 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8651ed-14d5-4fc4-b53a-dc0154b296bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:29.733472 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8651ed-14d5-4fc4-b53a-dc0154b296bd None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:29.733757 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8651ed-14d5-4fc4-b53a-dc0154b296bd None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:29.734037 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8651ed-14d5-4fc4-b53a-dc0154b296bd None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:29.734762 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8651ed-14d5-4fc4-b53a-dc0154b296bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:29.735071 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8651ed-14d5-4fc4-b53a-dc0154b296bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:29.736469 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8651ed-14d5-4fc4-b53a-dc0154b296bd None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:29.748457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 544/1077] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:29.790804 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814cea7-8570-4687-9ae0-2faba2208905 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:29.791006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814cea7-8570-4687-9ae0-2faba2208905 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:29.791276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814cea7-8570-4687-9ae0-2faba2208905 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:29.792914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 534/1078] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:29.798608 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b48ac-83f0-4ecc-aca0-ebe353f8b77f None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:29.798920 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b48ac-83f0-4ecc-aca0-ebe353f8b77f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:29.799166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b48ac-83f0-4ecc-aca0-ebe353f8b77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:29.818860 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-c42b48ac-83f0-4ecc-aca0-ebe353f8b77f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:29.821005 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-c42b48ac-83f0-4ecc-aca0-ebe353f8b77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:29.896116 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 545/1079] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:29.918005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814cea7-8570-4687-9ae0-2faba2208905 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:30.035093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814cea7-8570-4687-9ae0-2faba2208905 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:30.074516 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a3227-0c3b-4e98-b505-e15d53007a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:30.075273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a3227-0c3b-4e98-b505-e15d53007a6e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.075553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a3227-0c3b-4e98-b505-e15d53007a6e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.075874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a3227-0c3b-4e98-b505-e15d53007a6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.086522 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a3227-0c3b-4e98-b505-e15d53007a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-0e5a3227-0c3b-4e98-b505-e15d53007a6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:30.094384 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:30.095641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:30.097126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 535/1080] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:30.102523 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b48ac-83f0-4ecc-aca0-ebe353f8b77f None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:30.200567 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b48ac-83f0-4ecc-aca0-ebe353f8b77f None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:30.234128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:30.234795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.235077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.235354 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.236141 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:30.236450 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:30.237828 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:30.248021 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 546/1081] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:30.253794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a3227-0c3b-4e98-b505-e15d53007a6e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:30.364872 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a3227-0c3b-4e98-b505-e15d53007a6e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:30.399519 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4a6c-1f8f-41cd-a521-18d7049117f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:30.400433 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4a6c-1f8f-41cd-a521-18d7049117f1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.400721 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4a6c-1f8f-41cd-a521-18d7049117f1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.401001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4a6c-1f8f-41cd-a521-18d7049117f1 None admin] PATH_INFO: `/v3/users/d565dcd0f6d748768ec066be30a03867` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.402209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca4a6c-1f8f-41cd-a521-18d7049117f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d565dcd0f6d748768ec066be30a03867)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:30.403644 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca4a6c-1f8f-41cd-a521-18d7049117f1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:30.405339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 536/1082] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:30 2022] GET /identity/v3/users/d565dcd0f6d748768ec066be30a03867 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:30.411170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:30.510695 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7fa09-d939-4a89-916c-d91bcbe286ff None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:30.521346 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917cc13-0827-45b7-9c29-491ba794cb3b None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.521714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917cc13-0827-45b7-9c29-491ba794cb3b None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.522002 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917cc13-0827-45b7-9c29-491ba794cb3b None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.524320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 537/1083] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:30:30.529450 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb484e0-2058-4ea7-9d7a-72c3b224980b None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.529738 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb484e0-2058-4ea7-9d7a-72c3b224980b None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.530016 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb484e0-2058-4ea7-9d7a-72c3b224980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.544886 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef707f-b27b-4966-a2cf-044ea19a63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:30.545751 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef707f-b27b-4966-a2cf-044ea19a63c9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.546036 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef707f-b27b-4966-a2cf-044ea19a63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.546314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef707f-b27b-4966-a2cf-044ea19a63c9 None admin] PATH_INFO: `/v3/projects/fdd85d4848174a28a55ea4a09c5b109e` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.547063 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-dcb484e0-2058-4ea7-9d7a-72c3b224980b None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:30.547506 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef707f-b27b-4966-a2cf-044ea19a63c9 None admin] RBAC: Authorizing `identity:get_project(project_id=fdd85d4848174a28a55ea4a09c5b109e)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:30.548302 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-dcb484e0-2058-4ea7-9d7a-72c3b224980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:30.548997 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef707f-b27b-4966-a2cf-044ea19a63c9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:30.550707 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 547/1084] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:30:30 2022] GET /identity/v3/projects/fdd85d4848174a28a55ea4a09c5b109e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:30.557137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef707f-b27b-4966-a2cf-044ea19a63c9 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:30.618909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 538/1085] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:30.642648 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb484e0-2058-4ea7-9d7a-72c3b224980b None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:30.655557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef707f-b27b-4966-a2cf-044ea19a63c9 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:30.689429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fe0a-de24-4f6a-b4ea-7f39135759b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:30.690579 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe0a-de24-4f6a-b4ea-7f39135759b0 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.690861 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe0a-de24-4f6a-b4ea-7f39135759b0 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.691137 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95fe0a-de24-4f6a-b4ea-7f39135759b0 None admin] PATH_INFO: `/v3/projects/fdd85d4848174a28a55ea4a09c5b109e/users/d565dcd0f6d748768ec066be30a03867/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.693176 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95fe0a-de24-4f6a-b4ea-7f39135759b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd85d4848174a28a55ea4a09c5b109e, user_id=d565dcd0f6d748768ec066be30a03867, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:30.695172 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95fe0a-de24-4f6a-b4ea-7f39135759b0 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:30.708077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 548/1086] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:30:30 2022] PUT /identity/v3/projects/fdd85d4848174a28a55ea4a09c5b109e/users/d565dcd0f6d748768ec066be30a03867/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:30:30.753281 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb484e0-2058-4ea7-9d7a-72c3b224980b None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:30.792067 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211021fa-86ee-4371-8761-0b119533162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:30.792903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211021fa-86ee-4371-8761-0b119533162e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.793185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211021fa-86ee-4371-8761-0b119533162e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.793461 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211021fa-86ee-4371-8761-0b119533162e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.805112 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211021fa-86ee-4371-8761-0b119533162e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-211021fa-86ee-4371-8761-0b119533162e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:30.813492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:30.814774 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:30.816471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 539/1087] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:30:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:30.821742 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fe0a-de24-4f6a-b4ea-7f39135759b0 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:30.927444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95fe0a-de24-4f6a-b4ea-7f39135759b0 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:30.961853 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:30.962527 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:30.962813 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:30.963092 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:30.963876 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:30.964191 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:30.965556 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:30.973487 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 549/1088] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:30:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:30.979712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211021fa-86ee-4371-8761-0b119533162e None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:31.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211021fa-86ee-4371-8761-0b119533162e None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:31.115321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:31.116146 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:31.116670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:31.116924 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:31.127354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:31.128955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:31.145545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:31.146732 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:31.148312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:31.148312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:31.148312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:31.148312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:31.148312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 540/1089] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:31.153026 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:31.259795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f87d9-4f61-419e-a3b1-3303523f99b6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:31.292737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:31.293398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:31.293677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:31.293948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:31.294672 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:31.294976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:31.296378 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:31.308553 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 550/1090] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:31.314216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:31.415182 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd3033-6216-4664-99f1-66103de9e67c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:31.448529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:31.449327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:31.449611 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:31.449886 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:31.457403 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:31.458842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:30:31.473178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:31.474457 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:30:31.475792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:31.479207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 541/1091] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:30:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:30:31.480330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:31.579537 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef5ca6-dc69-4199-98bb-41ae120d4327 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:31.612009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:31.612676 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:31.612957 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:31.613230 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:31.614060 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:31.614368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:31.615801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:31.634390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 551/1092] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:30:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:31.640134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:31.737897 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c0d1e-b10e-42d4-b723-63a0549208b6 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:31.770977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6500c-f0b0-4ea9-ad59-6f57c9c15426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:31.771624 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6500c-f0b0-4ea9-ad59-6f57c9c15426 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:31.771942 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6500c-f0b0-4ea9-ad59-6f57c9c15426 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:31.772223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6500c-f0b0-4ea9-ad59-6f57c9c15426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:31.840970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6500c-f0b0-4ea9-ad59-6f57c9c15426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:31.842355 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6500c-f0b0-4ea9-ad59-6f57c9c15426 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:31.938132 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 542/1093] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:30:31.944286 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:32.041826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff5fbc-3317-4dcf-8b19-416c32625b13 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:32.076352 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:32.077144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:32.077428 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:32.077705 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:32.088169 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:32.089602 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:30:32.107384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:32.113196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:32.114287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:30:32.114287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:30:32.114287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:30:32.114287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:32.114287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 552/1094] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:32.114618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6500c-f0b0-4ea9-ad59-6f57c9c15426 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:32.213596 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6500c-f0b0-4ea9-ad59-6f57c9c15426 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:32.246207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:32.246870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:32.247153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:32.247426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:32.248177 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:32.248486 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:32.249859 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:32.261598 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 543/1095] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:32.267223 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:32.365259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0d661-5c34-4ae7-b9c5-9866b7003d49 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:32.399921 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:32.400630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:32.400912 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:32.401186 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:32.407756 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:32.409224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:30:32.423117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:32.424338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:30:32.425396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 553/1096] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:30:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:32.430371 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:32.529610 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea1893-2a03-447c-bd5e-e545094b4de5 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:32.562168 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa855d-6e43-4d52-bab7-c73f894b0649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:32.562830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa855d-6e43-4d52-bab7-c73f894b0649 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:32.563115 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa855d-6e43-4d52-bab7-c73f894b0649 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:32.563394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa855d-6e43-4d52-bab7-c73f894b0649 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:32.564227 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa855d-6e43-4d52-bab7-c73f894b0649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:32.564542 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa855d-6e43-4d52-bab7-c73f894b0649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:32.566597 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa855d-6e43-4d52-bab7-c73f894b0649 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:32.579929 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 544/1097] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:30:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:32.585959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:32.684446 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111f90-f1c2-4e43-aa8b-9b0d2d4c4039 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:32.718543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2774c-bb99-42a4-a9ee-1f57a4a993c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:32.719310 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2774c-bb99-42a4-a9ee-1f57a4a993c2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:32.719594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2774c-bb99-42a4-a9ee-1f57a4a993c2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:32.719972 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2774c-bb99-42a4-a9ee-1f57a4a993c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:32.720819 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2774c-bb99-42a4-a9ee-1f57a4a993c2 None admin] RBAC: Adding query filter params (role.id=3f75309e353c4d65ab7989f035f0514e, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=4be3545ab61f47aab2897c713fcc1c85) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:32.721132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2774c-bb99-42a4-a9ee-1f57a4a993c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:32.722560 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2774c-bb99-42a4-a9ee-1f57a4a993c2 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:32.739800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 554/1098] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:32 2022] GET /identity/v3/role_assignments?user.id=4be3545ab61f47aab2897c713fcc1c85&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=3f75309e353c4d65ab7989f035f0514e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:32.935577 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2cd9-0d44-4163-9120-6f4e488044f3 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:32.935855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2cd9-0d44-4163-9120-6f4e488044f3 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:32.936140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2cd9-0d44-4163-9120-6f4e488044f3 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:32.937528 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 545/1099] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:32.943363 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fb28f-a2bf-4843-89e5-6b483608a38f None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:32.943659 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fb28f-a2bf-4843-89e5-6b483608a38f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:32.944001 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fb28f-a2bf-4843-89e5-6b483608a38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:32.962041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-a39fb28f-a2bf-4843-89e5-6b483608a38f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:32.963248 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-a39fb28f-a2bf-4843-89e5-6b483608a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:33.034249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 555/1100] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:33.059033 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab2cd9-0d44-4163-9120-6f4e488044f3 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:33.163279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab2cd9-0d44-4163-9120-6f4e488044f3 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:33.197792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954e18a-6c2a-4097-8993-6c2c4ab03f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:33.198515 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e18a-6c2a-4097-8993-6c2c4ab03f76 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:33.198806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e18a-6c2a-4097-8993-6c2c4ab03f76 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:33.199085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e18a-6c2a-4097-8993-6c2c4ab03f76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:33.209681 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954e18a-6c2a-4097-8993-6c2c4ab03f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4954e18a-6c2a-4097-8993-6c2c4ab03f76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:33.218505 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:33.219717 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:33.220728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 546/1101] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:33.226484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fb28f-a2bf-4843-89e5-6b483608a38f None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:33.328249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fb28f-a2bf-4843-89e5-6b483608a38f None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:33.363263 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:33.363965 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:33.364255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:33.364520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:33.365267 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:33.365567 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:33.367098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:33.375868 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 556/1102] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:33.381681 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954e18a-6c2a-4097-8993-6c2c4ab03f76 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:33.487432 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954e18a-6c2a-4097-8993-6c2c4ab03f76 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:33.527796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e123b41-9fea-470d-bbfe-0c8a19f54152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:33.528705 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e123b41-9fea-470d-bbfe-0c8a19f54152 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:33.528983 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e123b41-9fea-470d-bbfe-0c8a19f54152 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:33.529250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e123b41-9fea-470d-bbfe-0c8a19f54152 None admin] PATH_INFO: `/v3/users/d565dcd0f6d748768ec066be30a03867` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:33.530489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e123b41-9fea-470d-bbfe-0c8a19f54152 None admin] RBAC: Authorizing `identity:get_user(user_id=d565dcd0f6d748768ec066be30a03867)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:33.531959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e123b41-9fea-470d-bbfe-0c8a19f54152 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:33.533792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 547/1103] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:33 2022] GET /identity/v3/users/d565dcd0f6d748768ec066be30a03867 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:33.539606 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:33.642891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8c4df-657a-47cf-88fc-76a79d8fce57 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:33.677654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e0eb-b5a6-4431-be2c-93cf53f7b333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:33.678570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e0eb-b5a6-4431-be2c-93cf53f7b333 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:33.679856 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e0eb-b5a6-4431-be2c-93cf53f7b333 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:33.680307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e0eb-b5a6-4431-be2c-93cf53f7b333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:33.749065 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e0eb-b5a6-4431-be2c-93cf53f7b333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:33.750457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e0eb-b5a6-4431-be2c-93cf53f7b333 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:33.849235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 557/1104] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:30:33.857800 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e123b41-9fea-470d-bbfe-0c8a19f54152 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:33.957631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e123b41-9fea-470d-bbfe-0c8a19f54152 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:33.991122 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed6a71-a4a1-43f7-82aa-749449d0bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:33.992069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed6a71-a4a1-43f7-82aa-749449d0bf73 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:33.992351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed6a71-a4a1-43f7-82aa-749449d0bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:33.992632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed6a71-a4a1-43f7-82aa-749449d0bf73 None admin] PATH_INFO: `/v3/projects/fdd85d4848174a28a55ea4a09c5b109e` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:33.993826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed6a71-a4a1-43f7-82aa-749449d0bf73 None admin] RBAC: Authorizing `identity:get_project(project_id=fdd85d4848174a28a55ea4a09c5b109e)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:33.995540 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed6a71-a4a1-43f7-82aa-749449d0bf73 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:33.997284 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 548/1105] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:30:33 2022] GET /identity/v3/projects/fdd85d4848174a28a55ea4a09c5b109e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:34.003706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e0eb-b5a6-4431-be2c-93cf53f7b333 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:34.098797 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e0eb-b5a6-4431-be2c-93cf53f7b333 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:34.131657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b9d84-50af-4937-8123-441a2ead4a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:34.132338 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b9d84-50af-4937-8123-441a2ead4a05 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:34.132622 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b9d84-50af-4937-8123-441a2ead4a05 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:34.132897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b9d84-50af-4937-8123-441a2ead4a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:34.133733 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b9d84-50af-4937-8123-441a2ead4a05 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=fdd85d4848174a28a55ea4a09c5b109e, user.id=d565dcd0f6d748768ec066be30a03867) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:34.134050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b9d84-50af-4937-8123-441a2ead4a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:34.135471 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b9d84-50af-4937-8123-441a2ead4a05 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:34.141250 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 558/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:34 2022] GET /identity/v3/role_assignments?user.id=d565dcd0f6d748768ec066be30a03867&scope.project.id=fdd85d4848174a28a55ea4a09c5b109e&role.id=8cf832105b2949f6b11e06b208146326 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:36.416296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871fd63-a909-413c-bb4d-4bd82b0f5756 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:36.416809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871fd63-a909-413c-bb4d-4bd82b0f5756 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:36.416929 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871fd63-a909-413c-bb4d-4bd82b0f5756 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:36.418221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 549/1107] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:36.423542 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eab6a-8239-4f9e-a764-e92d9f8fa85a None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:36.424019 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eab6a-8239-4f9e-a764-e92d9f8fa85a None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:36.424128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eab6a-8239-4f9e-a764-e92d9f8fa85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:36.440725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-242eab6a-8239-4f9e-a764-e92d9f8fa85a None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:36.441893 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-242eab6a-8239-4f9e-a764-e92d9f8fa85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:36.507235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 559/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:36.532058 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871fd63-a909-413c-bb4d-4bd82b0f5756 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:36.629394 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871fd63-a909-413c-bb4d-4bd82b0f5756 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:36.662332 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165915-89f9-4e65-93a0-af9d256c681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:36.663189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165915-89f9-4e65-93a0-af9d256c681b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:36.663552 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165915-89f9-4e65-93a0-af9d256c681b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:36.663896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165915-89f9-4e65-93a0-af9d256c681b None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:36.665153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d165915-89f9-4e65-93a0-af9d256c681b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:36.666662 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d165915-89f9-4e65-93a0-af9d256c681b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:36.668328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 550/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:36.674025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242eab6a-8239-4f9e-a764-e92d9f8fa85a None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:36.771245 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242eab6a-8239-4f9e-a764-e92d9f8fa85a None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:36.804804 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa67be-3f82-4382-a2a7-0318f531caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:36.805465 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa67be-3f82-4382-a2a7-0318f531caed None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:36.805795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa67be-3f82-4382-a2a7-0318f531caed None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:36.806011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa67be-3f82-4382-a2a7-0318f531caed None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:36.806719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa67be-3f82-4382-a2a7-0318f531caed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:36.808182 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa67be-3f82-4382-a2a7-0318f531caed None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:36.827830 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 560/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:30:36 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:39.181510 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22039-0ac8-45a9-b5e0-b0ddc9f5e8ed None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:39.182076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22039-0ac8-45a9-b5e0-b0ddc9f5e8ed None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:39.182076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22039-0ac8-45a9-b5e0-b0ddc9f5e8ed None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:39.183426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 551/1111] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:30:39.188667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9187-7453-4845-a9c9-e29a6cb29813 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:39.189122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9187-7453-4845-a9c9-e29a6cb29813 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:39.189232 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9187-7453-4845-a9c9-e29a6cb29813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:39.205918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-51df9187-7453-4845-a9c9-e29a6cb29813 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:39.207142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-51df9187-7453-4845-a9c9-e29a6cb29813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:39.271616 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 561/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:30:39.305493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22039-0ac8-45a9-b5e0-b0ddc9f5e8ed None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:39.404447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22039-0ac8-45a9-b5e0-b0ddc9f5e8ed None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:39.436900 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b71b1-74df-433a-9004-9898ffb2a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:39.437719 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b71b1-74df-433a-9004-9898ffb2a332 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:39.437997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b71b1-74df-433a-9004-9898ffb2a332 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:39.438265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b71b1-74df-433a-9004-9898ffb2a332 None admin] PATH_INFO: `/v3/roles/7c610827438840438f3b3e90fac7c51c` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:39.439748 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b71b1-74df-433a-9004-9898ffb2a332 None admin] RBAC: Authorizing `identity:get_role(role_id=7c610827438840438f3b3e90fac7c51c)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:39.441558 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b71b1-74df-433a-9004-9898ffb2a332 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:39.442931 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 552/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:39 2022] GET /identity/v3/roles/7c610827438840438f3b3e90fac7c51c => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:39.449011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df9187-7453-4845-a9c9-e29a6cb29813 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:39.551229 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df9187-7453-4845-a9c9-e29a6cb29813 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:39.584317 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13c35d-1596-405c-a01d-0f149ad67879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:39.585899 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13c35d-1596-405c-a01d-0f149ad67879 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:39.586358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13c35d-1596-405c-a01d-0f149ad67879 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:39.586790 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13c35d-1596-405c-a01d-0f149ad67879 None admin] PATH_INFO: `/v3/users/6753582980aa477f9135bbcd26de8f15` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:39.606910 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13c35d-1596-405c-a01d-0f149ad67879 None admin] RBAC: Authorizing `identity:get_user(user_id=6753582980aa477f9135bbcd26de8f15)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:39.608403 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13c35d-1596-405c-a01d-0f149ad67879 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:39.610315 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 562/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:39 2022] GET /identity/v3/users/6753582980aa477f9135bbcd26de8f15 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:39.616098 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b71b1-74df-433a-9004-9898ffb2a332 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:39.718974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b71b1-74df-433a-9004-9898ffb2a332 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:39.752978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b2730-810a-457a-b4f6-56c4508ab66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:39.753631 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b2730-810a-457a-b4f6-56c4508ab66f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:39.753918 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b2730-810a-457a-b4f6-56c4508ab66f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:39.754197 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b2730-810a-457a-b4f6-56c4508ab66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:39.823031 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b2730-810a-457a-b4f6-56c4508ab66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:39.824431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b2730-810a-457a-b4f6-56c4508ab66f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:39.924674 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 553/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:30:39.931160 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13c35d-1596-405c-a01d-0f149ad67879 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:40.031816 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13c35d-1596-405c-a01d-0f149ad67879 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:40.066243 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc36ebb-93fd-43af-8a1e-13ebe3881d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:40.067107 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36ebb-93fd-43af-8a1e-13ebe3881d79 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:40.067390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36ebb-93fd-43af-8a1e-13ebe3881d79 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:40.067664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36ebb-93fd-43af-8a1e-13ebe3881d79 None admin] PATH_INFO: `/v3/projects/fdd85d4848174a28a55ea4a09c5b109e` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:40.068995 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc36ebb-93fd-43af-8a1e-13ebe3881d79 None admin] RBAC: Authorizing `identity:get_project(project_id=fdd85d4848174a28a55ea4a09c5b109e)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:40.070521 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc36ebb-93fd-43af-8a1e-13ebe3881d79 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:40.073248 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 563/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:30:39 2022] GET /identity/v3/projects/fdd85d4848174a28a55ea4a09c5b109e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:40.079131 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b2730-810a-457a-b4f6-56c4508ab66f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:40.193716 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b2730-810a-457a-b4f6-56c4508ab66f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:40.232940 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a94ec2-8921-40f9-b7e2-7b4aa3191153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:40.233615 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94ec2-8921-40f9-b7e2-7b4aa3191153 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:40.233895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94ec2-8921-40f9-b7e2-7b4aa3191153 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:40.234170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94ec2-8921-40f9-b7e2-7b4aa3191153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:40.235013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94ec2-8921-40f9-b7e2-7b4aa3191153 None admin] RBAC: Adding query filter params (role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=fdd85d4848174a28a55ea4a09c5b109e, user.id=6753582980aa477f9135bbcd26de8f15) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:40.235327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94ec2-8921-40f9-b7e2-7b4aa3191153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:40.237035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94ec2-8921-40f9-b7e2-7b4aa3191153 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:40.243669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 554/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:40 2022] GET /identity/v3/role_assignments?user.id=6753582980aa477f9135bbcd26de8f15&scope.project.id=fdd85d4848174a28a55ea4a09c5b109e&role.id=7c610827438840438f3b3e90fac7c51c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:42.546096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c302-2bbb-4ffd-b110-ef1fea69bd26 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:42.546638 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c302-2bbb-4ffd-b110-ef1fea69bd26 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:42.546746 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c302-2bbb-4ffd-b110-ef1fea69bd26 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:42.548179 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 564/1118] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:42.554148 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b9ca6-8982-41e2-b01f-5825a841c00f None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:42.555076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b9ca6-8982-41e2-b01f-5825a841c00f None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:42.555076 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b9ca6-8982-41e2-b01f-5825a841c00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:42.573066 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-706b9ca6-8982-41e2-b01f-5825a841c00f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:42.574268 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-706b9ca6-8982-41e2-b01f-5825a841c00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:42.643034 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 555/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:42.667031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04c302-2bbb-4ffd-b110-ef1fea69bd26 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:42.775142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04c302-2bbb-4ffd-b110-ef1fea69bd26 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:42.808322 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc3cf-ba1c-4fe0-aaf8-506b44c743bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:42.809184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc3cf-ba1c-4fe0-aaf8-506b44c743bf None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:42.809459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc3cf-ba1c-4fe0-aaf8-506b44c743bf None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:42.809730 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc3cf-ba1c-4fe0-aaf8-506b44c743bf None admin] PATH_INFO: `/v3/roles/7c610827438840438f3b3e90fac7c51c` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:42.811220 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc3cf-ba1c-4fe0-aaf8-506b44c743bf None admin] RBAC: Authorizing `identity:get_role(role_id=7c610827438840438f3b3e90fac7c51c)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:42.812606 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc3cf-ba1c-4fe0-aaf8-506b44c743bf None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:42.813987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 565/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:42 2022] GET /identity/v3/roles/7c610827438840438f3b3e90fac7c51c => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:42.820876 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b9ca6-8982-41e2-b01f-5825a841c00f None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:42.920946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b9ca6-8982-41e2-b01f-5825a841c00f None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:42.956346 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76a8c-1ffa-42bb-a892-880b03fef2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:42.957225 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76a8c-1ffa-42bb-a892-880b03fef2cd None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:42.957510 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76a8c-1ffa-42bb-a892-880b03fef2cd None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:42.957785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76a8c-1ffa-42bb-a892-880b03fef2cd None admin] PATH_INFO: `/v3/users/6753582980aa477f9135bbcd26de8f15` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:42.959016 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb76a8c-1ffa-42bb-a892-880b03fef2cd None admin] RBAC: Authorizing `identity:get_user(user_id=6753582980aa477f9135bbcd26de8f15)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:42.961103 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb76a8c-1ffa-42bb-a892-880b03fef2cd None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:42.967611 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 556/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:42 2022] GET /identity/v3/users/6753582980aa477f9135bbcd26de8f15 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:42.968906 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc3cf-ba1c-4fe0-aaf8-506b44c743bf None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:43.072966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc3cf-ba1c-4fe0-aaf8-506b44c743bf None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:43.107877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30407429-b91b-4759-be3b-a4c0d3131371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:43.108743 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30407429-b91b-4759-be3b-a4c0d3131371 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:43.109024 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30407429-b91b-4759-be3b-a4c0d3131371 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:43.109295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30407429-b91b-4759-be3b-a4c0d3131371 None admin] PATH_INFO: `/v3/projects/fdd85d4848174a28a55ea4a09c5b109e` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:43.110520 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30407429-b91b-4759-be3b-a4c0d3131371 None admin] RBAC: Authorizing `identity:get_project(project_id=fdd85d4848174a28a55ea4a09c5b109e)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:43.111987 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30407429-b91b-4759-be3b-a4c0d3131371 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:43.113982 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 566/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:30:42 2022] GET /identity/v3/projects/fdd85d4848174a28a55ea4a09c5b109e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:43.119669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76a8c-1ffa-42bb-a892-880b03fef2cd None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:43.221737 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76a8c-1ffa-42bb-a892-880b03fef2cd None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:43.256193 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fccdf-b02a-4b5d-80d6-ebacd35fcd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:43.257289 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fccdf-b02a-4b5d-80d6-ebacd35fcd5d None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:43.257576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fccdf-b02a-4b5d-80d6-ebacd35fcd5d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:43.257856 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fccdf-b02a-4b5d-80d6-ebacd35fcd5d None admin] PATH_INFO: `/v3/projects/fdd85d4848174a28a55ea4a09c5b109e/users/6753582980aa477f9135bbcd26de8f15/roles/7c610827438840438f3b3e90fac7c51c` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:43.260149 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fccdf-b02a-4b5d-80d6-ebacd35fcd5d None admin] RBAC: Authorizing `identity:create_grant(project_id=fdd85d4848174a28a55ea4a09c5b109e, user_id=6753582980aa477f9135bbcd26de8f15, role_id=7c610827438840438f3b3e90fac7c51c)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:43.261618 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fccdf-b02a-4b5d-80d6-ebacd35fcd5d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:43.276194 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 557/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:30:43 2022] PUT /identity/v3/projects/fdd85d4848174a28a55ea4a09c5b109e/users/6753582980aa477f9135bbcd26de8f15/roles/7c610827438840438f3b3e90fac7c51c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:30:45.550772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ea65e-0ff8-4f77-b06d-d3e159161f4d None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:45.550772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ea65e-0ff8-4f77-b06d-d3e159161f4d None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:45.550772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ea65e-0ff8-4f77-b06d-d3e159161f4d None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:45.550772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 567/1124] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:45.557483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf3780-debc-49f7-974c-e0ac593aa106 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:45.557915 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf3780-debc-49f7-974c-e0ac593aa106 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:45.558126 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf3780-debc-49f7-974c-e0ac593aa106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:45.576363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-b9bf3780-debc-49f7-974c-e0ac593aa106 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:45.577567 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-b9bf3780-debc-49f7-974c-e0ac593aa106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:45.642905 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 558/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:45.666975 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ea65e-0ff8-4f77-b06d-d3e159161f4d None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:45.781595 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ea65e-0ff8-4f77-b06d-d3e159161f4d None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:45.816453 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424e7d-8157-4125-8eab-96a2a55e19fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:45.817300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424e7d-8157-4125-8eab-96a2a55e19fe None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:45.817585 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424e7d-8157-4125-8eab-96a2a55e19fe None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:45.817861 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424e7d-8157-4125-8eab-96a2a55e19fe None admin] PATH_INFO: `/v3/roles/7c610827438840438f3b3e90fac7c51c` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:45.819417 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98424e7d-8157-4125-8eab-96a2a55e19fe None admin] RBAC: Authorizing `identity:get_role(role_id=7c610827438840438f3b3e90fac7c51c)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:45.820820 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98424e7d-8157-4125-8eab-96a2a55e19fe None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:45.822287 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 568/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:45 2022] GET /identity/v3/roles/7c610827438840438f3b3e90fac7c51c => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:45.828157 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf3780-debc-49f7-974c-e0ac593aa106 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:45.927634 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf3780-debc-49f7-974c-e0ac593aa106 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:45.961581 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a9866-4303-4f62-8914-6b72f6162bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:45.962461 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a9866-4303-4f62-8914-6b72f6162bcc None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:45.962746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a9866-4303-4f62-8914-6b72f6162bcc None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:45.963024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a9866-4303-4f62-8914-6b72f6162bcc None admin] PATH_INFO: `/v3/users/6753582980aa477f9135bbcd26de8f15` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:45.964265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a9866-4303-4f62-8914-6b72f6162bcc None admin] RBAC: Authorizing `identity:get_user(user_id=6753582980aa477f9135bbcd26de8f15)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:45.965704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a9866-4303-4f62-8914-6b72f6162bcc None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:45.967365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 559/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:45 2022] GET /identity/v3/users/6753582980aa477f9135bbcd26de8f15 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:45.973269 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424e7d-8157-4125-8eab-96a2a55e19fe None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:46.077467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424e7d-8157-4125-8eab-96a2a55e19fe None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:46.112184 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4acd9-9c42-4001-b978-48a2bae86747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:46.112842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4acd9-9c42-4001-b978-48a2bae86747 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:46.113128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4acd9-9c42-4001-b978-48a2bae86747 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:46.113404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4acd9-9c42-4001-b978-48a2bae86747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:46.181407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4acd9-9c42-4001-b978-48a2bae86747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:46.182856 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4acd9-9c42-4001-b978-48a2bae86747 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:46.301087 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 569/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:30:46.307313 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a9866-4303-4f62-8914-6b72f6162bcc None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:46.407755 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a9866-4303-4f62-8914-6b72f6162bcc None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:46.440207 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d35f0-a295-4f89-ab11-a615acd38cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:46.441246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d35f0-a295-4f89-ab11-a615acd38cce None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:46.441521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d35f0-a295-4f89-ab11-a615acd38cce None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:46.441793 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d35f0-a295-4f89-ab11-a615acd38cce None admin] PATH_INFO: `/v3/projects/fdd85d4848174a28a55ea4a09c5b109e` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:46.442968 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d35f0-a295-4f89-ab11-a615acd38cce None admin] RBAC: Authorizing `identity:get_project(project_id=fdd85d4848174a28a55ea4a09c5b109e)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:46.444954 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d35f0-a295-4f89-ab11-a615acd38cce None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:46.446898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 560/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:30:46 2022] GET /identity/v3/projects/fdd85d4848174a28a55ea4a09c5b109e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:46.452921 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4acd9-9c42-4001-b978-48a2bae86747 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:46.547548 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4acd9-9c42-4001-b978-48a2bae86747 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:46.580734 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99cd51-6c51-4a69-a266-091aea77dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:46.581323 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99cd51-6c51-4a69-a266-091aea77dd02 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:46.581593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99cd51-6c51-4a69-a266-091aea77dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:46.581862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99cd51-6c51-4a69-a266-091aea77dd02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:46.582688 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99cd51-6c51-4a69-a266-091aea77dd02 None admin] RBAC: Adding query filter params (role.id=7c610827438840438f3b3e90fac7c51c, scope.project.id=fdd85d4848174a28a55ea4a09c5b109e, user.id=6753582980aa477f9135bbcd26de8f15) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:46.582999 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99cd51-6c51-4a69-a266-091aea77dd02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:46.584472 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99cd51-6c51-4a69-a266-091aea77dd02 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:46.590804 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 570/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:46 2022] GET /identity/v3/role_assignments?user.id=6753582980aa477f9135bbcd26de8f15&scope.project.id=fdd85d4848174a28a55ea4a09c5b109e&role.id=7c610827438840438f3b3e90fac7c51c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:48.825330 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45463da-3091-4a8c-9edb-a871eb0944dd None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:48.825903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45463da-3091-4a8c-9edb-a871eb0944dd None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:48.825903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45463da-3091-4a8c-9edb-a871eb0944dd None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:48.827260 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 561/1131] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:48.832499 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d22f-9326-4411-8417-72bfe69f2ad6 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:48.832911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d22f-9326-4411-8417-72bfe69f2ad6 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:48.833051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d22f-9326-4411-8417-72bfe69f2ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:48.849590 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-1439d22f-9326-4411-8417-72bfe69f2ad6 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:48.851365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-1439d22f-9326-4411-8417-72bfe69f2ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:48.915948 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 571/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:48.939276 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45463da-3091-4a8c-9edb-a871eb0944dd None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:49.036936 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45463da-3091-4a8c-9edb-a871eb0944dd None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:49.069539 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50a4f2-79d5-48a1-b71b-a7701ac30e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:49.070321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a4f2-79d5-48a1-b71b-a7701ac30e02 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:49.070605 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a4f2-79d5-48a1-b71b-a7701ac30e02 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:49.070879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50a4f2-79d5-48a1-b71b-a7701ac30e02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:49.072111 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50a4f2-79d5-48a1-b71b-a7701ac30e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:49.073545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50a4f2-79d5-48a1-b71b-a7701ac30e02 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:49.075195 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 562/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:49.081051 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d22f-9326-4411-8417-72bfe69f2ad6 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:49.173313 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d22f-9326-4411-8417-72bfe69f2ad6 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:49.206028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1df21-215e-4dda-90a5-8794318545ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:49.206667 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1df21-215e-4dda-90a5-8794318545ad None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:49.206945 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1df21-215e-4dda-90a5-8794318545ad None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:49.207215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1df21-215e-4dda-90a5-8794318545ad None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:49.207954 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1df21-215e-4dda-90a5-8794318545ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:49.209362 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1df21-215e-4dda-90a5-8794318545ad None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:49.233061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 572/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:30:49 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:30:51.534801 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a8489-3293-4537-aa27-f5c6d3b4fe8f None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:51.535363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a8489-3293-4537-aa27-f5c6d3b4fe8f None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:51.535363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a8489-3293-4537-aa27-f5c6d3b4fe8f None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:51.536784 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 563/1135] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:51.542230 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb721-c493-4ab7-9aba-d4b1a8543577 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:51.542660 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb721-c493-4ab7-9aba-d4b1a8543577 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:51.542793 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeb721-c493-4ab7-9aba-d4b1a8543577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:51.559737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-9afeb721-c493-4ab7-9aba-d4b1a8543577 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:51.560939 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-9afeb721-c493-4ab7-9aba-d4b1a8543577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:51.625740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 573/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:51.649995 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a8489-3293-4537-aa27-f5c6d3b4fe8f None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:51.749080 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a8489-3293-4537-aa27-f5c6d3b4fe8f None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:51.781173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c932c5-d148-4bd5-b91a-ac266850426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:51.781955 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c932c5-d148-4bd5-b91a-ac266850426e None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:51.782240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c932c5-d148-4bd5-b91a-ac266850426e None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:51.782517 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c932c5-d148-4bd5-b91a-ac266850426e None admin] PATH_INFO: `/v3/domains/default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:51.783703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c932c5-d148-4bd5-b91a-ac266850426e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:51.785169 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c932c5-d148-4bd5-b91a-ac266850426e None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:51.786766 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 564/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:51.792918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeb721-c493-4ab7-9aba-d4b1a8543577 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:51.898014 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeb721-c493-4ab7-9aba-d4b1a8543577 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:51.931236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8511aa-6b2a-423f-b230-363120107d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:51.931925 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8511aa-6b2a-423f-b230-363120107d9b None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:51.932209 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8511aa-6b2a-423f-b230-363120107d9b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:51.932484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8511aa-6b2a-423f-b230-363120107d9b None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:51.933224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8511aa-6b2a-423f-b230-363120107d9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:51.934651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8511aa-6b2a-423f-b230-363120107d9b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:51.957397 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 574/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:30:51 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:30:54.260270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d016cb-16fc-4f36-af49-5a58544ba08e None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:54.260848 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d016cb-16fc-4f36-af49-5a58544ba08e None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:54.260848 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d016cb-16fc-4f36-af49-5a58544ba08e None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:54.262208 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 565/1139] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:30:54.267396 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e1ee-5a49-4dbe-884b-6ae46e4489b6 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:54.267900 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e1ee-5a49-4dbe-884b-6ae46e4489b6 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:54.268023 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19e1ee-5a49-4dbe-884b-6ae46e4489b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:54.285393 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-3b19e1ee-5a49-4dbe-884b-6ae46e4489b6 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:54.286570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-3b19e1ee-5a49-4dbe-884b-6ae46e4489b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:54.351219 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 575/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:54.374354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d016cb-16fc-4f36-af49-5a58544ba08e None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:54.471420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d016cb-16fc-4f36-af49-5a58544ba08e None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:54.503708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf96b8-34f5-4db0-bd7a-5306d452641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:54.504521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf96b8-34f5-4db0-bd7a-5306d452641c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:54.504806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf96b8-34f5-4db0-bd7a-5306d452641c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:54.505081 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf96b8-34f5-4db0-bd7a-5306d452641c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:54.515634 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf96b8-34f5-4db0-bd7a-5306d452641c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-cfbf96b8-34f5-4db0-bd7a-5306d452641c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:54.523340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:54.524636 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:54.525957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 566/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:30:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:54.530551 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19e1ee-5a49-4dbe-884b-6ae46e4489b6 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:54.627680 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19e1ee-5a49-4dbe-884b-6ae46e4489b6 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:54.660429 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:54.661086 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:54.661368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:54.661644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:54.662394 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:54.663365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:54.664769 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:54.673113 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 576/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:30:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:54.679072 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf96b8-34f5-4db0-bd7a-5306d452641c None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:54.774830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf96b8-34f5-4db0-bd7a-5306d452641c None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:54.806235 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2ffc4-bc1a-49aa-85ad-31f1eaf75279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:54.807086 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2ffc4-bc1a-49aa-85ad-31f1eaf75279 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:54.807364 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2ffc4-bc1a-49aa-85ad-31f1eaf75279 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:54.807632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2ffc4-bc1a-49aa-85ad-31f1eaf75279 None admin] PATH_INFO: `/v3/users/deb291591d484ace98fef80feac905bf` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:54.820993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2ffc4-bc1a-49aa-85ad-31f1eaf75279 None admin] RBAC: Authorizing `identity:get_user(user_id=deb291591d484ace98fef80feac905bf)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:54.822408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2ffc4-bc1a-49aa-85ad-31f1eaf75279 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:54.824085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 567/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:54 2022] GET /identity/v3/users/deb291591d484ace98fef80feac905bf => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:54.829717 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:54.926979 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b5c50-a798-4725-906d-7f4b0fa703ea None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:54.960105 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6432-819d-4418-82e1-4b3746157961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:54.960907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6432-819d-4418-82e1-4b3746157961 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:54.961188 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6432-819d-4418-82e1-4b3746157961 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:54.961460 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6432-819d-4418-82e1-4b3746157961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:55.026013 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6432-819d-4418-82e1-4b3746157961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:55.027398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6432-819d-4418-82e1-4b3746157961 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:55.121206 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 577/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:30:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:30:55.127092 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2ffc4-bc1a-49aa-85ad-31f1eaf75279 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:55.222795 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2ffc4-bc1a-49aa-85ad-31f1eaf75279 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:55.255167 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cf5fe-9ca2-4cd7-ac0e-1174d0f64a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:55.256042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cf5fe-9ca2-4cd7-ac0e-1174d0f64a38 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:55.256910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cf5fe-9ca2-4cd7-ac0e-1174d0f64a38 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:55.257199 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cf5fe-9ca2-4cd7-ac0e-1174d0f64a38 None admin] PATH_INFO: `/v3/projects/738091b7c18e4b058b9467d8326cd52b` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:55.258395 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cf5fe-9ca2-4cd7-ac0e-1174d0f64a38 None admin] RBAC: Authorizing `identity:get_project(project_id=738091b7c18e4b058b9467d8326cd52b)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:55.259857 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cf5fe-9ca2-4cd7-ac0e-1174d0f64a38 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:55.261545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 568/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:30:55 2022] GET /identity/v3/projects/738091b7c18e4b058b9467d8326cd52b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:55.267503 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6432-819d-4418-82e1-4b3746157961 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:55.364452 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6432-819d-4418-82e1-4b3746157961 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:55.398216 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff107a8d-f180-47be-89fe-831bf34b143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:55.399116 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff107a8d-f180-47be-89fe-831bf34b143d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:55.399400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff107a8d-f180-47be-89fe-831bf34b143d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:55.399676 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff107a8d-f180-47be-89fe-831bf34b143d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:55.400547 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff107a8d-f180-47be-89fe-831bf34b143d None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=738091b7c18e4b058b9467d8326cd52b, user.id=deb291591d484ace98fef80feac905bf) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:55.400860 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff107a8d-f180-47be-89fe-831bf34b143d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:55.402299 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff107a8d-f180-47be-89fe-831bf34b143d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:55.407648 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 578/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:30:55 2022] GET /identity/v3/role_assignments?user.id=deb291591d484ace98fef80feac905bf&scope.project.id=738091b7c18e4b058b9467d8326cd52b&role.id=8cf832105b2949f6b11e06b208146326 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:57.662468 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180098-76bd-4930-bfcc-476c8045f5f2 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:57.663006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180098-76bd-4930-bfcc-476c8045f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:57.663117 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180098-76bd-4930-bfcc-476c8045f5f2 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:57.664481 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 569/1147] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:30:57.669837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51286dc-ecfe-4f82-855c-d5d3f7946349 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:57.670288 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51286dc-ecfe-4f82-855c-d5d3f7946349 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:57.670403 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51286dc-ecfe-4f82-855c-d5d3f7946349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:57.686946 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-d51286dc-ecfe-4f82-855c-d5d3f7946349 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:30:57.688177 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-d51286dc-ecfe-4f82-855c-d5d3f7946349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:30:57.767402 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 579/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:30:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:30:57.793971 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180098-76bd-4930-bfcc-476c8045f5f2 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:57.896246 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180098-76bd-4930-bfcc-476c8045f5f2 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:57.928616 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020b6c-d189-442c-80ab-b4deaad15c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:57.929408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020b6c-d189-442c-80ab-b4deaad15c6d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:57.929689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020b6c-d189-442c-80ab-b4deaad15c6d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:57.929966 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020b6c-d189-442c-80ab-b4deaad15c6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:57.939669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51020b6c-d189-442c-80ab-b4deaad15c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-51020b6c-d189-442c-80ab-b4deaad15c6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:30:57.948046 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:30:57.949273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:30:57.950571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 570/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:30:57.955354 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51286dc-ecfe-4f82-855c-d5d3f7946349 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:58.054439 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51286dc-ecfe-4f82-855c-d5d3f7946349 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:58.102192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:58.103155 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:58.103444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:58.103724 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:58.104513 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:30:58.104823 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:58.106187 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:58.114174 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 580/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:30:58.120328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020b6c-d189-442c-80ab-b4deaad15c6d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:58.217498 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020b6c-d189-442c-80ab-b4deaad15c6d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:58.250289 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389513-2bb6-4fd2-b94b-46e08d13ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:58.251182 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389513-2bb6-4fd2-b94b-46e08d13ac12 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:58.251466 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389513-2bb6-4fd2-b94b-46e08d13ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:58.251745 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389513-2bb6-4fd2-b94b-46e08d13ac12 None admin] PATH_INFO: `/v3/users/deb291591d484ace98fef80feac905bf` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:58.252970 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66389513-2bb6-4fd2-b94b-46e08d13ac12 None admin] RBAC: Authorizing `identity:get_user(user_id=deb291591d484ace98fef80feac905bf)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:58.254447 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66389513-2bb6-4fd2-b94b-46e08d13ac12 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:58.256138 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 571/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:30:58 2022] GET /identity/v3/users/deb291591d484ace98fef80feac905bf => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:58.261956 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:58.358644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6aa2b-33fb-4da1-bf3b-387e3b203bcb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:58.391388 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f18c9-ae89-4640-9b34-56906a4c0cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:58.392290 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f18c9-ae89-4640-9b34-56906a4c0cec None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:58.392573 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f18c9-ae89-4640-9b34-56906a4c0cec None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:58.392850 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f18c9-ae89-4640-9b34-56906a4c0cec None admin] PATH_INFO: `/v3/projects/738091b7c18e4b058b9467d8326cd52b` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:58.394044 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f18c9-ae89-4640-9b34-56906a4c0cec None admin] RBAC: Authorizing `identity:get_project(project_id=738091b7c18e4b058b9467d8326cd52b)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:58.395480 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f18c9-ae89-4640-9b34-56906a4c0cec None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:58.397935 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 581/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:30:58 2022] GET /identity/v3/projects/738091b7c18e4b058b9467d8326cd52b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:30:58.403999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389513-2bb6-4fd2-b94b-46e08d13ac12 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:30:58.499324 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389513-2bb6-4fd2-b94b-46e08d13ac12 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:30:58.531705 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a52a3-e97c-4c24-89e9-d45ba24ed6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:30:58.532608 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a52a3-e97c-4c24-89e9-d45ba24ed6bb None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:30:58.532893 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a52a3-e97c-4c24-89e9-d45ba24ed6bb None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:30:58.533170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a52a3-e97c-4c24-89e9-d45ba24ed6bb None admin] PATH_INFO: `/v3/projects/738091b7c18e4b058b9467d8326cd52b/users/deb291591d484ace98fef80feac905bf/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:30:58.535191 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a52a3-e97c-4c24-89e9-d45ba24ed6bb None admin] RBAC: Authorizing `identity:create_grant(project_id=738091b7c18e4b058b9467d8326cd52b, user_id=deb291591d484ace98fef80feac905bf, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:30:58.536659 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a52a3-e97c-4c24-89e9-d45ba24ed6bb None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:30:58.550071 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 572/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:30:58 2022] PUT /identity/v3/projects/738091b7c18e4b058b9467d8326cd52b/users/deb291591d484ace98fef80feac905bf/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:31:00.779618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8239eb-45ce-4fd7-b8e0-81d1f534283e None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:00.780265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8239eb-45ce-4fd7-b8e0-81d1f534283e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:00.780265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8239eb-45ce-4fd7-b8e0-81d1f534283e None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:00.781586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 582/1154] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:00.786975 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6a3e-da0b-4e04-8dde-4c8a575bbedb None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:00.787377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6a3e-da0b-4e04-8dde-4c8a575bbedb None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:00.788079 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6a3e-da0b-4e04-8dde-4c8a575bbedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:00.805565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-a5cf6a3e-da0b-4e04-8dde-4c8a575bbedb None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:00.806751 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a5cf6a3e-da0b-4e04-8dde-4c8a575bbedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:00.874591 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 573/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:31:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:31:00.897622 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8239eb-45ce-4fd7-b8e0-81d1f534283e None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:00.999746 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8239eb-45ce-4fd7-b8e0-81d1f534283e None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:01.032252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c537942-8461-4904-a3ba-f803d8615fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:01.032973 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c537942-8461-4904-a3ba-f803d8615fea None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:01.033252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c537942-8461-4904-a3ba-f803d8615fea None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:01.033525 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c537942-8461-4904-a3ba-f803d8615fea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:01.044501 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c537942-8461-4904-a3ba-f803d8615fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-5c537942-8461-4904-a3ba-f803d8615fea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:31:01.052061 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:31:01.053496 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:31:01.054923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 583/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:31:01.059572 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf6a3e-da0b-4e04-8dde-4c8a575bbedb None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:01.154911 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf6a3e-da0b-4e04-8dde-4c8a575bbedb None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:01.189140 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:01.189839 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:01.190120 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:01.190655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:01.191419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:01.191708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:01.193108 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:01.204102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 574/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:01.210718 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c537942-8461-4904-a3ba-f803d8615fea None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:01.317314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c537942-8461-4904-a3ba-f803d8615fea None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:01.349346 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c391-194e-4d2c-a902-79ec9af360be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:01.351118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c391-194e-4d2c-a902-79ec9af360be None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:01.351398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c391-194e-4d2c-a902-79ec9af360be None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:01.351669 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81c391-194e-4d2c-a902-79ec9af360be None admin] PATH_INFO: `/v3/users/deb291591d484ace98fef80feac905bf` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:01.352885 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81c391-194e-4d2c-a902-79ec9af360be None admin] RBAC: Authorizing `identity:get_user(user_id=deb291591d484ace98fef80feac905bf)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:01.354300 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81c391-194e-4d2c-a902-79ec9af360be None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:01.355929 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 584/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:31:01 2022] GET /identity/v3/users/deb291591d484ace98fef80feac905bf => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:01.361708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:01.457102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2dbbb-859f-49dd-8be8-3205c8269f41 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:01.489398 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c611e8-f236-4fe6-990a-df02e3e06064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:01.490038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c611e8-f236-4fe6-990a-df02e3e06064 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:01.490318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c611e8-f236-4fe6-990a-df02e3e06064 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:01.490688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c611e8-f236-4fe6-990a-df02e3e06064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:01.563731 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c611e8-f236-4fe6-990a-df02e3e06064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:01.565214 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c611e8-f236-4fe6-990a-df02e3e06064 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:01.658744 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 575/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:31:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:31:01.664652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c391-194e-4d2c-a902-79ec9af360be None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:01.761494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81c391-194e-4d2c-a902-79ec9af360be None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:01.793969 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19613566-ab7f-4e9f-aef3-366f4f4e2031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:01.794816 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613566-ab7f-4e9f-aef3-366f4f4e2031 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:01.795100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613566-ab7f-4e9f-aef3-366f4f4e2031 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:01.795377 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19613566-ab7f-4e9f-aef3-366f4f4e2031 None admin] PATH_INFO: `/v3/projects/738091b7c18e4b058b9467d8326cd52b` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:01.796593 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19613566-ab7f-4e9f-aef3-366f4f4e2031 None admin] RBAC: Authorizing `identity:get_project(project_id=738091b7c18e4b058b9467d8326cd52b)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:01.798033 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19613566-ab7f-4e9f-aef3-366f4f4e2031 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:01.799719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 585/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:31:01 2022] GET /identity/v3/projects/738091b7c18e4b058b9467d8326cd52b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:01.806304 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c611e8-f236-4fe6-990a-df02e3e06064 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:01.899012 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c611e8-f236-4fe6-990a-df02e3e06064 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:01.930648 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213157be-d0e6-4822-b5bc-c40bc65b5be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:01.931283 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213157be-d0e6-4822-b5bc-c40bc65b5be3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:01.931561 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213157be-d0e6-4822-b5bc-c40bc65b5be3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:01.931860 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213157be-d0e6-4822-b5bc-c40bc65b5be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:01.932687 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213157be-d0e6-4822-b5bc-c40bc65b5be3 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=738091b7c18e4b058b9467d8326cd52b, user.id=deb291591d484ace98fef80feac905bf) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:01.932995 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213157be-d0e6-4822-b5bc-c40bc65b5be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:01.934390 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213157be-d0e6-4822-b5bc-c40bc65b5be3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:01.940570 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 576/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:31:01 2022] GET /identity/v3/role_assignments?user.id=deb291591d484ace98fef80feac905bf&scope.project.id=738091b7c18e4b058b9467d8326cd52b&role.id=8cf832105b2949f6b11e06b208146326 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:04.166315 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e889-daaf-48f0-bebc-a3f9f5b3840e None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:04.166890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e889-daaf-48f0-bebc-a3f9f5b3840e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:04.166890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e889-daaf-48f0-bebc-a3f9f5b3840e None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:04.168311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 586/1162] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:04.173553 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cc43d-c053-4e2a-a8cc-cbcdd3301e29 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:04.173951 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cc43d-c053-4e2a-a8cc-cbcdd3301e29 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:04.174105 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cc43d-c053-4e2a-a8cc-cbcdd3301e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:04.190656 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-748cc43d-c053-4e2a-a8cc-cbcdd3301e29 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:04.191848 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-748cc43d-c053-4e2a-a8cc-cbcdd3301e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:04.254954 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 577/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:31:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:31:04.277760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e889-daaf-48f0-bebc-a3f9f5b3840e None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:04.376960 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e889-daaf-48f0-bebc-a3f9f5b3840e None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:04.410241 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3630c-3988-4b5e-89d1-e1f7cd4ac08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:04.410911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3630c-3988-4b5e-89d1-e1f7cd4ac08c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:04.411192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3630c-3988-4b5e-89d1-e1f7cd4ac08c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:04.411467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3630c-3988-4b5e-89d1-e1f7cd4ac08c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:04.475037 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3630c-3988-4b5e-89d1-e1f7cd4ac08c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:04.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3630c-3988-4b5e-89d1-e1f7cd4ac08c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:04.570090 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 587/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:31:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:31:04.576056 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cc43d-c053-4e2a-a8cc-cbcdd3301e29 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:04.670101 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cc43d-c053-4e2a-a8cc-cbcdd3301e29 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:04.702481 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e963f-65c8-4dc9-832b-27c108fc4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:04.703278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e963f-65c8-4dc9-832b-27c108fc4ace None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:04.703559 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e963f-65c8-4dc9-832b-27c108fc4ace None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:04.703862 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e963f-65c8-4dc9-832b-27c108fc4ace None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:04.710950 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e963f-65c8-4dc9-832b-27c108fc4ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:04.712420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e963f-65c8-4dc9-832b-27c108fc4ace None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-230e963f-65c8-4dc9-832b-27c108fc4ace None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:31:04.726877 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:31:04.728307 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:31:04.729583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 578/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:31:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:31:04.733899 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3630c-3988-4b5e-89d1-e1f7cd4ac08c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:04.829685 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3630c-3988-4b5e-89d1-e1f7cd4ac08c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:04.863378 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197fd1-0a99-41ab-abd6-ed04cd288994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:04.864059 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197fd1-0a99-41ab-abd6-ed04cd288994 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:04.864345 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197fd1-0a99-41ab-abd6-ed04cd288994 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:04.864623 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197fd1-0a99-41ab-abd6-ed04cd288994 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:04.865407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197fd1-0a99-41ab-abd6-ed04cd288994 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:04.865887 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197fd1-0a99-41ab-abd6-ed04cd288994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:04.867318 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197fd1-0a99-41ab-abd6-ed04cd288994 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:04.874505 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 588/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:31:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:07.083404 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525d544-6676-4af3-b2ff-04e501fddd46 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:07.084011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525d544-6676-4af3-b2ff-04e501fddd46 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:07.084011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525d544-6676-4af3-b2ff-04e501fddd46 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:07.085952 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 579/1167] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:07.091280 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232011f-8fbd-48ab-9c87-09af90e4af9f None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:07.091734 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232011f-8fbd-48ab-9c87-09af90e4af9f None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:07.091872 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232011f-8fbd-48ab-9c87-09af90e4af9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:07.108791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-7232011f-8fbd-48ab-9c87-09af90e4af9f None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:07.109972 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-7232011f-8fbd-48ab-9c87-09af90e4af9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:07.173747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 589/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:31:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:31:07.196333 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525d544-6676-4af3-b2ff-04e501fddd46 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:07.303381 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525d544-6676-4af3-b2ff-04e501fddd46 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:07.343440 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c889e6d-1952-4daa-a5d2-9a69c2684531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:07.344060 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c889e6d-1952-4daa-a5d2-9a69c2684531 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:07.344339 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c889e6d-1952-4daa-a5d2-9a69c2684531 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:07.344765 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c889e6d-1952-4daa-a5d2-9a69c2684531 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:07.345910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c889e6d-1952-4daa-a5d2-9a69c2684531 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:07.348061 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c889e6d-1952-4daa-a5d2-9a69c2684531 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:07.364269 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 580/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Mon May 9 15:31:07 2022] POST /identity/v3/domains => generated 267 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:31:09.610388 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628a3da-c2f5-4abe-b95c-d527923b4a57 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:09.610962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628a3da-c2f5-4abe-b95c-d527923b4a57 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:09.610962 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628a3da-c2f5-4abe-b95c-d527923b4a57 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:09.612377 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 590/1170] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:09.617803 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce11f-44a3-4632-9478-cdb80e021e26 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:09.618228 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce11f-44a3-4632-9478-cdb80e021e26 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:09.618363 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce11f-44a3-4632-9478-cdb80e021e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:09.636179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-018ce11f-44a3-4632-9478-cdb80e021e26 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:09.637296 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-018ce11f-44a3-4632-9478-cdb80e021e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:09.701003 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 581/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:31:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:31:09.724522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628a3da-c2f5-4abe-b95c-d527923b4a57 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:09.820869 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628a3da-c2f5-4abe-b95c-d527923b4a57 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:09.853653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca558724-96f7-4233-ab04-2c04d211e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:09.854490 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca558724-96f7-4233-ab04-2c04d211e396 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:09.854766 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca558724-96f7-4233-ab04-2c04d211e396 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:09.855032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca558724-96f7-4233-ab04-2c04d211e396 None admin] PATH_INFO: `/v3/domains/56fd792e32504999a603ffeeba13f83e` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:09.864926 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca558724-96f7-4233-ab04-2c04d211e396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=56fd792e32504999a603ffeeba13f83e)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:09.866510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca558724-96f7-4233-ab04-2c04d211e396 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:09.868142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 591/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 9 15:31:09 2022] GET /identity/v3/domains/56fd792e32504999a603ffeeba13f83e => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:09.873879 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce11f-44a3-4632-9478-cdb80e021e26 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:09.967980 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce11f-44a3-4632-9478-cdb80e021e26 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:10.000085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2437e60-05ad-4b4e-8c64-154bd832e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:10.000734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437e60-05ad-4b4e-8c64-154bd832e5ec None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:10.001015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437e60-05ad-4b4e-8c64-154bd832e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:10.001289 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2437e60-05ad-4b4e-8c64-154bd832e5ec None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:10.001995 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2437e60-05ad-4b4e-8c64-154bd832e5ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:10.003420 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2437e60-05ad-4b4e-8c64-154bd832e5ec None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:10.027830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 582/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:31:09 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:31:12.266854 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d2327-0a4f-4048-92e3-7324ac1592ce None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:12.267439 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d2327-0a4f-4048-92e3-7324ac1592ce None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:12.267439 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d2327-0a4f-4048-92e3-7324ac1592ce None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:12.268791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 592/1174] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:12.274874 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1182-63e6-4d13-ad3f-732b22e447ff None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:12.275328 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1182-63e6-4d13-ad3f-732b22e447ff None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:12.275438 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1182-63e6-4d13-ad3f-732b22e447ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:12.292895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-98fa1182-63e6-4d13-ad3f-732b22e447ff None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:12.294085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-98fa1182-63e6-4d13-ad3f-732b22e447ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:12.359347 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 583/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:31:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:31:12.384392 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d2327-0a4f-4048-92e3-7324ac1592ce None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:12.483095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d2327-0a4f-4048-92e3-7324ac1592ce None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:12.515408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78a31-706c-408f-9388-d68697e3e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:12.516312 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78a31-706c-408f-9388-d68697e3e71f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:12.516596 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78a31-706c-408f-9388-d68697e3e71f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:12.516923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78a31-706c-408f-9388-d68697e3e71f None admin] PATH_INFO: `/v3/domains/56fd792e32504999a603ffeeba13f83e` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:12.518067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be78a31-706c-408f-9388-d68697e3e71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=56fd792e32504999a603ffeeba13f83e)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:12.519494 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be78a31-706c-408f-9388-d68697e3e71f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:12.521134 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 593/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 9 15:31:12 2022] GET /identity/v3/domains/56fd792e32504999a603ffeeba13f83e => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:12.527522 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa1182-63e6-4d13-ad3f-732b22e447ff None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:12.628450 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa1182-63e6-4d13-ad3f-732b22e447ff None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:12.666198 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518c54b-1e1d-450e-8aa6-bd9bb894cd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:12.666854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518c54b-1e1d-450e-8aa6-bd9bb894cd97 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:12.667133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518c54b-1e1d-450e-8aa6-bd9bb894cd97 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:12.667408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518c54b-1e1d-450e-8aa6-bd9bb894cd97 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:12.668163 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518c54b-1e1d-450e-8aa6-bd9bb894cd97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:12.669583 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518c54b-1e1d-450e-8aa6-bd9bb894cd97 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:12.688729 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 584/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:31:12 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:31:14.970532 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705577-8f47-4909-b69d-5098809b753b None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:14.971115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705577-8f47-4909-b69d-5098809b753b None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:14.971115 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55705577-8f47-4909-b69d-5098809b753b None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:14.972484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 594/1178] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:14.978249 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38edd6-2659-49d7-bf99-6fb2afb83479 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:14.978653 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38edd6-2659-49d7-bf99-6fb2afb83479 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:14.978815 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38edd6-2659-49d7-bf99-6fb2afb83479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:14.996216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-dc38edd6-2659-49d7-bf99-6fb2afb83479 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:14.997406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-dc38edd6-2659-49d7-bf99-6fb2afb83479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:15.061177 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 585/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:31:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:31:15.084619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55705577-8f47-4909-b69d-5098809b753b None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:15.183405 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55705577-8f47-4909-b69d-5098809b753b None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:15.215652 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8bf4-1555-4d59-ae08-e43ba356bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:15.216463 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8bf4-1555-4d59-ae08-e43ba356bc21 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:15.216747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8bf4-1555-4d59-ae08-e43ba356bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:15.217022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8bf4-1555-4d59-ae08-e43ba356bc21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:15.227447 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a8bf4-1555-4d59-ae08-e43ba356bc21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-5d0a8bf4-1555-4d59-ae08-e43ba356bc21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:31:15.234961 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:31:15.236238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:31:15.237238 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 595/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:31:15.242669 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38edd6-2659-49d7-bf99-6fb2afb83479 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:15.338914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38edd6-2659-49d7-bf99-6fb2afb83479 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:15.371595 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:15.372292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:15.372577 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:15.372854 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:15.373604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:15.373914 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:15.375283 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:15.384213 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 586/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:15.389904 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8bf4-1555-4d59-ae08-e43ba356bc21 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:15.484552 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8bf4-1555-4d59-ae08-e43ba356bc21 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:15.518512 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a633-5732-40c7-9250-854a295f2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:15.519356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a633-5732-40c7-9250-854a295f2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:15.519631 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a633-5732-40c7-9250-854a295f2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:15.519935 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6a633-5732-40c7-9250-854a295f2bf9 None admin] PATH_INFO: `/v3/users/2c91273391b846beab76c0cd1edc8ad5` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:15.532374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a633-5732-40c7-9250-854a295f2bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=2c91273391b846beab76c0cd1edc8ad5)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:15.533819 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6a633-5732-40c7-9250-854a295f2bf9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:15.535443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 596/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:31:15 2022] GET /identity/v3/users/2c91273391b846beab76c0cd1edc8ad5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:15.541451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:15.647821 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdabf7-8109-496f-886b-ee985d882ab9 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:15.681725 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacb56-84de-4430-8e7d-f21a89e1e8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:15.682369 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacb56-84de-4430-8e7d-f21a89e1e8ee None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:15.682650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacb56-84de-4430-8e7d-f21a89e1e8ee None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:15.682925 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacb56-84de-4430-8e7d-f21a89e1e8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:15.746667 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cacb56-84de-4430-8e7d-f21a89e1e8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:15.748069 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cacb56-84de-4430-8e7d-f21a89e1e8ee None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:15.840475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 587/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:31:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:31:15.846445 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a633-5732-40c7-9250-854a295f2bf9 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:15.945400 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6a633-5732-40c7-9250-854a295f2bf9 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:15.981740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c63fc3-f4fc-46d6-abe0-33a8f94933cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:15.982591 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63fc3-f4fc-46d6-abe0-33a8f94933cd None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:15.982870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63fc3-f4fc-46d6-abe0-33a8f94933cd None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:15.983143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63fc3-f4fc-46d6-abe0-33a8f94933cd None admin] PATH_INFO: `/v3/projects/e45bdb3cc00d4ab381431a2cea7137ab` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:15.984371 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c63fc3-f4fc-46d6-abe0-33a8f94933cd None admin] RBAC: Authorizing `identity:get_project(project_id=e45bdb3cc00d4ab381431a2cea7137ab)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:15.986634 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c63fc3-f4fc-46d6-abe0-33a8f94933cd None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:15.988384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 597/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:31:15 2022] GET /identity/v3/projects/e45bdb3cc00d4ab381431a2cea7137ab => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:15.995015 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacb56-84de-4430-8e7d-f21a89e1e8ee None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:16.090909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacb56-84de-4430-8e7d-f21a89e1e8ee None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:16.124340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410da01-eb71-4a0b-8319-554bc7d0529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:16.124993 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410da01-eb71-4a0b-8319-554bc7d0529c None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:16.125277 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410da01-eb71-4a0b-8319-554bc7d0529c None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:16.125554 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410da01-eb71-4a0b-8319-554bc7d0529c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:16.126389 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410da01-eb71-4a0b-8319-554bc7d0529c None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=e45bdb3cc00d4ab381431a2cea7137ab, user.id=2c91273391b846beab76c0cd1edc8ad5) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:16.126704 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410da01-eb71-4a0b-8319-554bc7d0529c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:16.128170 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410da01-eb71-4a0b-8319-554bc7d0529c None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:16.133508 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 588/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:31:15 2022] GET /identity/v3/role_assignments?user.id=2c91273391b846beab76c0cd1edc8ad5&scope.project.id=e45bdb3cc00d4ab381431a2cea7137ab&role.id=8cf832105b2949f6b11e06b208146326 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:18.352272 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99691-18a2-46f3-bb35-200ac9f40a9e None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:18.352849 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99691-18a2-46f3-bb35-200ac9f40a9e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:18.352849 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99691-18a2-46f3-bb35-200ac9f40a9e None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:18.354196 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 598/1186] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:18.359508 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513924c-5762-4a7c-9cbd-e0e9a807c31d None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:18.359976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513924c-5762-4a7c-9cbd-e0e9a807c31d None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:18.360085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513924c-5762-4a7c-9cbd-e0e9a807c31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:18.377271 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-2513924c-5762-4a7c-9cbd-e0e9a807c31d None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:18.378444 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-2513924c-5762-4a7c-9cbd-e0e9a807c31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:18.442035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 589/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:31:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:31:18.465928 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf99691-18a2-46f3-bb35-200ac9f40a9e None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:18.565875 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf99691-18a2-46f3-bb35-200ac9f40a9e None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:18.598913 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d02f6d-c52e-4371-bab6-df88f53a093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:18.599870 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d02f6d-c52e-4371-bab6-df88f53a093f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:18.600246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d02f6d-c52e-4371-bab6-df88f53a093f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:18.600529 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d02f6d-c52e-4371-bab6-df88f53a093f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:18.610384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d02f6d-c52e-4371-bab6-df88f53a093f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-94d02f6d-c52e-4371-bab6-df88f53a093f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:31:18.618100 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:31:18.619347 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:31:18.620621 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 599/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:31:18.625279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513924c-5762-4a7c-9cbd-e0e9a807c31d None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:18.720119 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513924c-5762-4a7c-9cbd-e0e9a807c31d None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:18.752079 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:18.752738 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:18.753024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:18.753301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:18.754045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:18.754351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:18.756312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:18.764155 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 590/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:18.770010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d02f6d-c52e-4371-bab6-df88f53a093f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:18.864672 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d02f6d-c52e-4371-bab6-df88f53a093f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:18.897187 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728fe12-3f14-4e41-8f4e-ea8a2567fe75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:18.898039 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728fe12-3f14-4e41-8f4e-ea8a2567fe75 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:18.898316 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728fe12-3f14-4e41-8f4e-ea8a2567fe75 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:18.898589 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728fe12-3f14-4e41-8f4e-ea8a2567fe75 None admin] PATH_INFO: `/v3/users/2c91273391b846beab76c0cd1edc8ad5` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:18.899790 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728fe12-3f14-4e41-8f4e-ea8a2567fe75 None admin] RBAC: Authorizing `identity:get_user(user_id=2c91273391b846beab76c0cd1edc8ad5)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:18.901209 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728fe12-3f14-4e41-8f4e-ea8a2567fe75 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:18.902809 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 600/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:31:18 2022] GET /identity/v3/users/2c91273391b846beab76c0cd1edc8ad5 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:18.908428 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:19.005426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c3e65-3e23-409a-9718-e51d22d53e7a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:19.037945 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d165f-4d69-4767-8002-d6f0f2a86fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:19.038790 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d165f-4d69-4767-8002-d6f0f2a86fe5 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:19.039074 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d165f-4d69-4767-8002-d6f0f2a86fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:19.039350 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d165f-4d69-4767-8002-d6f0f2a86fe5 None admin] PATH_INFO: `/v3/projects/e45bdb3cc00d4ab381431a2cea7137ab` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:19.040633 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d165f-4d69-4767-8002-d6f0f2a86fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=e45bdb3cc00d4ab381431a2cea7137ab)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:19.042064 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d165f-4d69-4767-8002-d6f0f2a86fe5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:19.043742 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 591/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:31:18 2022] GET /identity/v3/projects/e45bdb3cc00d4ab381431a2cea7137ab => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:19.049504 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728fe12-3f14-4e41-8f4e-ea8a2567fe75 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:19.148135 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728fe12-3f14-4e41-8f4e-ea8a2567fe75 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:19.181550 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf9ed7-6b60-4be4-aedf-a896a41fe80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:19.182428 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf9ed7-6b60-4be4-aedf-a896a41fe80c None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:19.182713 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf9ed7-6b60-4be4-aedf-a896a41fe80c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:19.182990 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf9ed7-6b60-4be4-aedf-a896a41fe80c None admin] PATH_INFO: `/v3/projects/e45bdb3cc00d4ab381431a2cea7137ab/users/2c91273391b846beab76c0cd1edc8ad5/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:19.184986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf9ed7-6b60-4be4-aedf-a896a41fe80c None admin] RBAC: Authorizing `identity:create_grant(project_id=e45bdb3cc00d4ab381431a2cea7137ab, user_id=2c91273391b846beab76c0cd1edc8ad5, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:19.186420 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf9ed7-6b60-4be4-aedf-a896a41fe80c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:19.199702 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 601/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:31:19 2022] PUT /identity/v3/projects/e45bdb3cc00d4ab381431a2cea7137ab/users/2c91273391b846beab76c0cd1edc8ad5/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:31:21.410035 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397280-d07e-428e-b0f6-674c7309afa8 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:21.410521 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397280-d07e-428e-b0f6-674c7309afa8 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:21.410641 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b397280-d07e-428e-b0f6-674c7309afa8 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:21.412764 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 592/1193] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:21.418152 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf020-7de4-43f4-b82e-a27cf43fb60e None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:21.418539 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf020-7de4-43f4-b82e-a27cf43fb60e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:21.418702 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cf020-7de4-43f4-b82e-a27cf43fb60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:21.435035 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-ec0cf020-7de4-43f4-b82e-a27cf43fb60e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:21.436228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-ec0cf020-7de4-43f4-b82e-a27cf43fb60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:21.499884 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 602/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:31:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:31:21.523078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b397280-d07e-428e-b0f6-674c7309afa8 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:21.620437 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b397280-d07e-428e-b0f6-674c7309afa8 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:21.653300 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1392-de0e-4e44-a94e-e01dc37ce3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:21.654017 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1392-de0e-4e44-a94e-e01dc37ce3f8 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:21.654297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1392-de0e-4e44-a94e-e01dc37ce3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:21.654570 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1392-de0e-4e44-a94e-e01dc37ce3f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:21.664487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a1392-de0e-4e44-a94e-e01dc37ce3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-802a1392-de0e-4e44-a94e-e01dc37ce3f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:31:21.673974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:31:21.675254 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:31:21.676413 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 593/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:31:21.682736 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf020-7de4-43f4-b82e-a27cf43fb60e None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:21.780177 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cf020-7de4-43f4-b82e-a27cf43fb60e None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:21.812464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:21.813121 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:21.813403 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:21.813678 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:21.814419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:21.814723 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:21.816371 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:21.824918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 603/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:31:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:21.830649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1392-de0e-4e44-a94e-e01dc37ce3f8 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:21.925800 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1392-de0e-4e44-a94e-e01dc37ce3f8 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:21.957686 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c61b-4728-4626-88f6-f948661c2d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:21.958548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c61b-4728-4626-88f6-f948661c2d0d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:21.959444 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c61b-4728-4626-88f6-f948661c2d0d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:21.959747 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165c61b-4728-4626-88f6-f948661c2d0d None admin] PATH_INFO: `/v3/users/2c91273391b846beab76c0cd1edc8ad5` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:21.960958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165c61b-4728-4626-88f6-f948661c2d0d None admin] RBAC: Authorizing `identity:get_user(user_id=2c91273391b846beab76c0cd1edc8ad5)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:21.962382 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165c61b-4728-4626-88f6-f948661c2d0d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:21.964041 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 594/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:31:21 2022] GET /identity/v3/users/2c91273391b846beab76c0cd1edc8ad5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:21.969791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:22.065770 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8244f-f978-486f-9a53-56e410e2d008 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:22.097934 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3de80-4682-4dd0-9e69-2acfa844f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:22.098571 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3de80-4682-4dd0-9e69-2acfa844f027 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:22.098855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3de80-4682-4dd0-9e69-2acfa844f027 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:22.099134 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3de80-4682-4dd0-9e69-2acfa844f027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:22.163224 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3de80-4682-4dd0-9e69-2acfa844f027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:22.164698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3de80-4682-4dd0-9e69-2acfa844f027 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:22.260542 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 604/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:31:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:31:22.266555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c61b-4728-4626-88f6-f948661c2d0d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:22.364406 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165c61b-4728-4626-88f6-f948661c2d0d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:22.397935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d8c8d-f70b-4008-98be-36bb6915cc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:22.398866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d8c8d-f70b-4008-98be-36bb6915cc38 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:22.399151 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d8c8d-f70b-4008-98be-36bb6915cc38 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:22.399429 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d8c8d-f70b-4008-98be-36bb6915cc38 None admin] PATH_INFO: `/v3/projects/e45bdb3cc00d4ab381431a2cea7137ab` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:22.400655 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d8c8d-f70b-4008-98be-36bb6915cc38 None admin] RBAC: Authorizing `identity:get_project(project_id=e45bdb3cc00d4ab381431a2cea7137ab)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:22.402091 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d8c8d-f70b-4008-98be-36bb6915cc38 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:22.403823 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 595/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:31:22 2022] GET /identity/v3/projects/e45bdb3cc00d4ab381431a2cea7137ab => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:22.409973 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3de80-4682-4dd0-9e69-2acfa844f027 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:22.505035 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3de80-4682-4dd0-9e69-2acfa844f027 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:22.537967 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec0fd-d015-49d4-92db-efd40b7049a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:22.538549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec0fd-d015-49d4-92db-efd40b7049a9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:22.538830 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec0fd-d015-49d4-92db-efd40b7049a9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:22.539104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec0fd-d015-49d4-92db-efd40b7049a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:22.539966 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec0fd-d015-49d4-92db-efd40b7049a9 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=e45bdb3cc00d4ab381431a2cea7137ab, user.id=2c91273391b846beab76c0cd1edc8ad5) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:22.540280 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec0fd-d015-49d4-92db-efd40b7049a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:22.541698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec0fd-d015-49d4-92db-efd40b7049a9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:22.547384 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 605/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:31:22 2022] GET /identity/v3/role_assignments?user.id=2c91273391b846beab76c0cd1edc8ad5&scope.project.id=e45bdb3cc00d4ab381431a2cea7137ab&role.id=8cf832105b2949f6b11e06b208146326 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:21.500055 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4248-56d9-4031-93d6-dbaf2d26941d None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.500646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4248-56d9-4031-93d6-dbaf2d26941d None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.500646 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f4248-56d9-4031-93d6-dbaf2d26941d None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.502183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 596/1201] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:21.507843 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495b4d-0416-47f2-acb7-6311dc45165b None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.508298 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495b4d-0416-47f2-acb7-6311dc45165b None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.508392 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495b4d-0416-47f2-acb7-6311dc45165b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.525533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-f7495b4d-0416-47f2-acb7-6311dc45165b None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:21.526716 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-f7495b4d-0416-47f2-acb7-6311dc45165b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:21.593636 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 606/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:32:21.619102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f4248-56d9-4031-93d6-dbaf2d26941d None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.724048 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f4248-56d9-4031-93d6-dbaf2d26941d None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.758382 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.759187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.763853 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.763853 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.770743 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.772230 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:21.791013 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:21.792455 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:21.793612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:21.793612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:21.793612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:21.793612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:21.796184 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 597/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:21.798604 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495b4d-0416-47f2-acb7-6311dc45165b None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.906056 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495b4d-0416-47f2-acb7-6311dc45165b None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.941517 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c17ca5-3d0e-4152-b56b-b931f63b802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.942711 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17ca5-3d0e-4152-b56b-b931f63b802d None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.942982 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17ca5-3d0e-4152-b56b-b931f63b802d None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.943243 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c17ca5-3d0e-4152-b56b-b931f63b802d None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.943990 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17ca5-3d0e-4152-b56b-b931f63b802d None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:21.944292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17ca5-3d0e-4152-b56b-b931f63b802d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.945653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c17ca5-3d0e-4152-b56b-b931f63b802d None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:21.957307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 607/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:21.963911 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:22.087174 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75c9aa-00e9-40b4-a697-8416b11d74f7 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:22.127223 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3f3ae-ea8f-440d-b998-0126a3f259f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:22.128108 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3f3ae-ea8f-440d-b998-0126a3f259f5 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:22.128426 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3f3ae-ea8f-440d-b998-0126a3f259f5 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:22.128718 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3f3ae-ea8f-440d-b998-0126a3f259f5 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:22.129484 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3f3ae-ea8f-440d-b998-0126a3f259f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:22.130974 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3f3ae-ea8f-440d-b998-0126a3f259f5 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:22.152671 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 598/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:32:21 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:32:24.764812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f0501-c2dd-4de6-aeb6-d2f1177853f5 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:24.765404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f0501-c2dd-4de6-aeb6-d2f1177853f5 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:24.765404 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f0501-c2dd-4de6-aeb6-d2f1177853f5 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:24.766772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 608/1206] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:24.774627 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2bc6-2883-4c82-bedc-178cf9a4329e None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:24.775147 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2bc6-2883-4c82-bedc-178cf9a4329e None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:24.775243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2bc6-2883-4c82-bedc-178cf9a4329e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:24.795011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-1a7a2bc6-2883-4c82-bedc-178cf9a4329e None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:24.796397 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-1a7a2bc6-2883-4c82-bedc-178cf9a4329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:24.874752 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 599/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:32:24.902540 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f0501-c2dd-4de6-aeb6-d2f1177853f5 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.017806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f0501-c2dd-4de6-aeb6-d2f1177853f5 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.054575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02b416-82eb-4b32-9715-97725ddfcddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.055387 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02b416-82eb-4b32-9715-97725ddfcddb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.055729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02b416-82eb-4b32-9715-97725ddfcddb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.056006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02b416-82eb-4b32-9715-97725ddfcddb None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.068693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02b416-82eb-4b32-9715-97725ddfcddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-bd02b416-82eb-4b32-9715-97725ddfcddb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:25.077249 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:25.078319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:25.079291 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 609/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:25.086032 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a2bc6-2883-4c82-bedc-178cf9a4329e None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.197769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a2bc6-2883-4c82-bedc-178cf9a4329e None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.235102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.235927 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.236219 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.236525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.237365 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:25.237729 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:25.239487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:25.254550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 600/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:25.254771 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02b416-82eb-4b32-9715-97725ddfcddb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.363188 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02b416-82eb-4b32-9715-97725ddfcddb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.402619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.402906 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.403139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.403408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.415181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:25.416677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:25.435422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:25.436791 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:25.438266 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:25.438266 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:25.438266 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:25.438266 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:25.438266 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 610/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:25.443100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.556028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9f0da-1d9a-4fb1-8f81-4b098425304f None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.594453 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.595116 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.595410 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.595676 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.596498 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:25.596809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:25.600779 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:25.613975 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 601/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:25.619524 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.729773 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19180045-5753-4c30-bfb6-fbd35be77d8e None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.768437 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.769365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.770246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.770535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] PATH_INFO: `/v3/users/placement` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.779882 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:25.781434 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:32:25.798837 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:25.800062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:25.801677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 611/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:32:25.808804 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.920985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188c362-5dd0-4e76-97d2-2d37db0c5060 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.958935 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.959945 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.960234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.960511 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.961388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:25.961725 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:25.963298 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:25.982391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 602/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:25.989745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.102315 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa177298-b2b9-4831-b193-80d041229e12 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:26.140303 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0618a-058e-45a6-98db-93a267d73735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.140976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0618a-058e-45a6-98db-93a267d73735 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.141256 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0618a-058e-45a6-98db-93a267d73735 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.141541 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0618a-058e-45a6-98db-93a267d73735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.233597 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0618a-058e-45a6-98db-93a267d73735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.235098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0618a-058e-45a6-98db-93a267d73735 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.355157 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 612/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:32:26.361303 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.484285 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec749226-6ee8-4c55-9caf-c43033148202 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:26.526106 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.527265 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.527699 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.528179 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.541051 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.543000 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:26.564868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:26.566535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:26.568274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:26.568274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:26.568274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:26.568274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:26.568274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 603/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:26.573418 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0618a-058e-45a6-98db-93a267d73735 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.689640 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0618a-058e-45a6-98db-93a267d73735 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:26.728110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.728784 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.729096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.729354 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.730052 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:26.730371 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.731718 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.744098 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 613/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:26.751155 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.861493 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992353a9-bc4a-4ad3-95e5-921e5f71f874 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:26.901150 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.901995 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.902278 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.902530 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.912678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.914809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:32:26.934724 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:26.936010 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:26.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:32:26.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:32:26.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:32:26.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:32:26.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:32:26.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:32:26.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:26.937405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:26.938588 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 604/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:26.944604 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.067491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1138f-083a-4070-a299-e53deb471067 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.109425 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4ada0-a94f-40d5-9ba2-c572ec82f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.110246 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ada0-a94f-40d5-9ba2-c572ec82f4be None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.110533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ada0-a94f-40d5-9ba2-c572ec82f4be None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.110826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ada0-a94f-40d5-9ba2-c572ec82f4be None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.111806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4ada0-a94f-40d5-9ba2-c572ec82f4be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:27.112166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4ada0-a94f-40d5-9ba2-c572ec82f4be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:27.114364 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4ada0-a94f-40d5-9ba2-c572ec82f4be None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:27.128058 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 614/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:27.135864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.259323 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059b544-6e05-462c-b89b-f600258f3361 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.300593 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3cd23-56e2-4249-a760-7c9e3cf8a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.301779 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3cd23-56e2-4249-a760-7c9e3cf8a90d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.302093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3cd23-56e2-4249-a760-7c9e3cf8a90d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.302388 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3cd23-56e2-4249-a760-7c9e3cf8a90d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.303231 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3cd23-56e2-4249-a760-7c9e3cf8a90d None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=91c09dec03034c2e98bdcb5fac961008) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:27.303549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3cd23-56e2-4249-a760-7c9e3cf8a90d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:27.305273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3cd23-56e2-4249-a760-7c9e3cf8a90d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:27.311896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 605/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/role_assignments?user.id=91c09dec03034c2e98bdcb5fac961008&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:29.863992 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d94722-1f51-48c9-8b00-6e22d1ad5e85 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.864603 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d94722-1f51-48c9-8b00-6e22d1ad5e85 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.864603 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d94722-1f51-48c9-8b00-6e22d1ad5e85 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.866170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 615/1220] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:29.872312 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ad92-a31b-40c0-a21b-94b33fa24c76 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.872779 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ad92-a31b-40c0-a21b-94b33fa24c76 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.872899 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ad92-a31b-40c0-a21b-94b33fa24c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.892240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-2066ad92-a31b-40c0-a21b-94b33fa24c76 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:29.893729 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-2066ad92-a31b-40c0-a21b-94b33fa24c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:29.967367 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 606/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:32:29.993878 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d94722-1f51-48c9-8b00-6e22d1ad5e85 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:30.116229 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d94722-1f51-48c9-8b00-6e22d1ad5e85 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:30.157331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeadf1-daca-43e1-acb1-be50d3f8bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:30.158306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeadf1-daca-43e1-acb1-be50d3f8bebf None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.158693 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeadf1-daca-43e1-acb1-be50d3f8bebf None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.159112 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeadf1-daca-43e1-acb1-be50d3f8bebf None admin] PATH_INFO: `/v3/roles/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.172467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afeadf1-daca-43e1-acb1-be50d3f8bebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-7afeadf1-daca-43e1-acb1-be50d3f8bebf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:30.181002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:30.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:30.183143 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 616/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:30.191864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ad92-a31b-40c0-a21b-94b33fa24c76 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:30.309802 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ad92-a31b-40c0-a21b-94b33fa24c76 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:30.347490 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:30.349531 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.349919 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.350297 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.351263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] RBAC: Adding query filter params (name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:30.351670 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:30.353202 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:30.362143 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 607/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:32:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:30.369117 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeadf1-daca-43e1-acb1-be50d3f8bebf None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:30.489604 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeadf1-daca-43e1-acb1-be50d3f8bebf None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:30.525227 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:30.526031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.526314 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.526590 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.538471 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:30.539957 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:30.556670 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:30.557855 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:30.563918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:30.563918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:30.563918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:30.563918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:30.563918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 617/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:32:30.564326 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:30.674504 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19db84a-1620-4d5d-b51d-fbd941a67a94 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:30.714843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:30.715688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.715996 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.716271 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.717006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:30.717311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:30.718694 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:30.734696 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 608/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:30.740760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:30.852662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b1e00-3f66-4ce1-972d-0e2c0a6f8187 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:30.889251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:30.890055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.890341 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.890609 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] PATH_INFO: `/v3/users/placement` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.899549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:30.901132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:32:30.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:30.920114 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:30.921426 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 618/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:30.924977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.033730 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb68d01-d81a-41ee-aa00-5f272418b254 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.073794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.074509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.074794 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.075073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.076007 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:31.076316 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:31.077884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:31.096358 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 609/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:32:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:31.102760 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.211744 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3a4a-b559-427a-ab2f-dddf66a9eccf None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.250610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.251479 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.251800 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.252220 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.265673 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:31.267539 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:31.286586 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:31.288010 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:31.289129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:31.289129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:31.289129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:31.289129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:31.289129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 619/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:31.293698 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.405677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31754e8-ce6c-4058-9a9c-53cea432cb37 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.447699 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.449092 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.449792 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.450405 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.452042 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:31.452777 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:31.455943 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:31.476028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 610/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:31.481606 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.591132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556c9e9-0fdb-4f07-978f-2f745bd19ca9 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.626777 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.627814 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.628109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.628386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.637747 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:31.639477 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:32:31.656302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:31.657570 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:31.658831 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 620/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:32:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:31.664367 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.771073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f980c6-a91b-469b-b873-4b296e6e679b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.807401 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f31d0-2058-459a-8978-582fb4f5c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.808134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f31d0-2058-459a-8978-582fb4f5c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.808425 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f31d0-2058-459a-8978-582fb4f5c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.808742 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f31d0-2058-459a-8978-582fb4f5c8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.809766 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f31d0-2058-459a-8978-582fb4f5c8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:31.810203 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f31d0-2058-459a-8978-582fb4f5c8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:31.812050 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f31d0-2058-459a-8978-582fb4f5c8f6 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:31.825372 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 611/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:31.831562 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.935380 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73562c-e294-4402-8f59-c9834c384b34 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.970130 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142f2f9-10cd-4f69-b8d5-7eb8af78dc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.971031 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f2f9-10cd-4f69-b8d5-7eb8af78dc73 None admin] REQUEST_METHOD: `PUT` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.971317 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f2f9-10cd-4f69-b8d5-7eb8af78dc73 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.971581 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142f2f9-10cd-4f69-b8d5-7eb8af78dc73 None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/91c09dec03034c2e98bdcb5fac961008/roles/0dc5507e726a48198da466396f551a22` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.995306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142f2f9-10cd-4f69-b8d5-7eb8af78dc73 None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=91c09dec03034c2e98bdcb5fac961008, role_id=0dc5507e726a48198da466396f551a22)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:31.996842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142f2f9-10cd-4f69-b8d5-7eb8af78dc73 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:32.012358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 621/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:32:31 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/91c09dec03034c2e98bdcb5fac961008/roles/0dc5507e726a48198da466396f551a22 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:34.319965 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33e3b-ddcc-4cd6-a8d9-cb2eff768538 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.320535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33e3b-ddcc-4cd6-a8d9-cb2eff768538 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.320535 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33e3b-ddcc-4cd6-a8d9-cb2eff768538 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.323796 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 612/1233] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:34.327388 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ced98-104e-44fb-9e50-f1dc304c7d07 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.328025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ced98-104e-44fb-9e50-f1dc304c7d07 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.328025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ced98-104e-44fb-9e50-f1dc304c7d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.344968 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-176ced98-104e-44fb-9e50-f1dc304c7d07 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:34.346181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-176ced98-104e-44fb-9e50-f1dc304c7d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:34.427327 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 622/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:32:34.461916 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33e3b-ddcc-4cd6-a8d9-cb2eff768538 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.579354 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33e3b-ddcc-4cd6-a8d9-cb2eff768538 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.618279 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85072a-319f-48b1-9841-c29ad7236da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.619158 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85072a-319f-48b1-9841-c29ad7236da1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.619484 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85072a-319f-48b1-9841-c29ad7236da1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.619791 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85072a-319f-48b1-9841-c29ad7236da1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.632377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85072a-319f-48b1-9841-c29ad7236da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-9c85072a-319f-48b1-9841-c29ad7236da1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:34.642421 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:34.643713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:34.645142 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 613/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:34.650161 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ced98-104e-44fb-9e50-f1dc304c7d07 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.762325 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ced98-104e-44fb-9e50-f1dc304c7d07 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.797877 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.798549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.798832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.799105 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.799916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] RBAC: Adding query filter params (name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:34.800258 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.802337 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.811193 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 623/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:34.817471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85072a-319f-48b1-9841-c29ad7236da1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.922999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85072a-319f-48b1-9841-c29ad7236da1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.958673 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.959592 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.959918 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.960237 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.974100 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.975928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:34.999334 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:35.000873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:35.002093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:35.002093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:35.002093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:35.002093 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:35.006594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 614/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:35.007643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:35.111956 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f312cb-680b-4fd4-be77-f90a662e8299 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:35.146515 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:35.147170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:35.147444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:35.147712 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:35.148455 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:35.148758 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:35.150112 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:35.161544 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 624/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:35.167740 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:35.272692 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701e60e-68e7-4ef0-a4d6-6a982ba93381 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:35.308632 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:35.309461 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:35.309714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:35.310016 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:35.317939 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:35.319387 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:32:35.333338 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:35.340509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:35.341830 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 615/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:35.342682 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:35.450459 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3b00-e85c-44c5-a9e3-255ed18323bb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:35.487006 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:35.487922 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:35.488827 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:35.489232 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:35.490359 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:35.490767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:35.492466 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:35.514573 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 625/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:32:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:35.520440 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:35.627819 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ac37f-62de-4861-a3ed-94010fec57bc None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:35.663843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d652265-e6fa-405d-9eb4-eb964a28d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:35.664589 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652265-e6fa-405d-9eb4-eb964a28d44d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:35.664910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652265-e6fa-405d-9eb4-eb964a28d44d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:35.665239 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d652265-e6fa-405d-9eb4-eb964a28d44d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:35.734391 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d652265-e6fa-405d-9eb4-eb964a28d44d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:35.736001 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d652265-e6fa-405d-9eb4-eb964a28d44d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:35.843927 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 616/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:32:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:32:35.850790 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:35.956778 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dd73e-67bf-42c8-b999-a9b0f8397ce7 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:36.000583 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:36.001486 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.001874 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.002151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.014594 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:36.016091 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:36.036032 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:36.037151 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:36.038331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:36.038331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:36.038331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:36.038331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:36.038331 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 626/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:36.043075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d652265-e6fa-405d-9eb4-eb964a28d44d None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:36.151397 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d652265-e6fa-405d-9eb4-eb964a28d44d None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:36.188696 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:36.189417 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.189612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.189887 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.190866 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:36.191923 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:36.193306 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:36.204807 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 617/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:36.211334 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:36.319132 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d61d0-e869-4546-a6c7-fd8665625e43 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:36.356745 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:36.357780 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.358259 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.358742 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.369235 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:36.371677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:32:36.394737 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:36.396109 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:36.397356 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 627/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:36.403217 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:36.521868 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4503c-7f28-45e0-a962-926524bf0b5b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:36.555897 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416a84-a73a-4bd2-8f08-011e82556120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:36.556565 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416a84-a73a-4bd2-8f08-011e82556120 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.556846 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416a84-a73a-4bd2-8f08-011e82556120 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.557121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416a84-a73a-4bd2-8f08-011e82556120 None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.557949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8416a84-a73a-4bd2-8f08-011e82556120 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:36.558274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8416a84-a73a-4bd2-8f08-011e82556120 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:36.559654 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8416a84-a73a-4bd2-8f08-011e82556120 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:36.572773 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 618/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:32:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:36.579200 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:36.685959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc8071-22fb-4052-b640-fd6ff36506c6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:36.723277 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4eb33-3254-4b16-be30-296d927c2c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:36.724074 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eb33-3254-4b16-be30-296d927c2c41 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.724464 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eb33-3254-4b16-be30-296d927c2c41 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.724750 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eb33-3254-4b16-be30-296d927c2c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.725590 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4eb33-3254-4b16-be30-296d927c2c41 None admin] RBAC: Adding query filter params (role.id=0dc5507e726a48198da466396f551a22, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=91c09dec03034c2e98bdcb5fac961008) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:36.725904 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4eb33-3254-4b16-be30-296d927c2c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:36.727361 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4eb33-3254-4b16-be30-296d927c2c41 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:36.735798 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 628/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:32:36 2022] GET /identity/v3/role_assignments?user.id=91c09dec03034c2e98bdcb5fac961008&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=0dc5507e726a48198da466396f551a22 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:39.245285 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7e2d-69b0-4578-b9fb-0d9d8b8a50d5 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.245928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7e2d-69b0-4578-b9fb-0d9d8b8a50d5 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.245928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7e2d-69b0-4578-b9fb-0d9d8b8a50d5 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.247332 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 619/1247] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:39.252762 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac022-cf41-4f1f-b53a-c822fb9f64a5 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.253239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac022-cf41-4f1f-b53a-c822fb9f64a5 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.253349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ac022-cf41-4f1f-b53a-c822fb9f64a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.275710 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-f36ac022-cf41-4f1f-b53a-c822fb9f64a5 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:39.277056 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-f36ac022-cf41-4f1f-b53a-c822fb9f64a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:39.356407 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 629/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:32:39.385423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac7e2d-69b0-4578-b9fb-0d9d8b8a50d5 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.505497 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac7e2d-69b0-4578-b9fb-0d9d8b8a50d5 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.545346 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58ec4e-4f20-4c0d-a3cf-689419c14681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:39.546132 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ec4e-4f20-4c0d-a3cf-689419c14681 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.546431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ec4e-4f20-4c0d-a3cf-689419c14681 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.546694 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58ec4e-4f20-4c0d-a3cf-689419c14681 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.558154 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58ec4e-4f20-4c0d-a3cf-689419c14681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-7d58ec4e-4f20-4c0d-a3cf-689419c14681 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:39.568898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:39.569963 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:39.570922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 620/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:39.576678 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ac022-cf41-4f1f-b53a-c822fb9f64a5 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.685478 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ac022-cf41-4f1f-b53a-c822fb9f64a5 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.727500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:39.728279 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.728626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.728936 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.729774 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:39.730192 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:39.732012 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:39.749712 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 630/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:39.751002 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58ec4e-4f20-4c0d-a3cf-689419c14681 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.867427 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58ec4e-4f20-4c0d-a3cf-689419c14681 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.906865 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:39.908039 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.908330 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.908898 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.922356 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:39.924178 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:39.944525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:39.945910 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:39.947377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:39.947377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:39.947377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:39.947377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:39.947377 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 621/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:39.952357 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:40.070797 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad6aaa-aa64-4f9a-9e96-4426396e0558 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:40.108373 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:40.109099 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.109386 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.109656 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.110490 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:40.110846 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:40.112358 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:40.125934 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 631/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:40.131986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:40.258509 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb2c2-08ef-4cb6-baee-fe0a111b9957 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:40.302335 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:40.303487 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.303893 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.304240 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] PATH_INFO: `/v3/users/placement` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.314985 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:40.317412 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:32:40.338352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:40.339727 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:40.341028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 622/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:40.345783 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:40.458663 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e95a13-f102-42c1-bf75-207a463fdd7f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:40.496501 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:40.497237 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.497472 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.497751 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.498681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:40.499021 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:40.500610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:40.520719 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 632/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:32:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:40.527097 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:40.653513 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d8134-5e90-4bee-9382-9eea0925f10b None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:40.694650 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a7c79-507a-4f27-a6bc-b0a236efe823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:40.695361 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a7c79-507a-4f27-a6bc-b0a236efe823 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.695649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a7c79-507a-4f27-a6bc-b0a236efe823 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.695950 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a7c79-507a-4f27-a6bc-b0a236efe823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.774292 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a7c79-507a-4f27-a6bc-b0a236efe823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:40.776157 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a7c79-507a-4f27-a6bc-b0a236efe823 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:40.896065 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 623/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:32:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:32:40.901730 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.020521 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6b95-92de-4684-bb80-b5f4faf5546c None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.056725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.057525 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.057806 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.058080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.068934 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.070467 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:41.089918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:41.091139 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:41.092274 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:41.092274 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:41.092274 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:41.092274 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:41.092274 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 633/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:41.097930 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a7c79-507a-4f27-a6bc-b0a236efe823 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.199978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a7c79-507a-4f27-a6bc-b0a236efe823 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.238843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.239529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.239804 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.240089 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.240897 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:41.241120 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.242484 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.255301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 624/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:41.261484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.371489 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c898e-955d-4f9b-be93-71d15e267b67 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.414921 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.415698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.416003 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.416302 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.423265 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.424768 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:32:41.442647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:41.443963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:41.445067 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 634/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:41.449835 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.558423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290044e8-9f41-4e1c-a6e4-464296d3a858 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.592604 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a70933-34eb-4109-a4b4-37f94031705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.593344 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a70933-34eb-4109-a4b4-37f94031705d None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.593630 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a70933-34eb-4109-a4b4-37f94031705d None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.593949 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a70933-34eb-4109-a4b4-37f94031705d None admin] PATH_INFO: `/v3/projects` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.594769 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a70933-34eb-4109-a4b4-37f94031705d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:41.595090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a70933-34eb-4109-a4b4-37f94031705d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.596626 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a70933-34eb-4109-a4b4-37f94031705d None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.609939 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 625/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:41.616702 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.730166 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b60e5-507f-4886-9a72-ac3837e5de26 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.768076 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66d0c2-761e-4d3d-bbaa-9b1c737e05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.768695 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66d0c2-761e-4d3d-bbaa-9b1c737e05f4 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.769082 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66d0c2-761e-4d3d-bbaa-9b1c737e05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.769963 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66d0c2-761e-4d3d-bbaa-9b1c737e05f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.770805 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66d0c2-761e-4d3d-bbaa-9b1c737e05f4 None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=91c09dec03034c2e98bdcb5fac961008) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:41.771120 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66d0c2-761e-4d3d-bbaa-9b1c737e05f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.772674 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66d0c2-761e-4d3d-bbaa-9b1c737e05f4 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.778896 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 635/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/role_assignments?user.id=91c09dec03034c2e98bdcb5fac961008&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=8cf832105b2949f6b11e06b208146326 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:44.102125 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bb878-7dd8-4745-a244-fe9bec55b055 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.102712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bb878-7dd8-4745-a244-fe9bec55b055 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.102712 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bb878-7dd8-4745-a244-fe9bec55b055 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.104102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 626/1261] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:44.109357 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1f58-6be9-433a-b0b5-b99bf262c170 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.109805 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1f58-6be9-433a-b0b5-b99bf262c170 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.109923 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1f58-6be9-433a-b0b5-b99bf262c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.126818 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-c0cd1f58-6be9-433a-b0b5-b99bf262c170 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:44.128028 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-c0cd1f58-6be9-433a-b0b5-b99bf262c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:44.210933 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 636/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:32:44.233423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bb878-7dd8-4745-a244-fe9bec55b055 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.332676 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bb878-7dd8-4745-a244-fe9bec55b055 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:44.365310 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd5f11-522d-4134-92f9-30b3f93dd852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:44.366024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5f11-522d-4134-92f9-30b3f93dd852 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.366309 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5f11-522d-4134-92f9-30b3f93dd852 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.366584 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd5f11-522d-4134-92f9-30b3f93dd852 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.376585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd5f11-522d-4134-92f9-30b3f93dd852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-95fd5f11-522d-4134-92f9-30b3f93dd852 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:44.385037 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:44.386280 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:44.387393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 627/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:44.392239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd1f58-6be9-433a-b0b5-b99bf262c170 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.489511 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd1f58-6be9-433a-b0b5-b99bf262c170 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:44.522633 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:44.523290 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.523569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.523866 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.524618 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:44.524922 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:44.526273 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:44.534295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 637/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:44.540314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd5f11-522d-4134-92f9-30b3f93dd852 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.644689 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd5f11-522d-4134-92f9-30b3f93dd852 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:44.676451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:44.677234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.677510 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.677781 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.688182 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:44.689617 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:44.706826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:44.708113 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:44.709318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:44.709318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:44.709318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:44.709318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:44.709318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 628/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:44.713812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.809077 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5af7aa-37e1-412a-971b-27420a82e9b8 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:44.842638 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:44.843286 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.843569 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.843865 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.844583 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:44.844885 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:44.846239 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:44.858442 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 638/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:44.864729 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.961438 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b649990-afe1-456c-855d-5429e4137d66 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.004417 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.005416 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.005713 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.005999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.015040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.016873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:32:45.033263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:45.035024 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:45.036243 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 629/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:45.042160 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.140733 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae162a5-8a13-4f96-a66e-dec70ded1ebd None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.173107 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.173765 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.174047 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.174321 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] PATH_INFO: `/v3/users` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.175189 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:45.175619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.177212 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.194832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 639/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:45.200599 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.296654 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af279a8-97e5-437a-89f1-41a5422c6bd3 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.328255 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.329028 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.329310 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.329586 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.340220 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.341663 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:45.358982 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:45.360141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:45.361407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:45.361407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:45.361407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:45.361407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:45.361407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 630/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:45.366085 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.462021 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f67f0-7ada-4fda-9e59-bb07048ca3bb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.494869 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.495522 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.495826 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.496105 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.496821 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:45.497124 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.498481 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.509644 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 640/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:45.515319 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.612263 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a061877-0af2-47f0-b8f1-4b8ada34f3d2 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.645129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.645904 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.646186 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.646461 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.652969 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.654408 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:32:45.668488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:45.669863 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:45.671185 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 631/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:45.675941 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.770801 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dbe0a-ddaf-4146-afd0-a1aa1beb45b6 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.801991 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408e431-be49-4d65-8067-78651022876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.802630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e431-be49-4d65-8067-78651022876f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.802911 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e431-be49-4d65-8067-78651022876f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.803181 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408e431-be49-4d65-8067-78651022876f None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.803984 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408e431-be49-4d65-8067-78651022876f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:45.804289 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408e431-be49-4d65-8067-78651022876f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.805708 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408e431-be49-4d65-8067-78651022876f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.818890 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 641/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:45.824806 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.922320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09c98f-0035-4dc1-8ce9-a94f7df9ca5a None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.955414 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50912e-b6c4-4c07-a2d8-935404621313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.956318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50912e-b6c4-4c07-a2d8-935404621313 None admin] REQUEST_METHOD: `PUT` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.957219 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50912e-b6c4-4c07-a2d8-935404621313 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.957634 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50912e-b6c4-4c07-a2d8-935404621313 None admin] PATH_INFO: `/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/91c09dec03034c2e98bdcb5fac961008/roles/8cf832105b2949f6b11e06b208146326` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.959619 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50912e-b6c4-4c07-a2d8-935404621313 None admin] RBAC: Authorizing `identity:create_grant(project_id=97316c4f42ae4185a3ebe8633093e218, user_id=91c09dec03034c2e98bdcb5fac961008, role_id=8cf832105b2949f6b11e06b208146326)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.961094 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50912e-b6c4-4c07-a2d8-935404621313 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.977286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 632/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:32:45 2022] PUT /identity/v3/projects/97316c4f42ae4185a3ebe8633093e218/users/91c09dec03034c2e98bdcb5fac961008/roles/8cf832105b2949f6b11e06b208146326 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:32:48.258938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd610de-51c4-42b1-984b-29d1a56fda6c None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.259508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd610de-51c4-42b1-984b-29d1a56fda6c None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.259508 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd610de-51c4-42b1-984b-29d1a56fda6c None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.260909 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 642/1274] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:48.266415 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254792ce-fcd9-401d-903d-12298708a46d None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.266838 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254792ce-fcd9-401d-903d-12298708a46d None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.266957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254792ce-fcd9-401d-903d-12298708a46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.283940 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-254792ce-fcd9-401d-903d-12298708a46d None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:48.285811 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-254792ce-fcd9-401d-903d-12298708a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:48.348901 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 633/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:32:48.372258 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd610de-51c4-42b1-984b-29d1a56fda6c None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:48.471234 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd610de-51c4-42b1-984b-29d1a56fda6c None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:48.504616 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37871b-fb2c-4c8d-b5da-6b0f4906e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:48.505397 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37871b-fb2c-4c8d-b5da-6b0f4906e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.505682 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37871b-fb2c-4c8d-b5da-6b0f4906e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.505956 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37871b-fb2c-4c8d-b5da-6b0f4906e6f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.515882 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37871b-fb2c-4c8d-b5da-6b0f4906e6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-8d37871b-fb2c-4c8d-b5da-6b0f4906e6f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:48.523959 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:48.529977 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:48.531097 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 643/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:48.531968 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254792ce-fcd9-401d-903d-12298708a46d None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:48.627040 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254792ce-fcd9-401d-903d-12298708a46d None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:48.659094 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:48.660376 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.660586 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.660859 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] PATH_INFO: `/v3/roles` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.661608 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:48.661916 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:48.663288 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:48.671070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 634/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:48.677454 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37871b-fb2c-4c8d-b5da-6b0f4906e6f2 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:48.775893 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37871b-fb2c-4c8d-b5da-6b0f4906e6f2 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:48.808664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:48.809443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.809725 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.809991 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.820767 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:48.822205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:48.839025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:48.840252 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:48.841536 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:48.841536 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:48.841536 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:48.841536 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:48.841536 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 644/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:48.846022 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:48.945346 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a637db4-49ef-4a51-a7c7-a4763e0d63e1 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:48.982438 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:48.983828 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.984329 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.984676 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] PATH_INFO: `/v3/domains` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.985891 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:48.986270 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:48.989101 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.002232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 635/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:49.008986 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.107025 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f5e99-69bd-4d21-95aa-54d5269b16ef None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.139122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.139944 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.140229 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.140502 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.148292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.149728 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:32:49.164326 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:49.165561 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:49.166643 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 645/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:49.171268 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.270555 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef2431-cc92-412e-98c3-322e4a71d546 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.303469 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.304163 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.304449 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.304728 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] PATH_INFO: `/v3/users` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.305570 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:49.305882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.307314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.323870 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 636/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:49.329657 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.427144 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df336-21a4-4209-b0e5-733bc9d25d1f None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.459851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e539d78-d7b6-44db-86e5-46d6f28f48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.460491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539d78-d7b6-44db-86e5-46d6f28f48ea None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.460775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539d78-d7b6-44db-86e5-46d6f28f48ea None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.461054 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539d78-d7b6-44db-86e5-46d6f28f48ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.525662 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e539d78-d7b6-44db-86e5-46d6f28f48ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.527118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e539d78-d7b6-44db-86e5-46d6f28f48ea None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.623578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 646/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:32:49.629522 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.725714 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307466fc-46a6-420b-ace9-fafae456f4c0 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.758772 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.759548 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.759855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.760133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.770250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.771687 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:49.789070 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:49.790250 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:49.791489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:49.791489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:49.791489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:49.791489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:49.791489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 637/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:32:49.795893 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e539d78-d7b6-44db-86e5-46d6f28f48ea None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.890661 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e539d78-d7b6-44db-86e5-46d6f28f48ea None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.932449 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.933104 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.933381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.933654 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] PATH_INFO: `/v3/domains` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.934365 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:49.934664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.936062 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.947048 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 647/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:49.952740 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:50.058078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09642995-937a-40a4-a382-d31905b9ae84 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:50.090205 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:50.090978 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:50.091256 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:50.091526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:50.098629 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:50.100078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:32:50.113291 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application with Lock( May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:50.114467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: ERROR keystone.server.flask.application May 09 15:32:50.115697 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 638/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:50.120406 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:50.217425 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14a7bf-04aa-4c09-bed2-298b87d57acb None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:50.249009 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f938ab-83cc-411a-a317-8b62e6a0e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:50.249655 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f938ab-83cc-411a-a317-8b62e6a0e9ba None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:50.249940 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f938ab-83cc-411a-a317-8b62e6a0e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:50.250215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f938ab-83cc-411a-a317-8b62e6a0e9ba None admin] PATH_INFO: `/v3/projects` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:50.250997 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f938ab-83cc-411a-a317-8b62e6a0e9ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:50.251304 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f938ab-83cc-411a-a317-8b62e6a0e9ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:50.252750 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f938ab-83cc-411a-a317-8b62e6a0e9ba None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:50.265168 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 648/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:32:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:50.272141 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:50.368788 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1cc8-ac3a-46da-a3a6-d701bb1fe599 None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:50.401101 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e51c3-5b94-45cf-82cc-ce1c134d80ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:50.401754 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e51c3-5b94-45cf-82cc-ce1c134d80ae None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:50.402039 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e51c3-5b94-45cf-82cc-ce1c134d80ae None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:50.402314 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e51c3-5b94-45cf-82cc-ce1c134d80ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:50.403153 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e51c3-5b94-45cf-82cc-ce1c134d80ae None admin] RBAC: Adding query filter params (role.id=8cf832105b2949f6b11e06b208146326, scope.project.id=97316c4f42ae4185a3ebe8633093e218, user.id=91c09dec03034c2e98bdcb5fac961008) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:50.403471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e51c3-5b94-45cf-82cc-ce1c134d80ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:50.404936 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e51c3-5b94-45cf-82cc-ce1c134d80ae None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:50.411121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 639/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:32:50 2022] GET /identity/v3/role_assignments?user.id=91c09dec03034c2e98bdcb5fac961008&scope.project.id=97316c4f42ae4185a3ebe8633093e218&role.id=8cf832105b2949f6b11e06b208146326 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:52.672576 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bfab-3061-4d55-800a-de024465476c None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:52.673122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bfab-3061-4d55-800a-de024465476c None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:52.673122 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bfab-3061-4d55-800a-de024465476c None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:52.674423 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 649/1288] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:52.679899 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759114d-0ac6-47ef-a8de-daa710b51067 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:52.680318 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759114d-0ac6-47ef-a8de-daa710b51067 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:52.680475 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759114d-0ac6-47ef-a8de-daa710b51067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:52.697939 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-e759114d-0ac6-47ef-a8de-daa710b51067 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:52.699130 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-e759114d-0ac6-47ef-a8de-daa710b51067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:52.763889 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 640/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:32:52.786651 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680bfab-3061-4d55-800a-de024465476c None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:52.885619 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680bfab-3061-4d55-800a-de024465476c None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:52.917701 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:52.918491 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:52.918775 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:52.919055 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] PATH_INFO: `/v3/services/placement` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:52.919706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:52.921088 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:52.933253 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:52.934703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:52.936002 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 650/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:32:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:52.941353 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759114d-0ac6-47ef-a8de-daa710b51067 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:53.048172 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759114d-0ac6-47ef-a8de-daa710b51067 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:53.082320 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f458b9-bfb5-4150-a8be-b8eccf3783d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:53.082977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f458b9-bfb5-4150-a8be-b8eccf3783d1 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:53.083256 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f458b9-bfb5-4150-a8be-b8eccf3783d1 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:53.083530 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f458b9-bfb5-4150-a8be-b8eccf3783d1 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:53.084264 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f458b9-bfb5-4150-a8be-b8eccf3783d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:53.084570 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f458b9-bfb5-4150-a8be-b8eccf3783d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:53.085920 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f458b9-bfb5-4150-a8be-b8eccf3783d1 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:53.090592 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 641/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:32:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:53.096413 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:53.194343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5ccdb-970b-4866-970a-bb445f5e741a None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:53.227022 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c5baf-47ba-4098-9ec2-e9d6fa598ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:53.227677 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5baf-47ba-4098-9ec2-e9d6fa598ac9 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:53.227991 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5baf-47ba-4098-9ec2-e9d6fa598ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:53.228269 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c5baf-47ba-4098-9ec2-e9d6fa598ac9 None admin] PATH_INFO: `/v3/services` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:53.228972 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c5baf-47ba-4098-9ec2-e9d6fa598ac9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:53.229280 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c5baf-47ba-4098-9ec2-e9d6fa598ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:53.230647 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c5baf-47ba-4098-9ec2-e9d6fa598ac9 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:53.234974 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 651/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:32:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:55.457038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17379-0e61-40f9-b5d5-6d9feddf45bd None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.457734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17379-0e61-40f9-b5d5-6d9feddf45bd None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.457734 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17379-0e61-40f9-b5d5-6d9feddf45bd None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.458969 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 642/1293] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:55.464295 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935152a9-faa8-4955-a4eb-9e200d589c42 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.464682 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935152a9-faa8-4955-a4eb-9e200d589c42 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.464851 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935152a9-faa8-4955-a4eb-9e200d589c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.481803 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-935152a9-faa8-4955-a4eb-9e200d589c42 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:55.482994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-935152a9-faa8-4955-a4eb-9e200d589c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:55.547307 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 652/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:32:55.570163 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17379-0e61-40f9-b5d5-6d9feddf45bd None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:55.668909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17379-0e61-40f9-b5d5-6d9feddf45bd None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:55.702236 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa01416-b344-4e09-839d-4c9687516d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:55.702903 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa01416-b344-4e09-839d-4c9687516d59 None admin] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.703189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa01416-b344-4e09-839d-4c9687516d59 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.703467 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa01416-b344-4e09-839d-4c9687516d59 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.704233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa01416-b344-4e09-839d-4c9687516d59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:55.705600 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa01416-b344-4e09-839d-4c9687516d59 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:55.719106 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 643/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:32:55 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:57.959938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97ae1-d332-4028-b0ec-fefd2df18fec None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.960514 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97ae1-d332-4028-b0ec-fefd2df18fec None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.960514 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a97ae1-d332-4028-b0ec-fefd2df18fec None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.961866 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 653/1296] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:57.967594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2e29-08fc-494c-8d03-afd47eaf4212 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.968057 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2e29-08fc-494c-8d03-afd47eaf4212 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.968352 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2e29-08fc-494c-8d03-afd47eaf4212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.986286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-626f2e29-08fc-494c-8d03-afd47eaf4212 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:57.988079 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-626f2e29-08fc-494c-8d03-afd47eaf4212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:58.065793 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 644/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:32:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:32:58.088306 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a97ae1-d332-4028-b0ec-fefd2df18fec None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.184141 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a97ae1-d332-4028-b0ec-fefd2df18fec None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.216729 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.217443 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.217722 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.217990 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] PATH_INFO: `/v3/services/placement` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.218648 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.220014 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:58.232197 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:58.233510 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:32:58.234681 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 654/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:58.239642 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2e29-08fc-494c-8d03-afd47eaf4212 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.333814 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2e29-08fc-494c-8d03-afd47eaf4212 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.366298 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.366952 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.367234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.367520 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.368273 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] RBAC: Adding query filter params (name=placement) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:58.368585 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.369959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.375121 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 645/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:58.381916 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.479957 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bfd5f-bc35-4895-9445-15e9608b6236 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.511736 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a229b-acc7-4ed3-a575-3e4211b8016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.512413 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a229b-acc7-4ed3-a575-3e4211b8016b None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.512703 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a229b-acc7-4ed3-a575-3e4211b8016b None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.512982 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a229b-acc7-4ed3-a575-3e4211b8016b None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.513772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a229b-acc7-4ed3-a575-3e4211b8016b None admin] RBAC: Adding query filter params (interface=public, service_id=5d5e22de43d442a9b25b67a2e3a0942f, region_id=RegionOne) {{(pid=206370) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:58.514085 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a229b-acc7-4ed3-a575-3e4211b8016b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.515444 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a229b-acc7-4ed3-a575-3e4211b8016b None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.520956 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 655/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/endpoints?service_id=5d5e22de43d442a9b25b67a2e3a0942f&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:58.526628 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.621946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d02c7-9c51-42e7-aee0-7e5a3b20cedd None admin] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.653577 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f96c6-fd8a-4509-b71f-1cde0f1e9184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.654227 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f96c6-fd8a-4509-b71f-1cde0f1e9184 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.654508 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f96c6-fd8a-4509-b71f-1cde0f1e9184 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.654785 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f96c6-fd8a-4509-b71f-1cde0f1e9184 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.655466 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f96c6-fd8a-4509-b71f-1cde0f1e9184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.656855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f96c6-fd8a-4509-b71f-1cde0f1e9184 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.663906 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 646/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:33:00.990818 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376cedc-e796-488e-a580-0f289cb00e6e None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:00.991401 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376cedc-e796-488e-a580-0f289cb00e6e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:00.991401 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376cedc-e796-488e-a580-0f289cb00e6e None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:00.992830 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 656/1302] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:00.998298 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982c51-5c8f-4248-a953-4b6ec40d2d05 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:00.998739 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982c51-5c8f-4248-a953-4b6ec40d2d05 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:00.998847 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982c51-5c8f-4248-a953-4b6ec40d2d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.015626 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-f2982c51-5c8f-4248-a953-4b6ec40d2d05 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:01.016833 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-f2982c51-5c8f-4248-a953-4b6ec40d2d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:01.080311 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 647/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:33:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:33:01.105158 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376cedc-e796-488e-a580-0f289cb00e6e None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:01.203311 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376cedc-e796-488e-a580-0f289cb00e6e None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:01.235874 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:01.236664 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.236947 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.237324 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.238056 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:01.239411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:01.251080 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:01.252411 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application with Lock( May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: ERROR keystone.server.flask.application May 09 15:33:01.253650 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 657/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:33:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:01.258749 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2982c51-5c8f-4248-a953-4b6ec40d2d05 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:01.357134 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2982c51-5c8f-4248-a953-4b6ec40d2d05 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:01.389751 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97109861-76d8-48fa-ab2a-289b35d7fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:01.390410 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109861-76d8-48fa-ab2a-289b35d7fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.390687 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109861-76d8-48fa-ab2a-289b35d7fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.390959 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97109861-76d8-48fa-ab2a-289b35d7fcd2 None admin] PATH_INFO: `/v3/services` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.391667 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97109861-76d8-48fa-ab2a-289b35d7fcd2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=206369) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:01.391999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97109861-76d8-48fa-ab2a-289b35d7fcd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:01.393351 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97109861-76d8-48fa-ab2a-289b35d7fcd2 None admin] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:01.398973 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 648/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:33:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:01.404716 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:01.501179 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7c51f-ae70-441f-91c9-3f5905a81ae4 None admin] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:01.533828 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e43fd3-d21b-44c2-bf6b-3d7bd88201ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7614d8c4184d29a9515f84d7487a48', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:01.534507 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e43fd3-d21b-44c2-bf6b-3d7bd88201ae None admin] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.534789 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e43fd3-d21b-44c2-bf6b-3d7bd88201ae None admin] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.535065 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e43fd3-d21b-44c2-bf6b-3d7bd88201ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.535832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e43fd3-d21b-44c2-bf6b-3d7bd88201ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:01.537211 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e43fd3-d21b-44c2-bf6b-3d7bd88201ae None admin] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:01.555159 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 658/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:33:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:08.013419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622fcbe-8925-4566-9ea1-182efbfd4810 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.014019 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622fcbe-8925-4566-9ea1-182efbfd4810 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.014129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622fcbe-8925-4566-9ea1-182efbfd4810 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.016102 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 649/1307] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:08.021327 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb47ec2-0a73-4930-a062-71ca3e79d545 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.021846 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb47ec2-0a73-4930-a062-71ca3e79d545 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.021846 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb47ec2-0a73-4930-a062-71ca3e79d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.179215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-4bb47ec2-0a73-4930-a062-71ca3e79d545 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:08.180457 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-4bb47ec2-0a73-4930-a062-71ca3e79d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:08.415653 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 659/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:08.488571 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7cb31-7fb0-43a7-a4b9-a7c085a0bc2b None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.489225 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7cb31-7fb0-43a7-a4b9-a7c085a0bc2b None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.489731 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7cb31-7fb0-43a7-a4b9-a7c085a0bc2b None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.491353 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 650/1309] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 9 15:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:08.497847 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762320-e535-440b-ac3a-ed9bfd1c904e None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.498183 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762320-e535-440b-ac3a-ed9bfd1c904e None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.498419 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762320-e535-440b-ac3a-ed9bfd1c904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.646790 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-fb762320-e535-440b-ac3a-ed9bfd1c904e None None] MFA Rules not processed for user `ff6dfa76a7a14d09a88235482b3e68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:08.648066 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-fb762320-e535-440b-ac3a-ed9bfd1c904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:08.810125 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 660/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 9 15:34:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:08.822192 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7cb31-7fb0-43a7-a4b9-a7c085a0bc2b None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.823895 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a0b7cb31-7fb0-43a7-a4b9-a7c085a0bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:08.986686 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7cb31-7fb0-43a7-a4b9-a7c085a0bc2b None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:09.077459 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674da077-6f22-4ecf-9747-87af0ee69a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:09.079594 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da077-6f22-4ecf-9747-87af0ee69a56 service neutron] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:09.080301 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da077-6f22-4ecf-9747-87af0ee69a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:09.080810 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da077-6f22-4ecf-9747-87af0ee69a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:09.082857 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-674da077-6f22-4ecf-9747-87af0ee69a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:09.198815 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674da077-6f22-4ecf-9747-87af0ee69a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:09.200896 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674da077-6f22-4ecf-9747-87af0ee69a56 service neutron] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:09.221523 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 651/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:11.865543 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571ac02-d24b-4086-9b8e-f1d4498fdf75 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.866548 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571ac02-d24b-4086-9b8e-f1d4498fdf75 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.867050 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571ac02-d24b-4086-9b8e-f1d4498fdf75 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.874081 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08c3d-4f04-49dc-ae31-99ee8e78c457 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.874933 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08c3d-4f04-49dc-ae31-99ee8e78c457 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.875432 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08c3d-4f04-49dc-ae31-99ee8e78c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.880500 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 661/1312] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:11 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:11.955602 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-97b08c3d-4f04-49dc-ae31-99ee8e78c457 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:11.957228 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-97b08c3d-4f04-49dc-ae31-99ee8e78c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:12.084216 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 652/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:34:12.105615 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571ac02-d24b-4086-9b8e-f1d4498fdf75 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.107441 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-6571ac02-d24b-4086-9b8e-f1d4498fdf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:12.224897 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571ac02-d24b-4086-9b8e-f1d4498fdf75 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:12.312932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec7a28-d86d-4c66-9b44-5d507697f378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:12.315635 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec7a28-d86d-4c66-9b44-5d507697f378 service neutron] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.316202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec7a28-d86d-4c66-9b44-5d507697f378 service neutron] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.316706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec7a28-d86d-4c66-9b44-5d507697f378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.318698 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-16ec7a28-d86d-4c66-9b44-5d507697f378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:12.439054 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec7a28-d86d-4c66-9b44-5d507697f378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:12.441191 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec7a28-d86d-4c66-9b44-5d507697f378 service neutron] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:12.462034 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 662/1314] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:15.112340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aedfc-c415-430b-bb4b-5f91bec73faa None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.112921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aedfc-c415-430b-bb4b-5f91bec73faa None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.112921 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aedfc-c415-430b-bb4b-5f91bec73faa None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.114304 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 653/1315] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:15.119828 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c9bc-291d-419b-8e5d-6349f00a8deb None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.120255 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c9bc-291d-419b-8e5d-6349f00a8deb None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.120390 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6c9bc-291d-419b-8e5d-6349f00a8deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.184142 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-98b6c9bc-291d-419b-8e5d-6349f00a8deb None None] MFA Rules not processed for user `c4d4881e6ced433aab8e2c1035d9d174`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:15.185343 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-98b6c9bc-291d-419b-8e5d-6349f00a8deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:15.279175 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 663/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:15.335559 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e69c5-58fe-4c77-a42a-891a23f0a566 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.335878 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e69c5-58fe-4c77-a42a-891a23f0a566 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.336159 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e69c5-58fe-4c77-a42a-891a23f0a566 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.337550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 654/1317] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 9 15:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:15.343348 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb26b-53dd-4d9f-80bb-a2c6b62c9c13 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.343640 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb26b-53dd-4d9f-80bb-a2c6b62c9c13 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.343950 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb26b-53dd-4d9f-80bb-a2c6b62c9c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.417640 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-382bb26b-53dd-4d9f-80bb-a2c6b62c9c13 None None] MFA Rules not processed for user `ff6dfa76a7a14d09a88235482b3e68d8`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:15.418832 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-382bb26b-53dd-4d9f-80bb-a2c6b62c9c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:15.494918 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 664/1318] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 9 15:34:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:15.504488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e69c5-58fe-4c77-a42a-891a23f0a566 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:15.506038 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-c18e69c5-58fe-4c77-a42a-891a23f0a566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:15.608864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e69c5-58fe-4c77-a42a-891a23f0a566 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:15.682187 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc209ee8-85c6-4e71-8d30-07b667bcdfbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:15.682843 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209ee8-85c6-4e71-8d30-07b667bcdfbc service neutron] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.683127 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209ee8-85c6-4e71-8d30-07b667bcdfbc service neutron] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.683407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209ee8-85c6-4e71-8d30-07b667bcdfbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.685090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-cc209ee8-85c6-4e71-8d30-07b667bcdfbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:15.789526 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc209ee8-85c6-4e71-8d30-07b667bcdfbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:15.790997 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc209ee8-85c6-4e71-8d30-07b667bcdfbc service neutron] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:15.808802 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 655/1319] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:19.002460 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380651c-7a36-4094-800a-5f3af7d6bc83 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.003081 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380651c-7a36-4094-800a-5f3af7d6bc83 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.003081 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380651c-7a36-4094-800a-5f3af7d6bc83 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.004462 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 665/1320] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:19.009664 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0f6e-9cae-4396-8297-50ef842f07bf None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.010081 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0f6e-9cae-4396-8297-50ef842f07bf None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.010206 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0f6e-9cae-4396-8297-50ef842f07bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.073809 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-d14a0f6e-9cae-4396-8297-50ef842f07bf None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:19.075018 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-d14a0f6e-9cae-4396-8297-50ef842f07bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:19.167237 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 656/1321] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:34:19.206402 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380651c-7a36-4094-800a-5f3af7d6bc83 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:19.207996 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-8380651c-7a36-4094-800a-5f3af7d6bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:19.311858 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380651c-7a36-4094-800a-5f3af7d6bc83 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:19.384271 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9277b5-cd8c-4ad1-8276-745ff13c7773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:19.384928 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9277b5-cd8c-4ad1-8276-745ff13c7773 service neutron] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.385210 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9277b5-cd8c-4ad1-8276-745ff13c7773 service neutron] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.385484 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9277b5-cd8c-4ad1-8276-745ff13c7773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.387152 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-ca9277b5-cd8c-4ad1-8276-745ff13c7773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:19.496458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9277b5-cd8c-4ad1-8276-745ff13c7773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:19.497906 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9277b5-cd8c-4ad1-8276-745ff13c7773 service neutron] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:19.516156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 666/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:22.507976 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2216-41b4-40ea-b0c2-021ab3bc994d None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.508517 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2216-41b4-40ea-b0c2-021ab3bc994d None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.508688 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d2216-41b4-40ea-b0c2-021ab3bc994d None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.510264 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 657/1323] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:22.515749 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746016fc-9031-41fb-80ff-bc906ffda3ed None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.516170 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746016fc-9031-41fb-80ff-bc906ffda3ed None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.516328 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746016fc-9031-41fb-80ff-bc906ffda3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.580904 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-746016fc-9031-41fb-80ff-bc906ffda3ed None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:22.582103 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-746016fc-9031-41fb-80ff-bc906ffda3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:22.681069 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 667/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:22.717812 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d2216-41b4-40ea-b0c2-021ab3bc994d None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:22.719348 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-381d2216-41b4-40ea-b0c2-021ab3bc994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:22.823873 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d2216-41b4-40ea-b0c2-021ab3bc994d None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:22.899190 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e24122-6e64-43dd-8827-817efaae87da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:22.899884 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24122-6e64-43dd-8827-817efaae87da service neutron] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.900173 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24122-6e64-43dd-8827-817efaae87da service neutron] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.900545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24122-6e64-43dd-8827-817efaae87da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.902194 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a2e24122-6e64-43dd-8827-817efaae87da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:23.013832 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e24122-6e64-43dd-8827-817efaae87da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:23.015286 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e24122-6e64-43dd-8827-817efaae87da service neutron] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:23.036721 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 658/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:25.351203 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf0800-c3f5-402a-a7c0-1f92c09443ff None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:25.351726 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf0800-c3f5-402a-a7c0-1f92c09443ff None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:25.351726 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf0800-c3f5-402a-a7c0-1f92c09443ff None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:25.353129 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 668/1326] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:25.358489 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d689f3-989e-408c-b04a-2e84b670303d None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:25.358882 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d689f3-989e-408c-b04a-2e84b670303d None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:25.359047 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d689f3-989e-408c-b04a-2e84b670303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:25.424274 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-a9d689f3-989e-408c-b04a-2e84b670303d None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:25.425488 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a9d689f3-989e-408c-b04a-2e84b670303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:25.526965 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 659/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:25.564128 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf0800-c3f5-402a-a7c0-1f92c09443ff None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:25.565994 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-9baf0800-c3f5-402a-a7c0-1f92c09443ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:25.669497 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf0800-c3f5-402a-a7c0-1f92c09443ff None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:25.746714 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df3938-e2b5-4e4f-9b35-8cccbcc23dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:25.747374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df3938-e2b5-4e4f-9b35-8cccbcc23dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:25.747656 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df3938-e2b5-4e4f-9b35-8cccbcc23dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:25.747958 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df3938-e2b5-4e4f-9b35-8cccbcc23dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:25.749665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-22df3938-e2b5-4e4f-9b35-8cccbcc23dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:25.856427 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df3938-e2b5-4e4f-9b35-8cccbcc23dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:25.857864 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df3938-e2b5-4e4f-9b35-8cccbcc23dd5 service neutron] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:25.876706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 669/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:28.178095 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2117-3ea5-46df-8475-7fa90db79cc7 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.178652 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2117-3ea5-46df-8475-7fa90db79cc7 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.178652 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d2117-3ea5-46df-8475-7fa90db79cc7 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.180084 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 660/1329] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:28.185480 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0917-715d-440e-80b1-811157f2bdcc None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.185888 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0917-715d-440e-80b1-811157f2bdcc None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.186041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0917-715d-440e-80b1-811157f2bdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.250043 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-970c0917-715d-440e-80b1-811157f2bdcc None None] MFA Rules not processed for user `c4d4881e6ced433aab8e2c1035d9d174`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:28.251978 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-970c0917-715d-440e-80b1-811157f2bdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:28.349251 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 670/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:28.386431 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d2117-3ea5-46df-8475-7fa90db79cc7 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:28.388030 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a57d2117-3ea5-46df-8475-7fa90db79cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:28.494129 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d2117-3ea5-46df-8475-7fa90db79cc7 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.566528 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa65d4-a439-460c-ac72-ff1de5328201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.567183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa65d4-a439-460c-ac72-ff1de5328201 service neutron] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.567495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa65d4-a439-460c-ac72-ff1de5328201 service neutron] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.567787 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa65d4-a439-460c-ac72-ff1de5328201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.569472 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a8aa65d4-a439-460c-ac72-ff1de5328201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:28.675137 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa65d4-a439-460c-ac72-ff1de5328201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.676612 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa65d4-a439-460c-ac72-ff1de5328201 service neutron] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.695967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 661/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:31.143538 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbd25-075a-43bf-b0c2-def2bd94b705 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.144140 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbd25-075a-43bf-b0c2-def2bd94b705 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.144140 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbd25-075a-43bf-b0c2-def2bd94b705 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.145535 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 671/1332] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:31.150888 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728212-9bb8-41fb-9b34-a6939cb1db31 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.151298 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728212-9bb8-41fb-9b34-a6939cb1db31 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.151452 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728212-9bb8-41fb-9b34-a6939cb1db31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.215253 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-38728212-9bb8-41fb-9b34-a6939cb1db31 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:31.216500 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-38728212-9bb8-41fb-9b34-a6939cb1db31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:31.310649 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 662/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:31.347460 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcbd25-075a-43bf-b0c2-def2bd94b705 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:31.349027 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-99dcbd25-075a-43bf-b0c2-def2bd94b705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:31.451776 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcbd25-075a-43bf-b0c2-def2bd94b705 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:31.524550 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4e62e-72b1-4ef5-a35c-54035c443d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:31.525200 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4e62e-72b1-4ef5-a35c-54035c443d59 service neutron] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.525485 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4e62e-72b1-4ef5-a35c-54035c443d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.525763 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4e62e-72b1-4ef5-a35c-54035c443d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.527422 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-67f4e62e-72b1-4ef5-a35c-54035c443d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:31.636288 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4e62e-72b1-4ef5-a35c-54035c443d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:31.637727 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4e62e-72b1-4ef5-a35c-54035c443d59 service neutron] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:31.656490 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 672/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:33.935980 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68019-8c88-4127-87b9-1de45f5e7e75 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.936525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68019-8c88-4127-87b9-1de45f5e7e75 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.936525 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68019-8c88-4127-87b9-1de45f5e7e75 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.938441 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 663/1335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:33.944601 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1461b-d339-4b61-abdf-7ac892b3e919 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.945414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1461b-d339-4b61-abdf-7ac892b3e919 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.945414 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1461b-d339-4b61-abdf-7ac892b3e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:34.009656 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-37c1461b-d339-4b61-abdf-7ac892b3e919 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:34.010860 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-37c1461b-d339-4b61-abdf-7ac892b3e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:34.106783 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 673/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:34:34.146244 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c68019-8c88-4127-87b9-1de45f5e7e75 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:34.147789 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-56c68019-8c88-4127-87b9-1de45f5e7e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:34.248090 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c68019-8c88-4127-87b9-1de45f5e7e75 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:34.321708 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ffb9-9f23-4730-b585-28cbf5fdaa20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:34.322361 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ffb9-9f23-4730-b585-28cbf5fdaa20 service neutron] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:34.322648 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ffb9-9f23-4730-b585-28cbf5fdaa20 service neutron] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:34.322922 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ffb9-9f23-4730-b585-28cbf5fdaa20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:34.324616 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-cd54ffb9-9f23-4730-b585-28cbf5fdaa20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:34.448347 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ffb9-9f23-4730-b585-28cbf5fdaa20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:34.449799 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ffb9-9f23-4730-b585-28cbf5fdaa20 service neutron] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:34.467842 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 664/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:37.031706 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b2844-1f3e-4f55-8f4d-c74738b7c2a6 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.032319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b2844-1f3e-4f55-8f4d-c74738b7c2a6 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.032319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b2844-1f3e-4f55-8f4d-c74738b7c2a6 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.034319 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 674/1338] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:37.040451 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1779-76aa-4d38-9b9e-590d5a6309ec None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.040936 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1779-76aa-4d38-9b9e-590d5a6309ec None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.041543 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be1779-76aa-4d38-9b9e-590d5a6309ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.106006 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-69be1779-76aa-4d38-9b9e-590d5a6309ec None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:37.107221 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-69be1779-76aa-4d38-9b9e-590d5a6309ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:37.202011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 665/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:37.237914 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b2844-1f3e-4f55-8f4d-c74738b7c2a6 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:37.239438 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-cd3b2844-1f3e-4f55-8f4d-c74738b7c2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:37.340578 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b2844-1f3e-4f55-8f4d-c74738b7c2a6 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.412906 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5b193-ea28-4972-b4e5-2602ce35bd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.413557 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5b193-ea28-4972-b4e5-2602ce35bd95 service neutron] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.413842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5b193-ea28-4972-b4e5-2602ce35bd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.414118 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5b193-ea28-4972-b4e5-2602ce35bd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.415795 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-51a5b193-ea28-4972-b4e5-2602ce35bd95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:37.525312 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5b193-ea28-4972-b4e5-2602ce35bd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.526762 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5b193-ea28-4972-b4e5-2602ce35bd95 service neutron] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.544202 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 675/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:41.779572 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c9d7-1321-4e42-be03-019d38432a59 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:41.780183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c9d7-1321-4e42-be03-019d38432a59 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:41.780183 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1c9d7-1321-4e42-be03-019d38432a59 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:41.782206 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 666/1341] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:41.787696 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189637-fe26-4224-a097-c3fb6f8487a8 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:41.788169 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189637-fe26-4224-a097-c3fb6f8487a8 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:41.788280 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1189637-fe26-4224-a097-c3fb6f8487a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:41.873093 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-a1189637-fe26-4224-a097-c3fb6f8487a8 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:41.874236 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-a1189637-fe26-4224-a097-c3fb6f8487a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:41.975208 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 676/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:42.013977 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c9d7-1321-4e42-be03-019d38432a59 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:42.016304 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-1fe1c9d7-1321-4e42-be03-019d38432a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:42.112232 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1c9d7-1321-4e42-be03-019d38432a59 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:42.115998 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e42756-38f5-4b57-a66b-c9272ca574fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:42.116660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e42756-38f5-4b57-a66b-c9272ca574fd service neutron] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:42.116946 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e42756-38f5-4b57-a66b-c9272ca574fd service neutron] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:42.117227 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e42756-38f5-4b57-a66b-c9272ca574fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:42.126666 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e42756-38f5-4b57-a66b-c9272ca574fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:42.128133 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e42756-38f5-4b57-a66b-c9272ca574fd service neutron] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:42.137620 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 667/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:44.997372 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e586d3-eab1-4845-8710-9922f9579905 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:44.997919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e586d3-eab1-4845-8710-9922f9579905 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:44.997919 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e586d3-eab1-4845-8710-9922f9579905 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:44.999215 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 677/1344] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:45.004419 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89403b3b-0b75-4edf-bf4f-cace56316afc None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:45.004864 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89403b3b-0b75-4edf-bf4f-cace56316afc None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:45.004964 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89403b3b-0b75-4edf-bf4f-cace56316afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:45.032677 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-89403b3b-0b75-4edf-bf4f-cace56316afc None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:45.033956 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-89403b3b-0b75-4edf-bf4f-cace56316afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:45.108550 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 668/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:45.146330 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e586d3-eab1-4845-8710-9922f9579905 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:45.156967 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e586d3-eab1-4845-8710-9922f9579905 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:45.160463 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce326e8-55b5-4ddd-8fc5-1b0c6bbfeb84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:45.161095 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce326e8-55b5-4ddd-8fc5-1b0c6bbfeb84 service neutron] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:45.161374 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce326e8-55b5-4ddd-8fc5-1b0c6bbfeb84 service neutron] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:45.161645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce326e8-55b5-4ddd-8fc5-1b0c6bbfeb84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:45.170350 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce326e8-55b5-4ddd-8fc5-1b0c6bbfeb84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:45.171812 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce326e8-55b5-4ddd-8fc5-1b0c6bbfeb84 service neutron] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:45.181470 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 678/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:34:49.499883 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a2b7-5322-4f43-9e0d-a76d3521d323 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:49.500432 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a2b7-5322-4f43-9e0d-a76d3521d323 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:49.500545 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a2b7-5322-4f43-9e0d-a76d3521d323 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:49.501920 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 669/1347] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:49.507076 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ed1f-9fb2-4c77-a324-1b105083cf27 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:49.507533 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ed1f-9fb2-4c77-a324-1b105083cf27 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:49.507659 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ed1f-9fb2-4c77-a324-1b105083cf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:49.526110 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-2362ed1f-9fb2-4c77-a324-1b105083cf27 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:49.527381 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-2362ed1f-9fb2-4c77-a324-1b105083cf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:49.537740 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 679/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:49.575234 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755a2b7-5322-4f43-9e0d-a76d3521d323 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:49.576958 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-b755a2b7-5322-4f43-9e0d-a76d3521d323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:49.590459 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755a2b7-5322-4f43-9e0d-a76d3521d323 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:49.594483 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac672056-2bc0-434a-b1f8-172121421ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6dfa76a7a14d09a88235482b3e68d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:49.595115 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672056-2bc0-434a-b1f8-172121421ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:49.595393 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672056-2bc0-434a-b1f8-172121421ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:49.595662 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac672056-2bc0-434a-b1f8-172121421ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:49.604637 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac672056-2bc0-434a-b1f8-172121421ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:49.606062 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac672056-2bc0-434a-b1f8-172121421ab8 service neutron] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:49.615492 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 670/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:34:55.127059 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6211f1-2605-467d-af00-c17cc2b856d7 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:55.127579 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6211f1-2605-467d-af00-c17cc2b856d7 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:55.128163 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6211f1-2605-467d-af00-c17cc2b856d7 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:55.129882 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 680/1350] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:55.136267 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd42f-905e-45be-8d85-9a778ac6bd01 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:55.136702 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd42f-905e-45be-8d85-9a778ac6bd01 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:55.136832 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd42f-905e-45be-8d85-9a778ac6bd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:55.216194 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-a60fd42f-905e-45be-8d85-9a778ac6bd01 None None] MFA Rules not processed for user `91c09dec03034c2e98bdcb5fac961008`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:55.217423 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a60fd42f-905e-45be-8d85-9a778ac6bd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:55.358222 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 671/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:34:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:34:59.926748 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bad4ea-c393-488d-bf8c-edb54485e913 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:59.927630 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bad4ea-c393-488d-bf8c-edb54485e913 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:59.927938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bad4ea-c393-488d-bf8c-edb54485e913 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:59.929349 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 681/1352] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:59.934678 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4c3d-da38-47c5-9675-617c346f6ba3 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:59.935138 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4c3d-da38-47c5-9675-617c346f6ba3 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:59.935229 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d4c3d-da38-47c5-9675-617c346f6ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:59.956085 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-a27d4c3d-da38-47c5-9675-617c346f6ba3 None None] MFA Rules not processed for user `91c09dec03034c2e98bdcb5fac961008`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:59.957703 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a27d4c3d-da38-47c5-9675-617c346f6ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:59.966607 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 672/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:34:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:01.745997 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f388bd9-d048-4761-95de-369d76aaecf9 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:01.746549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f388bd9-d048-4761-95de-369d76aaecf9 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:01.746549 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f388bd9-d048-4761-95de-369d76aaecf9 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:01.747932 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 682/1354] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:01.753409 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31c78c-9a73-483c-a188-fe4c0a05fab4 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:01.753848 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31c78c-9a73-483c-a188-fe4c0a05fab4 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:01.754119 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31c78c-9a73-483c-a188-fe4c0a05fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:01.772839 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-ef31c78c-9a73-483c-a188-fe4c0a05fab4 None None] MFA Rules not processed for user `91c09dec03034c2e98bdcb5fac961008`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:01.774078 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-ef31c78c-9a73-483c-a188-fe4c0a05fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:01.784029 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 673/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:35:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:05.683408 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc233fd-a41f-4268-a268-9beadff4e542 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:05.684363 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc233fd-a41f-4268-a268-9beadff4e542 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:05.684805 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc233fd-a41f-4268-a268-9beadff4e542 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:05.686610 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 683/1356] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:05.692340 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10752-a527-4776-9cdb-874eab3c0190 None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:05.692826 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10752-a527-4776-9cdb-874eab3c0190 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:05.693193 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10752-a527-4776-9cdb-874eab3c0190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:05.713321 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-80c10752-a527-4776-9cdb-874eab3c0190 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:05.714855 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-80c10752-a527-4776-9cdb-874eab3c0190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:05.724676 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 674/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:05.775156 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72047-beb4-450b-9e56-bc4fabe1bfcd None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:05.775458 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72047-beb4-450b-9e56-bc4fabe1bfcd None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:05.776011 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72047-beb4-450b-9e56-bc4fabe1bfcd None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:05.777388 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 684/1358] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 9 15:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:05.783366 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441ad9e-77f9-44fb-bd70-4a2fb1ae01cf None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:05.783660 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441ad9e-77f9-44fb-bd70-4a2fb1ae01cf None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:05.784011 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441ad9e-77f9-44fb-bd70-4a2fb1ae01cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:05.832957 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-a441ad9e-77f9-44fb-bd70-4a2fb1ae01cf None None] MFA Rules not processed for user `4be3545ab61f47aab2897c713fcc1c85`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:05.834167 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-a441ad9e-77f9-44fb-bd70-4a2fb1ae01cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:05.915928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 675/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 9 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:05.925990 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e72047-beb4-450b-9e56-bc4fabe1bfcd None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:05.941188 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e72047-beb4-450b-9e56-bc4fabe1bfcd None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:05.946431 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43127d-864d-40d6-a655-adde981392f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be3545ab61f47aab2897c713fcc1c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:05.947072 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43127d-864d-40d6-a655-adde981392f2 service nova] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:05.947360 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43127d-864d-40d6-a655-adde981392f2 service nova] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:05.947638 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43127d-864d-40d6-a655-adde981392f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:05.956787 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43127d-864d-40d6-a655-adde981392f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:05.958395 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43127d-864d-40d6-a655-adde981392f2 service nova] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:05.968912 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 685/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:35:08.443390 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eccab5-73ff-4ea0-9407-60a94d013de4 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:08.443967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eccab5-73ff-4ea0-9407-60a94d013de4 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:08.443967 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eccab5-73ff-4ea0-9407-60a94d013de4 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:08.445367 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 676/1361] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:08.450665 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6cbaa-2a9e-4d52-a023-bd368da5e836 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:08.451078 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6cbaa-2a9e-4d52-a023-bd368da5e836 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:08.451228 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6cbaa-2a9e-4d52-a023-bd368da5e836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:08.468842 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-0fa6cbaa-2a9e-4d52-a023-bd368da5e836 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:08.470041 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-0fa6cbaa-2a9e-4d52-a023-bd368da5e836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:08.479158 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 686/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:08.525315 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eccab5-73ff-4ea0-9407-60a94d013de4 None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:08.541471 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eccab5-73ff-4ea0-9407-60a94d013de4 None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:08.547986 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf3395-cd98-44e1-823c-dad0a8e84bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be3545ab61f47aab2897c713fcc1c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:08.548647 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3395-cd98-44e1-823c-dad0a8e84bd5 service nova] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:08.548931 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3395-cd98-44e1-823c-dad0a8e84bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:08.549209 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3395-cd98-44e1-823c-dad0a8e84bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:08.557953 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf3395-cd98-44e1-823c-dad0a8e84bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:08.559549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf3395-cd98-44e1-823c-dad0a8e84bd5 service nova] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:08.570859 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 677/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:35:11.130714 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1695b57-a6b5-49f6-8f9d-774ce5a7b4ca None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:11.131292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1695b57-a6b5-49f6-8f9d-774ce5a7b4ca None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:11.131292 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1695b57-a6b5-49f6-8f9d-774ce5a7b4ca None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:11.132683 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 687/1364] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:11.138082 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6b644-dc89-45fb-970e-9a0b9f43812c None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:11.138909 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6b644-dc89-45fb-970e-9a0b9f43812c None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:11.139397 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6b644-dc89-45fb-970e-9a0b9f43812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:11.158862 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-1fd6b644-dc89-45fb-970e-9a0b9f43812c None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:11.160073 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-1fd6b644-dc89-45fb-970e-9a0b9f43812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:11.168327 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 678/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:11.214567 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fda9d-efa7-410e-ac15-5196d2ec5aa1 None None] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:11.214862 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fda9d-efa7-410e-ac15-5196d2ec5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:11.215164 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fda9d-efa7-410e-ac15-5196d2ec5aa1 None None] PATH_INFO: `/` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:11.216772 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 688/1366] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 9 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:11.223189 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592794d-ead0-4065-80d8-67f35abab46f None None] REQUEST_METHOD: `POST` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:11.223549 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592794d-ead0-4065-80d8-67f35abab46f None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:11.223928 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592794d-ead0-4065-80d8-67f35abab46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:11.243407 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.auth.core [None req-9592794d-ead0-4065-80d8-67f35abab46f None None] MFA Rules not processed for user `4be3545ab61f47aab2897c713fcc1c85`. Rule list: `[]` (Enabled: `True`). {{(pid=206369) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:11.244642 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.fernet_utils [None req-9592794d-ead0-4065-80d8-67f35abab46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206369) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:11.255541 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 679/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 9 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:11.263233 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fda9d-efa7-410e-ac15-5196d2ec5aa1 None None] Authenticating user token {{(pid=206370) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:11.278658 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fda9d-efa7-410e-ac15-5196d2ec5aa1 None None] Validating token access rules against request {{(pid=206370) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:11.285645 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e824efa-3344-4e2d-b8d8-5388352b6f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be3545ab61f47aab2897c713fcc1c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206370) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:11.286575 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824efa-3344-4e2d-b8d8-5388352b6f1a service nova] REQUEST_METHOD: `GET` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:11.287096 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824efa-3344-4e2d-b8d8-5388352b6f1a service nova] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:11.287626 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e824efa-3344-4e2d-b8d8-5388352b6f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:11.297023 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e824efa-3344-4e2d-b8d8-5388352b6f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:11.298907 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e824efa-3344-4e2d-b8d8-5388352b6f1a service nova] RBAC: Authorization granted {{(pid=206370) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:11.309970 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 689/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:35:12.321999 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb829-6439-411b-9c99-fd130ba8d3a1 None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:12.322529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb829-6439-411b-9c99-fd130ba8d3a1 None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:12.322529 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5cb829-6439-411b-9c99-fd130ba8d3a1 None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:12.324746 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 680/1369] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:12.330368 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684c8a1-300e-4bbd-bef0-f879075b7df2 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:12.330891 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684c8a1-300e-4bbd-bef0-f879075b7df2 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:12.330976 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684c8a1-300e-4bbd-bef0-f879075b7df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:12.349943 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-2684c8a1-300e-4bbd-bef0-f879075b7df2 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:12.351179 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-2684c8a1-300e-4bbd-bef0-f879075b7df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:12.362023 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 690/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:13.650770 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c10a-7784-4bc7-9a58-b0a75a3f82fd None None] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:13.651300 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c10a-7784-4bc7-9a58-b0a75a3f82fd None None] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:13.651300 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709c10a-7784-4bc7-9a58-b0a75a3f82fd None None] PATH_INFO: `/` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:13.652715 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 681/1371] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:13.658940 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2fdfc-d432-48d7-bbb1-c160d93b0826 None None] REQUEST_METHOD: `POST` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:13.659398 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2fdfc-d432-48d7-bbb1-c160d93b0826 None None] SCRIPT_NAME: `/identity` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:13.659568 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2fdfc-d432-48d7-bbb1-c160d93b0826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=206370) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:13.677026 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.auth.core [None req-60a2fdfc-d432-48d7-bbb1-c160d93b0826 None None] MFA Rules not processed for user `bb7614d8c4184d29a9515f84d7487a48`. Rule list: `[]` (Enabled: `True`). {{(pid=206370) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:13.678205 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: DEBUG keystone.common.fernet_utils [None req-60a2fdfc-d432-48d7-bbb1-c160d93b0826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=206370) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:13.685938 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: [pid: 206370|app: 0|req: 691/1372] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:35:13.730233 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709c10a-7784-4bc7-9a58-b0a75a3f82fd None None] Authenticating user token {{(pid=206369) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:13.745709 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709c10a-7784-4bc7-9a58-b0a75a3f82fd None None] Validating token access rules against request {{(pid=206369) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:13.752075 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d3ef2-2e1d-45a1-9fc5-6db8cbf75e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be3545ab61f47aab2897c713fcc1c85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97316c4f42ae4185a3ebe8633093e218', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=206369) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:13.752722 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d3ef2-2e1d-45a1-9fc5-6db8cbf75e99 service nova] REQUEST_METHOD: `GET` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:13.753005 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d3ef2-2e1d-45a1-9fc5-6db8cbf75e99 service nova] SCRIPT_NAME: `/identity` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:13.753282 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d3ef2-2e1d-45a1-9fc5-6db8cbf75e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=206369) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:13.761576 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d3ef2-2e1d-45a1-9fc5-6db8cbf75e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:13.763157 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d3ef2-2e1d-45a1-9fc5-6db8cbf75e99 service nova] RBAC: Authorization granted {{(pid=206369) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:13.773045 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: [pid: 206369|app: 0|req: 682/1373] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:35:35.885682 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: Mon May 9 15:35:35 2022 - graceful shutdown triggered... May 09 15:35:35.885823 dv-cinder-841125-1-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 09 15:35:35.886495 dv-cinder-841125-1-iscsi devstack@keystone.service[206369]: Gracefully killing worker 1 (pid: 206369)... May 09 15:35:35.886902 dv-cinder-841125-1-iscsi devstack@keystone.service[206370]: Gracefully killing worker 2 (pid: 206370)... May 09 15:35:36.887467 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: worker 1 buried after 1 seconds May 09 15:35:36.888068 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: worker 2 buried after 1 seconds May 09 15:35:36.888068 dv-cinder-841125-1-iscsi devstack@keystone.service[206355]: goodbye to uWSGI. May 09 15:35:36.889053 dv-cinder-841125-1-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 09 15:35:36.889591 dv-cinder-841125-1-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 09 15:41:01.675485 dv-cinder-841125-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 15:41:01.691179 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 15:41:01 2022] *** May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: nodename: dv-cinder-841125-1-iscsi May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: machine: x86_64 May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: clock source: unix May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: pcre jit disabled May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: detected number of CPU cores: 4 May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: current working directory: / May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: detected binary path: /usr/bin/uwsgi-core May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: your processes number limit is 47680 May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: your memory page size is 4096 bytes May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: detected max file descriptor number: 2048 May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: lock engine: pthread robust mutexes May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: thunder lock: enabled May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 15:41:01.698437 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 15:41:01.741139 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: Python main interpreter initialized at 0x55bfcb29b9c0 May 09 15:41:01.741139 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: python threads support enabled May 09 15:41:01.741139 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: your server socket listen backlog is limited to 100 connections May 09 15:41:01.741139 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: your mercy for graceful operations on workers is 90 seconds May 09 15:41:01.741608 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: mapped 403077 bytes (393 KB) for 2 cores May 09 15:41:01.741608 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: *** Operational MODE: preforking *** May 09 15:41:01.741900 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: *** uWSGI is running in multiple interpreter mode *** May 09 15:41:01.741900 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: spawned uWSGI master process (pid: 275828) May 09 15:41:01.742114 dv-cinder-841125-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 15:41:01.742708 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: spawned uWSGI worker 1 (pid: 275842, cores: 1) May 09 15:41:01.744786 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: spawned uWSGI worker 2 (pid: 275843, cores: 1) May 09 15:41:01.745155 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 15:41:07.566042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:41:07.566042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: from cryptography.utils import int_from_bytes May 09 15:41:07.567999 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:41:07.567999 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: from cryptography.utils import int_from_bytes May 09 15:41:07.571852 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:41:07.571852 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: from cryptography.utils import int_from_bytes May 09 15:41:07.573174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:41:07.573174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: from cryptography.utils import int_from_bytes May 09 15:41:07.617914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:41:07.618102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:41:07.618285 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] command line args: [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:41:07.618559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:41:07.618739 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ================================================================================ {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:41:07.618995 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] admin_token = **** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.619243 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] config_dir = [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.619433 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.619617 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] config_source = [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.619822 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] debug = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.620025 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.620397 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.620575 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] insecure_debug = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.620829 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.621079 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.621312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] list_limit = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.621495 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] log_config_append = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.621676 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.621805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:41:07.621927 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] log_dir = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.622045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:41:07.622161 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] log_file = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.622308 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] command line args: [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:41:07.622446 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.622583 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:41:07.622726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.622862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ================================================================================ {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:41:07.622998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.623140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] admin_token = **** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.623290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.623434 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] config_dir = [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.623570 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.623707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.623870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.624010 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] config_source = [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.624145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.624281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] debug = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.624417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.624560 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.624723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.624859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.624859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] insecure_debug = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.625148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.625290 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.625423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.625568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.625706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.625842 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] list_limit = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.625989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.626126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] log_config_append = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.626267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] notification_format = cadf {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.626404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.626404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] log_dir = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.626663 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.626802 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] log_file = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.626802 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.627247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.627405 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.627550 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] publish_errors = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.627687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.627862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.628008 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.628158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.628295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.628432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.628579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.628803 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.628938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.629088 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.629219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.629363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] standard_threads = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.629506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.630291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] strict_password_check = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.630432 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.630567 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.630707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.630842 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] use_eventlog = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.630979 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.631120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] use_journal = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.631120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] use_json = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.631378 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.631520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] use_stderr = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.631655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] notification_format = cadf {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.631810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] use_syslog = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.631963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.632118 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] watch_log_file = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.632118 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.632376 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.632512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.632653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] publish_errors = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.632798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.632798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.632798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.633185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.633328 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.633470 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.633470 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.633735 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.633870 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.634005 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.634141 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.634283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.634283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.634539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] standard_threads = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.634539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] strict_password_check = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.634804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.634804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.635066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.635066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] use_eventlog = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.635338 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.635481 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] use_journal = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.635616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.635745 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] use_json = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.635745 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] use_stderr = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.636029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.636166 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] use_syslog = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.636301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.636436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] watch_log_file = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:41:07.636584 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.636726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.636870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.637015 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.637150 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.637286 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.637429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.637567 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.637702 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.637838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.637972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.638108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.638244 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.638384 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.638519 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.638654 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.638789 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.638917 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.639052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.639192 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.639340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.639476 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.639604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.639738 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.639912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.640045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.640181 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.640319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.640449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.640584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.640728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.640859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.641000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.641131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.641267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.641414 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.641557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.641688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.641824 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.641960 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.642105 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.642235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.642376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.642508 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.642644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.642780 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.642916 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.643060 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.643208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.643345 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.643483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.643619 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.643755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.644046 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.644193 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.644331 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.644467 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.644606 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.644742 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.644878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.645029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.645166 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.645302 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.645448 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.645586 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.645723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.645861 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.646007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.646144 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.646281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.646416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.646563 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.646703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.646834 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.646970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.647107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.647244 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.647374 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.647548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.647681 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.647848 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.647994 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.648131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.648267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.648410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.648541 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.648677 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.648824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.648969 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.649112 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.649250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.649380 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.649519 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.649657 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.649800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.649937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.650067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.650204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.650341 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.650484 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.650621 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.650751 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.650881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.650881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.651139 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.651276 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.651276 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.651544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.651680 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.651868 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.652092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.652232 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.652380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.652517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.652653 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.652791 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.652939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.enabled = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.653074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.653204 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.653346 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.653493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.653631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.653773 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.653910 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.654049 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.654185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.654185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.654438 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.654438 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.654770 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.654906 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.655047 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.655183 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.655320 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.655320 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.655572 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.655708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.655892 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.655892 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.656148 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.656278 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.656414 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.656544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.656756 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.656895 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.657040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.657178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.657316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.657447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.657603 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.657747 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.657884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.658021 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.658160 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.enabled = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.658290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.658443 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.658580 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.658716 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.658853 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.659001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.659132 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.659272 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.659410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.659546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.659677 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.659856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.659999 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.660140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.660277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.660420 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.660557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.660693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.660845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.660990 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.661127 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] auth.external = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.661295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.661439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] auth.mapped = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.661575 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.661711 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.661861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.661991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.662137 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.662268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] auth.password = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.662413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.662657 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] auth.token = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.662809 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.662941 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.663081 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.663224 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] catalog.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.663355 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.663485 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.663628 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.663794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.663937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.664075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.664212 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.664354 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.664503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.664647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.664767 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.664902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] credential.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.665048 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.665192 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] credential.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.665329 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.665467 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.665613 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.665756 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.665903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.666040 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.666176 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.666319 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.666449 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] auth.external = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.666579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.666715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] auth.mapped = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.666858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.666995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.667135 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.667266 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.667395 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.667525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] auth.password = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.667656 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.667834 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] auth.token = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.667834 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.668103 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.668240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] catalog.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.668380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.668523 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.668660 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.668800 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.668936 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.669083 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.669214 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.669350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.669486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] federation.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.669626 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.669767 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.669767 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] federation.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.669767 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.670135 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] credential.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.670278 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.670416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] credential.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.670546 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.670676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.670822 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.670959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.671097 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.671240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.671370 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.671507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.671652 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.671825 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.671970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.672108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.672238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.672382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.672519 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.672649 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.672791 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.672926 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.673061 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.673204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.673340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.673475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.673617 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.673759 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.673890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.674025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.674153 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.674288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.674429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.674565 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] federation.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.674691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.674825 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.674961 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.675096 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] federation.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.675234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.675369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.675505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.675634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.675786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.675786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.676056 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.676193 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.676321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.676932 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.677068 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.677198 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.677335 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.677595 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.677729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.677866 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.678004 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.678136 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.678276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.678413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.678551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.678681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.678819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.678956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.679168 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.679309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.679446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.679576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.679720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.679894 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.680033 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.680165 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.680303 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.680447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.680584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.680727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.680858 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.680994 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.681126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.681263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.681400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.681542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.681678 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.681678 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.681945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.682089 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.682233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.682233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.682489 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.682629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.682760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.682893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.password = **** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.683029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.683172 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.683320 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.683457 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.683588 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.683723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.683906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.684051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.684194 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.684331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.684463 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.684599 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.684729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.684872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.685003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.685178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.685319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.685458 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.685589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.685739 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.685871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.686006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.686144 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.686274 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.686410 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.686569 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.686710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.686856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.686986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.687115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.687256 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.687398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.687838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.687978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.688116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.688252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.688389 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.688529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.688667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.688821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.688821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.689088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.password = **** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.689224 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.689364 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.689494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.689625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.689754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.689890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.690026 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.690169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.690305 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.690443 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.690579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.690710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.690839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.690980 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.691111 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.691247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.691378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.691378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.691638 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.691809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.691952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.692742 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.692957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.693089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.693227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.693362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.693490 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.693625 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.693760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.693891 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.694039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.694175 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.694311 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.694439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.694567 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.694695 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.694842 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.694974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.695108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.695238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] policy.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.695373 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.695508 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.695653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.695874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.696019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.696161 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.696290 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.696426 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] receipt.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.696573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.696704 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.696845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.696982 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.697119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.697254 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.697392 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.697521 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.697656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.697785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.697919 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.698049 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] resource.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.698190 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.698335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.698464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.698599 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] resource.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.698735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.698865 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.699006 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.699150 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.699285 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.699415 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.699543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.699687 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] revoke.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.699890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.699890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.700152 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.700281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.700417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.700547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.700685 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] role.cache_time = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.700685 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] role.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.700937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.700937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.701188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] role.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.701188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] role.list_limit = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.701454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] policy.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.701454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.701712 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.701848 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.701983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.702119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.702262 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.702391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] receipt.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.702518 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.702649 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.702785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.702937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.703077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.703214 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.703354 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.703491 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.703619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.703753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.703915 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.704053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] resource.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.704202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.704339 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.704484 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.704621 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] resource.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.704769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.704899 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.705033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.705169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.705169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.705425 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.705555 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] revoke.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.705690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.705840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.705977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.706117 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.706327 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.706468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] role.cache_time = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.706604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.706739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] role.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.706883 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.706883 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.706883 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.707311 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] role.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.707311 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] role.list_limit = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.707585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.707881 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.708085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.708085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.708360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.708498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.708649 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.708780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.708909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.709056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.709203 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.709333 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.709460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.709590 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.709724 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.709863 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.709999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.710128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.710256 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.710384 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] token.cache_time = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.710512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.710689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] token.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.710821 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.710951 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.711087 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.711225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] token.provider = fernet {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.711355 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.711494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.711632 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.711828 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.711961 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.712091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.712222 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.712365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.712500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.712637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.712775 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.712912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.713061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.713205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] trust.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.713336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.713472 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.713602 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.713749 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.713749 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.714020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.714151 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.714288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.714288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.714542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.714684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.714822 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.714959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.715095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.715232 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.715363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.715506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.715652 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.connection = **** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.715812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.715961 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.716102 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.716239 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.716371 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.716520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.716658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] token.cache_time = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.716801 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.716942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] token.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.717089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.717227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.717376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.717507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] token.provider = fernet {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.717637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.717777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.717915 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.718051 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.718189 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.718320 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.718449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.718596 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.718727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.718856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.718983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.719112 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.719242 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.719380 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] trust.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.719523 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.719660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.719847 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.719989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.720127 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.720270 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.720401 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.720531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.720661 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.720790 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.720920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=275842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.connection = **** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.721072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.722167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.723294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.723294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.723294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.723294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:41:07.723294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=275843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:41:07.735812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.736046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.736276 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.737223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.737459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.737690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.745836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.747570 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.774900 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.775128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.775838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.776075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.829321 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.830305 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.881543 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.881776 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.883682 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.883951 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.948779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.948998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949308 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949847 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.949943 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.950063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.972912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.973147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.973992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.974218 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.974392 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.974521 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.974647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.974744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.974863 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.974967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.975159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.975297 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.975512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.975726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.986249 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:07.987294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.001276 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.001511 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.001740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.001965 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.002178 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.002298 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.002389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.002500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.002591 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=275842) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.002684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.002832 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.003052 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.003266 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.003480 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=275843) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:41:08.019910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.020184 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:41:08.020351 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.020609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.020840 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:41:08.020940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:41:08.021076 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.021186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.021341 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.021439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:41:08.021604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.021702 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.021864 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.021979 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.022144 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.022405 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.033000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.033282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.033460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.033564 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.033738 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.033840 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.034007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.034292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.042664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.043503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.046003 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.046288 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.046574 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.046833 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.046972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.047115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.047263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.047397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.047532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.047807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.047918 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.048093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.048202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.048355 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.048450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.048625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.048724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.048898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.048991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.049167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.049439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.049703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.076738 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.078109 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.078387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.078673 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.079804 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.080044 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.084275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.084558 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.084843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.086027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.086303 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.086583 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.092272 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.092560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.093918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.094202 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.097230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.097520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.097803 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.098083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.098957 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.099258 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.099594 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.099894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.099994 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.100183 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.100464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.100747 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.101021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.101293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.101562 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.101829 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.119605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.119916 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.121522 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.121800 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.124484 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.126330 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.128174 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.128445 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.130656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.130952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.133753 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.135967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.137380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.139543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.141155 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.141455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.141743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.142030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.142312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.142594 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.143302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.143603 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.143918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.144208 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.144486 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.144770 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.162866 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.163245 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.163521 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.163810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.165877 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.166254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.166525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.166789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.171793 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.173971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.173971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.175083 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.177278 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.177424 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.177565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.177704 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.177857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.178141 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.178421 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.180827 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.181114 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.181407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.181686 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.181957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.192389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.192675 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.192960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.193255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.193538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.193821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.194097 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.196460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.196739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.197031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.197329 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.197609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.197885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.198161 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.213078 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.216425 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.217305 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.219792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.220619 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.221431 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.223085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.224199 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.224675 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.225037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.226660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.228321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.228603 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.228897 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.232201 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.233833 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.236394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.237126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.237414 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.237695 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.237971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.238088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.241723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.242014 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.242310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.242585 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.247424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.247731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.248041 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.251984 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.252288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.252574 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.256549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=275842) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.256848 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.257136 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.257416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.257690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.257980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.258254 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.258536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.258808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.259093 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.259366 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.259647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.259940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.260205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=275842) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.261236 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=275843) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:41:08.261524 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.261810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.262090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.262364 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.262675 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.262925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.263215 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.263487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.263757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.264051 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.264323 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.264597 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.264864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=275843) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:41:08.300528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bfcb29b9c0 pid: 275842 (default app) May 09 15:41:08.304350 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb84125-7d2e-49fd-bfd2-fdd725023fc3 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:08.304662 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb84125-7d2e-49fd-bfd2-fdd725023fc3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:08.304953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb84125-7d2e-49fd-bfd2-fdd725023fc3 None None] PATH_INFO: `/v3` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:08.306377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55bfcb29b9c0 pid: 275843 (default app) May 09 15:41:08.309222 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Mon May 9 15:41:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:16.480983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6c7d3-88ee-4668-b90b-9ee26f1c92c9 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:16.481594 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6c7d3-88ee-4668-b90b-9ee26f1c92c9 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:16.481594 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6c7d3-88ee-4668-b90b-9ee26f1c92c9 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:16.485917 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:16.491547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:16.491986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:16.492133 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:16.523158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG oslo_db.sqlalchemy.engines [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=275842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:41:16.712236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG passlib.handlers.bcrypt [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=275842) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:41:16.712660 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG passlib.handlers.bcrypt [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=275842) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:41:16.772745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:16.774300 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:16.899720 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 09 15:41:16.923568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6c7d3-88ee-4668-b90b-9ee26f1c92c9 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:16.957502 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG oslo_db.sqlalchemy.engines [None req-c2f6c7d3-88ee-4668-b90b-9ee26f1c92c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=275843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:41:17.084474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6c7d3-88ee-4668-b90b-9ee26f1c92c9 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:17.088695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0fe73-e68a-4ae4-b69d-aecf1c3bec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc880447f6bd497e832e82cd644c7320', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:17.089368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fe73-e68a-4ae4-b69d-aecf1c3bec9f admin admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:17.089655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fe73-e68a-4ae4-b69d-aecf1c3bec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:17.089936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fe73-e68a-4ae4-b69d-aecf1c3bec9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:17.097958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0fe73-e68a-4ae4-b69d-aecf1c3bec9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:17.149986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6df0fe73-e68a-4ae4-b69d-aecf1c3bec9f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:41:17.150320 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0fe73-e68a-4ae4-b69d-aecf1c3bec9f admin admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:17.159728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 9 15:41:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 15:41:17.166058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:17.181127 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b242d-2204-482b-a46a-5240ab7d7b79 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:17.185659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f8f3e-13d6-4331-961c-90fe48ba2732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc880447f6bd497e832e82cd644c7320', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:17.186812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f8f3e-13d6-4331-961c-90fe48ba2732 admin admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:17.187106 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f8f3e-13d6-4331-961c-90fe48ba2732 admin admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:17.187649 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f8f3e-13d6-4331-961c-90fe48ba2732 admin admin] PATH_INFO: `/v3/projects/cc880447f6bd497e832e82cd644c7320` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:17.189319 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f8f3e-13d6-4331-961c-90fe48ba2732 admin admin] RBAC: Authorizing `identity:get_project(project_id=cc880447f6bd497e832e82cd644c7320)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:17.240628 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd4f8f3e-13d6-4331-961c-90fe48ba2732 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:41:17.240970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f8f3e-13d6-4331-961c-90fe48ba2732 admin admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:17.245581 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Mon May 9 15:41:17 2022] GET /identity/v3/projects/cc880447f6bd497e832e82cd644c7320 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:19.447999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eefdc4-90bf-4b45-a477-a1397eb87616 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:19.448546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eefdc4-90bf-4b45-a477-a1397eb87616 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:19.448665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eefdc4-90bf-4b45-a477-a1397eb87616 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:19.452713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:19.458623 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7555d-4f3e-4f2e-b6c1-97a0149dae5a None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:19.459054 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7555d-4f3e-4f2e-b6c1-97a0149dae5a None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:19.459275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7555d-4f3e-4f2e-b6c1-97a0149dae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:19.480303 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-b3d7555d-4f3e-4f2e-b6c1-97a0149dae5a None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:19.481841 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-b3d7555d-4f3e-4f2e-b6c1-97a0149dae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:19.490012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:41:19.511577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eefdc4-90bf-4b45-a477-a1397eb87616 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:19.524547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eefdc4-90bf-4b45-a477-a1397eb87616 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:19.528794 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a9b9f-f65d-4ed5-ab24-a8afac3bc027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc880447f6bd497e832e82cd644c7320', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:19.529461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9b9f-f65d-4ed5-ab24-a8afac3bc027 admin admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:19.529752 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9b9f-f65d-4ed5-ab24-a8afac3bc027 admin admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:19.530036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a9b9f-f65d-4ed5-ab24-a8afac3bc027 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:19.538618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a9b9f-f65d-4ed5-ab24-a8afac3bc027 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:19.540431 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a9b9f-f65d-4ed5-ab24-a8afac3bc027 admin admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:19.549381 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Mon May 9 15:41:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:41:19.555432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7555d-4f3e-4f2e-b6c1-97a0149dae5a None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:19.564876 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7555d-4f3e-4f2e-b6c1-97a0149dae5a None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:19.569907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1845e-8065-4e57-88ec-800482d1ba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc880447f6bd497e832e82cd644c7320', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:19.570775 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1845e-8065-4e57-88ec-800482d1ba6c admin admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:19.571059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1845e-8065-4e57-88ec-800482d1ba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:19.571334 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1845e-8065-4e57-88ec-800482d1ba6c admin admin] PATH_INFO: `/v3/users/57514b8d78af4c4d8d5b1768815c9e7b` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:19.572779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1845e-8065-4e57-88ec-800482d1ba6c admin admin] RBAC: Authorizing `identity:get_user(user_id=57514b8d78af4c4d8d5b1768815c9e7b)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:19.574616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1845e-8065-4e57-88ec-800482d1ba6c admin admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:19.576241 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Mon May 9 15:41:19 2022] GET /identity/v3/users/57514b8d78af4c4d8d5b1768815c9e7b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:21.918985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c628c9-b60f-4f95-be99-bb74c852ca1c None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:21.919816 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c628c9-b60f-4f95-be99-bb74c852ca1c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:21.919816 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c628c9-b60f-4f95-be99-bb74c852ca1c None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:21.921014 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:21.921854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1746bc-6f98-4711-b9f2-26d1b8e7a00c None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:21.922263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1746bc-6f98-4711-b9f2-26d1b8e7a00c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:21.922416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1746bc-6f98-4711-b9f2-26d1b8e7a00c None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:21.923925 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:21.926010 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:21.926309 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:21.926595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:21.928972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb747be-4fb4-483f-a3ae-1c3bc66d13e3 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:21.929264 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb747be-4fb4-483f-a3ae-1c3bc66d13e3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:21.929544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb747be-4fb4-483f-a3ae-1c3bc66d13e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:21.968950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG passlib.handlers.bcrypt [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=275843) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:41:21.969388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG passlib.handlers.bcrypt [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=275843) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:41:22.017082 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:22.018742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:22.055861 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-7eb747be-4fb4-483f-a3ae-1c3bc66d13e3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:22.057060 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-7eb747be-4fb4-483f-a3ae-1c3bc66d13e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:22.133555 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:22.133816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:22.155970 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:22.156646 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb747be-4fb4-483f-a3ae-1c3bc66d13e3 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:22.253414 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb747be-4fb4-483f-a3ae-1c3bc66d13e3 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:22.256528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7444866-748e-4e16-9732-32be0c24b71d None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:22.286329 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad8ea7-6cd3-41ae-a06f-6d5417201e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:22.287128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8ea7-6cd3-41ae-a06f-6d5417201e9d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:22.287415 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8ea7-6cd3-41ae-a06f-6d5417201e9d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:22.287693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8ea7-6cd3-41ae-a06f-6d5417201e9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:22.290265 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73fb6-94ab-4799-b40b-50e30e1f7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:22.291195 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73fb6-94ab-4799-b40b-50e30e1f7377 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:22.291487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73fb6-94ab-4799-b40b-50e30e1f7377 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:22.291796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73fb6-94ab-4799-b40b-50e30e1f7377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:22.298696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad8ea7-6cd3-41ae-a06f-6d5417201e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-e3ad8ea7-6cd3-41ae-a06f-6d5417201e9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:22.309874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:22.311129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:22.312238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 8/14] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:41:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:41:22.319906 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad8ea7-6cd3-41ae-a06f-6d5417201e9d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:22.360148 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73fb6-94ab-4799-b40b-50e30e1f7377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:22.361679 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73fb6-94ab-4799-b40b-50e30e1f7377 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:22.414404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad8ea7-6cd3-41ae-a06f-6d5417201e9d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:22.447537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:22.448231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:22.448518 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:22.448795 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:22.449549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:22.449851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:22.451247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:22.462609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 7/15] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:22.462772 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 9/16] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:22.468053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73fb6-94ab-4799-b40b-50e30e1f7377 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:22.468208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:22.575354 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544d7e-5100-4f8c-9b96-65596335541a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:22.610967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bac54d-213c-415b-8f3b-f6716b6d56cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:22.611791 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bac54d-213c-415b-8f3b-f6716b6d56cc None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:22.612090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bac54d-213c-415b-8f3b-f6716b6d56cc None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:22.612375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bac54d-213c-415b-8f3b-f6716b6d56cc None admin] PATH_INFO: `/v3/users/57514b8d78af4c4d8d5b1768815c9e7b` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:22.613614 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bac54d-213c-415b-8f3b-f6716b6d56cc None admin] RBAC: Authorizing `identity:get_user(user_id=57514b8d78af4c4d8d5b1768815c9e7b)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:22.615825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bac54d-213c-415b-8f3b-f6716b6d56cc None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:22.617512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 10/17] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:22 2022] GET /identity/v3/users/57514b8d78af4c4d8d5b1768815c9e7b => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:22.622910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bac54d-213c-415b-8f3b-f6716b6d56cc None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:22.674767 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73fb6-94ab-4799-b40b-50e30e1f7377 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:22.708007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:22.708817 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:22.709091 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:22.709365 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:22.718800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bac54d-213c-415b-8f3b-f6716b6d56cc None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:22.727440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:22.728956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:41:22.749267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:22.750324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:22.751316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:41:22.751316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:41:22.751316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:41:22.751316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:22.751316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 8/18] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:22.752263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c88b9a-be7c-4ad4-8119-694f796a31a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:22.753058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88b9a-be7c-4ad4-8119-694f796a31a7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:22.753343 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88b9a-be7c-4ad4-8119-694f796a31a7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:22.753619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88b9a-be7c-4ad4-8119-694f796a31a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:22.755539 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c88b9a-be7c-4ad4-8119-694f796a31a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:22.757034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:22.757370 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c88b9a-be7c-4ad4-8119-694f796a31a7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:22.758992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 11/19] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:22.764437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c88b9a-be7c-4ad4-8119-694f796a31a7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:22.853623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691235-1be9-4f47-bf19-b38a556b5c52 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:22.860369 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c88b9a-be7c-4ad4-8119-694f796a31a7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:22.886648 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8225b04-d46e-47ac-8bdf-2a4f327b3e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:22.887321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8225b04-d46e-47ac-8bdf-2a4f327b3e79 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:22.887610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8225b04-d46e-47ac-8bdf-2a4f327b3e79 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:22.887926 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8225b04-d46e-47ac-8bdf-2a4f327b3e79 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:22.888665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8225b04-d46e-47ac-8bdf-2a4f327b3e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:22.888978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8225b04-d46e-47ac-8bdf-2a4f327b3e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:22.890367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8225b04-d46e-47ac-8bdf-2a4f327b3e79 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:22.893243 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb874668-048e-479e-be53-3cf23281aacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:22.893897 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb874668-048e-479e-be53-3cf23281aacd None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:22.894188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb874668-048e-479e-be53-3cf23281aacd None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:22.894466 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb874668-048e-479e-be53-3cf23281aacd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:22.895298 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb874668-048e-479e-be53-3cf23281aacd None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.domain.id=default, user.id=57514b8d78af4c4d8d5b1768815c9e7b) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:22.896201 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb874668-048e-479e-be53-3cf23281aacd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:22.897781 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb874668-048e-479e-be53-3cf23281aacd None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:22.904472 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 12/20] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 9 15:41:22 2022] GET /identity/v3/role_assignments?user.id=57514b8d78af4c4d8d5b1768815c9e7b&scope.domain.id=default&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:22.908343 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 9/21] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:25.438839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a60854-778d-49f9-8d4a-f01d242098be None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:25.439426 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a60854-778d-49f9-8d4a-f01d242098be None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:25.439520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a60854-778d-49f9-8d4a-f01d242098be None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:25.441083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 13/22] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:25.447292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90681b-7acd-4205-b735-89ad64c53580 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:25.448233 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90681b-7acd-4205-b735-89ad64c53580 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:25.448743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90681b-7acd-4205-b735-89ad64c53580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:25.479613 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-0a90681b-7acd-4205-b735-89ad64c53580 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:25.481346 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-0a90681b-7acd-4205-b735-89ad64c53580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:25.555447 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 10/23] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:25.592294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a60854-778d-49f9-8d4a-f01d242098be None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:25.712564 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a60854-778d-49f9-8d4a-f01d242098be None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:25.749531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed96bd9-258d-4916-8a7d-1f108b917b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:25.750674 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed96bd9-258d-4916-8a7d-1f108b917b06 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:25.751140 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed96bd9-258d-4916-8a7d-1f108b917b06 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:25.751595 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed96bd9-258d-4916-8a7d-1f108b917b06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:25.764828 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed96bd9-258d-4916-8a7d-1f108b917b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-8ed96bd9-258d-4916-8a7d-1f108b917b06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:25.773297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:25.774664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:25.775954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:25.778211 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 14/24] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:25.784247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90681b-7acd-4205-b735-89ad64c53580 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:25.953921 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90681b-7acd-4205-b735-89ad64c53580 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:26.000048 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b841f-ad7e-4b59-aab1-3d73bf71d2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:26.000652 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b841f-ad7e-4b59-aab1-3d73bf71d2bb None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.000942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b841f-ad7e-4b59-aab1-3d73bf71d2bb None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.001227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b841f-ad7e-4b59-aab1-3d73bf71d2bb None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.002002 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b841f-ad7e-4b59-aab1-3d73bf71d2bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:26.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b841f-ad7e-4b59-aab1-3d73bf71d2bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:26.003705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b841f-ad7e-4b59-aab1-3d73bf71d2bb None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:26.020998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 11/25] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:26.028840 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed96bd9-258d-4916-8a7d-1f108b917b06 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:26.129459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0778aa-15f6-4679-9ac1-cb023f02f036 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.130660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0778aa-15f6-4679-9ac1-cb023f02f036 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.131189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0778aa-15f6-4679-9ac1-cb023f02f036 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.135235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 12/26] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:41:26.140646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea29b8-3e08-4603-9c66-8c2ea44cb68b None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.141230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea29b8-3e08-4603-9c66-8c2ea44cb68b None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.141753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea29b8-3e08-4603-9c66-8c2ea44cb68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.162697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed96bd9-258d-4916-8a7d-1f108b917b06 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:26.178052 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-7fea29b8-3e08-4603-9c66-8c2ea44cb68b None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:26.179407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-7fea29b8-3e08-4603-9c66-8c2ea44cb68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:26.201824 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc04ec-88b7-41fa-a883-64b5128469ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:26.203119 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc04ec-88b7-41fa-a883-64b5128469ba None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.203688 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc04ec-88b7-41fa-a883-64b5128469ba None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.204216 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc04ec-88b7-41fa-a883-64b5128469ba None admin] PATH_INFO: `/v3/users/57514b8d78af4c4d8d5b1768815c9e7b` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.205682 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc04ec-88b7-41fa-a883-64b5128469ba None admin] RBAC: Authorizing `identity:get_user(user_id=57514b8d78af4c4d8d5b1768815c9e7b)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:26.207386 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc04ec-88b7-41fa-a883-64b5128469ba None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:26.210210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 15/27] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:26 2022] GET /identity/v3/users/57514b8d78af4c4d8d5b1768815c9e7b => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:26.216760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc04ec-88b7-41fa-a883-64b5128469ba None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:26.304179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 13/28] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:26.304993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d696d-e01f-40ed-a857-7b01fa4dd540 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.305290 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d696d-e01f-40ed-a857-7b01fa4dd540 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.305571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d696d-e01f-40ed-a857-7b01fa4dd540 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.310584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 14/29] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:26.318106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b86b-7383-4249-a242-0c458514f682 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.318387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b86b-7383-4249-a242-0c458514f682 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.318850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b86b-7383-4249-a242-0c458514f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.360741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-b614b86b-7383-4249-a242-0c458514f682 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:26.363590 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-b614b86b-7383-4249-a242-0c458514f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:26.416210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc04ec-88b7-41fa-a883-64b5128469ba None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:26.480093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 15/30] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:26.481631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614b86b-7383-4249-a242-0c458514f682 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:26.487783 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c784c33-88e7-44a3-a58f-944f304d5605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:26.488240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784c33-88e7-44a3-a58f-944f304d5605 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.488341 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784c33-88e7-44a3-a58f-944f304d5605 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.488604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784c33-88e7-44a3-a58f-944f304d5605 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.490763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c784c33-88e7-44a3-a58f-944f304d5605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:26.492294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c784c33-88e7-44a3-a58f-944f304d5605 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:26.493986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 16/31] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:26.503820 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c784c33-88e7-44a3-a58f-944f304d5605 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:26.624181 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614b86b-7383-4249-a242-0c458514f682 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:26.637689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c784c33-88e7-44a3-a58f-944f304d5605 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:26.658625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f10879-1647-4299-875b-5e21b1805d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:26.659589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10879-1647-4299-875b-5e21b1805d07 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.660068 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10879-1647-4299-875b-5e21b1805d07 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.660602 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f10879-1647-4299-875b-5e21b1805d07 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.662100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f10879-1647-4299-875b-5e21b1805d07 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:26.663849 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f10879-1647-4299-875b-5e21b1805d07 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:26.678149 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002bbe0-9e2e-41c2-9801-6fce748a29ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:26.679412 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002bbe0-9e2e-41c2-9801-6fce748a29ec None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.680413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002bbe0-9e2e-41c2-9801-6fce748a29ec None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.680991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002bbe0-9e2e-41c2-9801-6fce748a29ec None admin] PATH_INFO: `/v3/domains/default/users/57514b8d78af4c4d8d5b1768815c9e7b/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.683577 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002bbe0-9e2e-41c2-9801-6fce748a29ec None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=57514b8d78af4c4d8d5b1768815c9e7b, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:26.685386 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002bbe0-9e2e-41c2-9801-6fce748a29ec None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:26.791856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 16/32] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:41:26 2022] POST /identity/v3/roles => generated 225 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:26.792957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f10879-1647-4299-875b-5e21b1805d07 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:26.820402 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 17/33] 10.222.0.32 () {58 vars in 1361 bytes} [Mon May 9 15:41:26 2022] PUT /identity/v3/domains/default/users/57514b8d78af4c4d8d5b1768815c9e7b/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:41:26.822934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af54ea-3058-4bc4-863a-8b6e3e4c1117 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.823559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af54ea-3058-4bc4-863a-8b6e3e4c1117 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.824117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af54ea-3058-4bc4-863a-8b6e3e4c1117 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.833850 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 18/34] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:26.836928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e7ec1-fbc9-4dcd-944b-9556085cf038 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:26.837482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e7ec1-fbc9-4dcd-944b-9556085cf038 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:26.838015 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e7ec1-fbc9-4dcd-944b-9556085cf038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:26.858332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-369e7ec1-fbc9-4dcd-944b-9556085cf038 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:26.860597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-369e7ec1-fbc9-4dcd-944b-9556085cf038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:26.946209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 19/35] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:26.951802 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f10879-1647-4299-875b-5e21b1805d07 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:26.969635 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e7ec1-fbc9-4dcd-944b-9556085cf038 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:27.010519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:27.011664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.012159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.012633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.024429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:27.026340 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:41:27.046116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:27.047370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:27.048377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:41:27.048377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:41:27.048377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:41:27.048377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:27.052999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 17/36] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:27.059315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:27.096301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e7ec1-fbc9-4dcd-944b-9556085cf038 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:27.137030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377aa73-b13a-4cf8-9138-b906c2315d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:27.138151 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377aa73-b13a-4cf8-9138-b906c2315d0d None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.138618 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377aa73-b13a-4cf8-9138-b906c2315d0d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.139131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377aa73-b13a-4cf8-9138-b906c2315d0d None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.140118 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377aa73-b13a-4cf8-9138-b906c2315d0d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:27.141962 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377aa73-b13a-4cf8-9138-b906c2315d0d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:27.164332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 20/37] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:41:26 2022] POST /identity/v3/roles => generated 219 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:41:27.171930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74986a10-e59b-44f5-b918-94cad33d698b None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.172235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74986a10-e59b-44f5-b918-94cad33d698b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.172640 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74986a10-e59b-44f5-b918-94cad33d698b None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.179067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 21/38] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:27.184626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506d9eb-44bd-4aaa-bfa0-a42681a0dcd4 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.184968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506d9eb-44bd-4aaa-bfa0-a42681a0dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.185345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506d9eb-44bd-4aaa-bfa0-a42681a0dcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.190162 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4191f-e903-4026-a024-ec15336daad9 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:27.220447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-d506d9eb-44bd-4aaa-bfa0-a42681a0dcd4 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:27.221665 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-d506d9eb-44bd-4aaa-bfa0-a42681a0dcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:27.250411 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5509e-9ae1-4551-b40d-af07c1a5e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:27.251122 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5509e-9ae1-4551-b40d-af07c1a5e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.251466 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5509e-9ae1-4551-b40d-af07c1a5e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.251806 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5509e-9ae1-4551-b40d-af07c1a5e2f8 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.252763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5509e-9ae1-4551-b40d-af07c1a5e2f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:27.253082 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5509e-9ae1-4551-b40d-af07c1a5e2f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:27.255372 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5509e-9ae1-4551-b40d-af07c1a5e2f8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:27.271811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 18/39] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:27.273448 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70145d8-db7c-4746-8ef7-4af765c9f234 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.273757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70145d8-db7c-4746-8ef7-4af765c9f234 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.274048 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70145d8-db7c-4746-8ef7-4af765c9f234 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.275649 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 19/40] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:27.280902 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70145d8-db7c-4746-8ef7-4af765c9f234 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:27.335648 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 22/41] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:27.337381 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0055-7e1d-435a-a94e-10122ef962aa None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.337849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0055-7e1d-435a-a94e-10122ef962aa None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.338293 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede0055-7e1d-435a-a94e-10122ef962aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.357524 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-0ede0055-7e1d-435a-a94e-10122ef962aa None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:27.359088 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-0ede0055-7e1d-435a-a94e-10122ef962aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:27.396205 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70145d8-db7c-4746-8ef7-4af765c9f234 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:27.434623 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 23/42] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:27.434860 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89531-9f27-4d0f-aaec-1e85c226ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:27.435523 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89531-9f27-4d0f-aaec-1e85c226ca63 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.435896 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89531-9f27-4d0f-aaec-1e85c226ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.436189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89531-9f27-4d0f-aaec-1e85c226ca63 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.436438 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede0055-7e1d-435a-a94e-10122ef962aa None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:27.438055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b89531-9f27-4d0f-aaec-1e85c226ca63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:27.439057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b89531-9f27-4d0f-aaec-1e85c226ca63 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:27.479199 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 20/43] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:41:27 2022] POST /identity/v3/projects => generated 301 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:27.480010 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89531-9f27-4d0f-aaec-1e85c226ca63 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:27.563279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede0055-7e1d-435a-a94e-10122ef962aa None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:27.591843 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89531-9f27-4d0f-aaec-1e85c226ca63 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:27.606839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dff98-d246-4fc3-b7be-22c83f7dd50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:27.608143 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dff98-d246-4fc3-b7be-22c83f7dd50e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.608709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dff98-d246-4fc3-b7be-22c83f7dd50e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.609333 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dff98-d246-4fc3-b7be-22c83f7dd50e None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.610906 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dff98-d246-4fc3-b7be-22c83f7dd50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:27.612686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dff98-d246-4fc3-b7be-22c83f7dd50e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:27.615584 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 24/44] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:27.621741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dff98-d246-4fc3-b7be-22c83f7dd50e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:27.632045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcbbcf-d2f6-46d0-8b55-67d07bb9f4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:27.633198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcbbcf-d2f6-46d0-8b55-67d07bb9f4ba None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.633198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcbbcf-d2f6-46d0-8b55-67d07bb9f4ba None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.633432 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcbbcf-d2f6-46d0-8b55-67d07bb9f4ba None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.634090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcbbcf-d2f6-46d0-8b55-67d07bb9f4ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:27.635543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcbbcf-d2f6-46d0-8b55-67d07bb9f4ba None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:27.651546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 21/45] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:41:27 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:27.757971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dff98-d246-4fc3-b7be-22c83f7dd50e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:27.796468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ee5ef-249c-4021-8662-c3c2d70b79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:27.797219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee5ef-249c-4021-8662-c3c2d70b79c4 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:27.797520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee5ef-249c-4021-8662-c3c2d70b79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:27.797808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee5ef-249c-4021-8662-c3c2d70b79c4 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:27.798552 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ee5ef-249c-4021-8662-c3c2d70b79c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:27.800078 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ee5ef-249c-4021-8662-c3c2d70b79c4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:27.832072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 25/46] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:41:27 2022] POST /identity/v3/projects => generated 312 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:29.410821 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605a892-3f22-4bc5-8a5e-cc9f12d7ab66 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:29.412036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605a892-3f22-4bc5-8a5e-cc9f12d7ab66 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:29.412036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605a892-3f22-4bc5-8a5e-cc9f12d7ab66 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:29.413337 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 22/47] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:29.418737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ed01d-34f5-4194-b42a-7f9e7cc98fef None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:29.419149 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ed01d-34f5-4194-b42a-7f9e7cc98fef None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:29.419343 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ed01d-34f5-4194-b42a-7f9e7cc98fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:29.436093 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-571ed01d-34f5-4194-b42a-7f9e7cc98fef None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:29.437547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-571ed01d-34f5-4194-b42a-7f9e7cc98fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:29.503853 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 26/48] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:29.527404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605a892-3f22-4bc5-8a5e-cc9f12d7ab66 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:29.629365 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605a892-3f22-4bc5-8a5e-cc9f12d7ab66 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:29.662866 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d598e-bece-4492-b361-e0da6b8e7753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:29.663670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d598e-bece-4492-b361-e0da6b8e7753 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:29.663982 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d598e-bece-4492-b361-e0da6b8e7753 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:29.664261 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d598e-bece-4492-b361-e0da6b8e7753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:29.675493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d598e-bece-4492-b361-e0da6b8e7753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-c43d598e-bece-4492-b361-e0da6b8e7753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:29.684493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:29.685708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:29.686719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 23/49] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:29.692841 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ed01d-34f5-4194-b42a-7f9e7cc98fef None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:29.788602 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ed01d-34f5-4194-b42a-7f9e7cc98fef None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:29.821731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:29.822411 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:29.822703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:29.822990 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:29.823749 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:29.824096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:29.825511 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:29.834129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 27/50] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:29.839636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d598e-bece-4492-b361-e0da6b8e7753 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:29.943645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d598e-bece-4492-b361-e0da6b8e7753 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:29.978468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829dad1-1dae-4bbb-b927-9ef2b4e87fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:29.979358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829dad1-1dae-4bbb-b927-9ef2b4e87fea None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:29.979652 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829dad1-1dae-4bbb-b927-9ef2b4e87fea None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:29.979977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829dad1-1dae-4bbb-b927-9ef2b4e87fea None admin] PATH_INFO: `/v3/users/57514b8d78af4c4d8d5b1768815c9e7b` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:29.981429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829dad1-1dae-4bbb-b927-9ef2b4e87fea None admin] RBAC: Authorizing `identity:get_user(user_id=57514b8d78af4c4d8d5b1768815c9e7b)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:29.982908 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829dad1-1dae-4bbb-b927-9ef2b4e87fea None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:29.984599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 24/51] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:29 2022] GET /identity/v3/users/57514b8d78af4c4d8d5b1768815c9e7b => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:29.990264 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:30.088443 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f718-7d1d-4a60-93c2-be5345b53fc2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:30.089441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f444-6a0e-4bdf-8b4f-eae1ca93cebc None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:30.089748 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f444-6a0e-4bdf-8b4f-eae1ca93cebc None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:30.090040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499f444-6a0e-4bdf-8b4f-eae1ca93cebc None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:30.091433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 25/52] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:41:30.096526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897d17-94ad-4338-bfbb-0d18df981903 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:30.096826 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897d17-94ad-4338-bfbb-0d18df981903 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:30.097128 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897d17-94ad-4338-bfbb-0d18df981903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:30.114387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-75897d17-94ad-4338-bfbb-0d18df981903 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:30.116166 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-75897d17-94ad-4338-bfbb-0d18df981903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:30.121903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc7ca-c85a-471a-b9c9-82ff62254867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:30.122708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc7ca-c85a-471a-b9c9-82ff62254867 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:30.123001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc7ca-c85a-471a-b9c9-82ff62254867 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:30.123294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc7ca-c85a-471a-b9c9-82ff62254867 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:30.124491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bc7ca-c85a-471a-b9c9-82ff62254867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:30.125949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bc7ca-c85a-471a-b9c9-82ff62254867 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:30.127693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 28/53] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:30.133812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc7ca-c85a-471a-b9c9-82ff62254867 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:30.184037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 26/54] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:30.208586 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897d17-94ad-4338-bfbb-0d18df981903 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:30.230175 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc7ca-c85a-471a-b9c9-82ff62254867 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:30.264266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:30.265000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:30.265934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:30.266447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:30.267307 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.domain.id=default, user.id=57514b8d78af4c4d8d5b1768815c9e7b) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:30.267631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:30.269149 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:30.275235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 29/55] 10.222.0.32 () {56 vars in 1322 bytes} [Mon May 9 15:41:30 2022] GET /identity/v3/role_assignments?user.id=57514b8d78af4c4d8d5b1768815c9e7b&scope.domain.id=default&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:30.321695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897d17-94ad-4338-bfbb-0d18df981903 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:30.357545 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4b24-da47-4d01-bd75-766374d639ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:30.358372 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4b24-da47-4d01-bd75-766374d639ec None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:30.358664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4b24-da47-4d01-bd75-766374d639ec None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:30.358948 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4b24-da47-4d01-bd75-766374d639ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:30.360231 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4b24-da47-4d01-bd75-766374d639ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:30.361732 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4b24-da47-4d01-bd75-766374d639ec None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:30.363592 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 27/56] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:30.369932 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:30.473967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77adf73-0133-444f-8d51-3d84584adcd5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:30.507138 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f16a6-e465-458f-a691-aa4f11b3c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:30.507836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f16a6-e465-458f-a691-aa4f11b3c43c None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:30.508128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f16a6-e465-458f-a691-aa4f11b3c43c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:30.508410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f16a6-e465-458f-a691-aa4f11b3c43c None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:30.509120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f16a6-e465-458f-a691-aa4f11b3c43c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:30.510569 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f16a6-e465-458f-a691-aa4f11b3c43c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:30.536202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 30/57] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 9 15:41:30 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:32.791785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71dfd-01ac-44b1-be14-d2f5fc541e1f None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:32.792333 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71dfd-01ac-44b1-be14-d2f5fc541e1f None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:32.792333 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd71dfd-01ac-44b1-be14-d2f5fc541e1f None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:32.793733 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 28/58] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:32.799051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646aa37-9211-46e2-95bc-0390b45df6ea None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:32.799489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646aa37-9211-46e2-95bc-0390b45df6ea None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:32.799605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646aa37-9211-46e2-95bc-0390b45df6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:32.816185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-c646aa37-9211-46e2-95bc-0390b45df6ea None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:32.818178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-c646aa37-9211-46e2-95bc-0390b45df6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:32.881755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 31/59] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:32.907107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71dfd-01ac-44b1-be14-d2f5fc541e1f None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:33.005154 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd71dfd-01ac-44b1-be14-d2f5fc541e1f None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:33.036078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab008d4-43ac-4e94-8640-cdf095a4c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:33.036851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab008d4-43ac-4e94-8640-cdf095a4c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:33.037136 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab008d4-43ac-4e94-8640-cdf095a4c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:33.037415 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab008d4-43ac-4e94-8640-cdf095a4c2b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:33.038583 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab008d4-43ac-4e94-8640-cdf095a4c2b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:33.040063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab008d4-43ac-4e94-8640-cdf095a4c2b2 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:33.041662 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 29/60] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:33.047105 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646aa37-9211-46e2-95bc-0390b45df6ea None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:33.142481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646aa37-9211-46e2-95bc-0390b45df6ea None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:33.174508 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a47550-a218-48e9-857b-7470610575cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:33.175185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47550-a218-48e9-857b-7470610575cb None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:33.175478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47550-a218-48e9-857b-7470610575cb None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:33.175779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47550-a218-48e9-857b-7470610575cb None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:33.177072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a47550-a218-48e9-857b-7470610575cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:33.178673 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a47550-a218-48e9-857b-7470610575cb None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:33.204716 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 32/61] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:41:33 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:41:36.618146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a164d-cf88-4298-81f1-e4e460c64a7e None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:36.618720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a164d-cf88-4298-81f1-e4e460c64a7e None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:36.618720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a164d-cf88-4298-81f1-e4e460c64a7e None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:36.620195 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 30/62] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:36.631187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da8c7-b839-4e64-bbb7-302a1846f788 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:36.631724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da8c7-b839-4e64-bbb7-302a1846f788 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:36.631724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606da8c7-b839-4e64-bbb7-302a1846f788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:36.668855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-606da8c7-b839-4e64-bbb7-302a1846f788 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:36.670528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-606da8c7-b839-4e64-bbb7-302a1846f788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:36.808292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 33/63] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:36.856933 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a164d-cf88-4298-81f1-e4e460c64a7e None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:36.962140 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dcec7-4e1f-4a54-b8eb-eba4c1c51096 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:36.962836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dcec7-4e1f-4a54-b8eb-eba4c1c51096 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:36.963368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dcec7-4e1f-4a54-b8eb-eba4c1c51096 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:36.965022 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 34/64] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:41:36.970483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9b36-3019-4c2d-bc4a-a6fb284923d7 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:36.971058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9b36-3019-4c2d-bc4a-a6fb284923d7 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:36.971576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9b36-3019-4c2d-bc4a-a6fb284923d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:36.998385 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-eb2a9b36-3019-4c2d-bc4a-a6fb284923d7 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:37.001642 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-eb2a9b36-3019-4c2d-bc4a-a6fb284923d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:37.056798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a164d-cf88-4298-81f1-e4e460c64a7e None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.100462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 35/65] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:37.102182 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb1f2e-bb17-4503-823a-ad09a6f9ccd8 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.102782 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb1f2e-bb17-4503-823a-ad09a6f9ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.103304 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb1f2e-bb17-4503-823a-ad09a6f9ccd8 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.109342 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 36/66] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:37.110996 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f767-df5e-437e-b5f0-6f548422d320 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.111521 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f767-df5e-437e-b5f0-6f548422d320 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.112099 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f767-df5e-437e-b5f0-6f548422d320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.143380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-a397f767-df5e-437e-b5f0-6f548422d320 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:37.145411 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-a397f767-df5e-437e-b5f0-6f548422d320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:37.146762 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8905511-c827-4992-8090-6a341a590af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.147564 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8905511-c827-4992-8090-6a341a590af3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.147895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8905511-c827-4992-8090-6a341a590af3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.148177 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8905511-c827-4992-8090-6a341a590af3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.159217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8905511-c827-4992-8090-6a341a590af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-f8905511-c827-4992-8090-6a341a590af3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:37.167223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:37.168551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:37.169477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:37.170228 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 31/67] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:37.171081 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046a5c-06e7-4d4e-a9d2-3a55f69df57d None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.171279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046a5c-06e7-4d4e-a9d2-3a55f69df57d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.171554 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d046a5c-06e7-4d4e-a9d2-3a55f69df57d None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.172845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 32/68] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:37.173789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046a5c-06e7-4d4e-a9d2-3a55f69df57d None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.225907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 37/69] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:37.226860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397f767-df5e-437e-b5f0-6f548422d320 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.285281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d046a5c-06e7-4d4e-a9d2-3a55f69df57d None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.320199 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f02cf-702e-4c2a-9e72-ca0a22e2d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.321045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f02cf-702e-4c2a-9e72-ca0a22e2d70b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.321334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f02cf-702e-4c2a-9e72-ca0a22e2d70b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.321618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f02cf-702e-4c2a-9e72-ca0a22e2d70b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.331611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f02cf-702e-4c2a-9e72-ca0a22e2d70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:37.339416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397f767-df5e-437e-b5f0-6f548422d320 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-051f02cf-702e-4c2a-9e72-ca0a22e2d70b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:37.340101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:37.341140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:37.342100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 33/70] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:37.342892 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523aeba-20be-48e6-8d81-97fd740b3c36 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.342892 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523aeba-20be-48e6-8d81-97fd740b3c36 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.343718 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523aeba-20be-48e6-8d81-97fd740b3c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.360366 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-4523aeba-20be-48e6-8d81-97fd740b3c36 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:37.361606 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-4523aeba-20be-48e6-8d81-97fd740b3c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:37.380229 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.380909 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.381197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.381478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.382227 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:37.382532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:37.383968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:37.392120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 38/71] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:37.393055 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.438075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 34/72] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:37.439166 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523aeba-20be-48e6-8d81-97fd740b3c36 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.493383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a0e7-4a60-4e27-a993-36e7d39be8a0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.525900 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe9c9-f2ab-41d2-b784-81c63a356c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.531314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe9c9-f2ab-41d2-b784-81c63a356c06 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.531314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe9c9-f2ab-41d2-b784-81c63a356c06 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.531314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe9c9-f2ab-41d2-b784-81c63a356c06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.539864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523aeba-20be-48e6-8d81-97fd740b3c36 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.541419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fe9c9-f2ab-41d2-b784-81c63a356c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-002fe9c9-f2ab-41d2-b784-81c63a356c06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:37.549215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:37.550514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 39/73] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:37.552696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe9c9-f2ab-41d2-b784-81c63a356c06 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.576184 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd023d7b-c8c3-49a0-8ed5-166a6abc9a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.576862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023d7b-c8c3-49a0-8ed5-166a6abc9a5d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.577153 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023d7b-c8c3-49a0-8ed5-166a6abc9a5d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.577433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd023d7b-c8c3-49a0-8ed5-166a6abc9a5d None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.578187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd023d7b-c8c3-49a0-8ed5-166a6abc9a5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:37.578565 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd023d7b-c8c3-49a0-8ed5-166a6abc9a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:37.579968 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd023d7b-c8c3-49a0-8ed5-166a6abc9a5d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:37.587799 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 35/74] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:37.590624 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad87d6-e916-474d-9fc8-1c3d79d60382 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.590927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad87d6-e916-474d-9fc8-1c3d79d60382 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.591218 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad87d6-e916-474d-9fc8-1c3d79d60382 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.592681 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 36/75] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:37.593865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad87d6-e916-474d-9fc8-1c3d79d60382 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.651415 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe9c9-f2ab-41d2-b784-81c63a356c06 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.683689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15feb3-7d41-489a-b88c-647470aa7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.684596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15feb3-7d41-489a-b88c-647470aa7d7b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.684887 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15feb3-7d41-489a-b88c-647470aa7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.685167 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15feb3-7d41-489a-b88c-647470aa7d7b None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.695092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad87d6-e916-474d-9fc8-1c3d79d60382 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.700086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15feb3-7d41-489a-b88c-647470aa7d7b None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:37.701579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15feb3-7d41-489a-b88c-647470aa7d7b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:37.703284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 40/76] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:37.704095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15feb3-7d41-489a-b88c-647470aa7d7b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.730195 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a54a9b-8b84-4a03-b187-cc20d4fc3829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.730999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54a9b-8b84-4a03-b187-cc20d4fc3829 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.731288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54a9b-8b84-4a03-b187-cc20d4fc3829 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.731575 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54a9b-8b84-4a03-b187-cc20d4fc3829 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.741897 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a54a9b-8b84-4a03-b187-cc20d4fc3829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a3a54a9b-8b84-4a03-b187-cc20d4fc3829 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:37.749617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:37.750610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:37.751706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 37/77] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:37.752777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a54a9b-8b84-4a03-b187-cc20d4fc3829 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.801919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15feb3-7d41-489a-b88c-647470aa7d7b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.835809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5c803-34ed-4429-8b05-d68b5d713db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.836480 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5c803-34ed-4429-8b05-d68b5d713db9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.836773 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5c803-34ed-4429-8b05-d68b5d713db9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.837051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5c803-34ed-4429-8b05-d68b5d713db9 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.837804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5c803-34ed-4429-8b05-d68b5d713db9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:37.838115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5c803-34ed-4429-8b05-d68b5d713db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:37.839509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5c803-34ed-4429-8b05-d68b5d713db9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:37.847342 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 41/78] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:37.849058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b01c9-5357-45ee-9abf-e0fc1f6b0b63 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.849356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b01c9-5357-45ee-9abf-e0fc1f6b0b63 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.849641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b01c9-5357-45ee-9abf-e0fc1f6b0b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.850747 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a54a9b-8b84-4a03-b187-cc20d4fc3829 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:37.865771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-8a8b01c9-5357-45ee-9abf-e0fc1f6b0b63 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:37.866977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-8a8b01c9-5357-45ee-9abf-e0fc1f6b0b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:37.884089 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83f3e8-1664-463b-84a3-360b86e546e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:37.884973 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f3e8-1664-463b-84a3-360b86e546e0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:37.885264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f3e8-1664-463b-84a3-360b86e546e0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:37.885550 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83f3e8-1664-463b-84a3-360b86e546e0 None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:37.886783 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83f3e8-1664-463b-84a3-360b86e546e0 None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:37.888293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83f3e8-1664-463b-84a3-360b86e546e0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:37.889937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 38/79] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:37.890717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83f3e8-1664-463b-84a3-360b86e546e0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.935236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 42/80] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:37.936377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b01c9-5357-45ee-9abf-e0fc1f6b0b63 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:37.990015 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83f3e8-1664-463b-84a3-360b86e546e0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.022710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2b040-091e-4203-aaa5-2883221eeddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.023301 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2b040-091e-4203-aaa5-2883221eeddc None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.023593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2b040-091e-4203-aaa5-2883221eeddc None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.023913 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2b040-091e-4203-aaa5-2883221eeddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.032921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b01c9-5357-45ee-9abf-e0fc1f6b0b63 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.066083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.066756 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.067028 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.067306 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.068097 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:38.068407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.069798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.077785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 43/81] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:38.078398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.089621 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2b040-091e-4203-aaa5-2883221eeddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.091098 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2b040-091e-4203-aaa5-2883221eeddc None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.172942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6e0d-b240-40f1-a99b-70afef9ac967 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.185924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 39/82] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:38.186878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2b040-091e-4203-aaa5-2883221eeddc None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.206647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68b16-c96a-430c-ae06-e6eb4de32036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.207551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68b16-c96a-430c-ae06-e6eb4de32036 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.207867 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68b16-c96a-430c-ae06-e6eb4de32036 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.208148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68b16-c96a-430c-ae06-e6eb4de32036 None admin] PATH_INFO: `/v3/users/57514b8d78af4c4d8d5b1768815c9e7b` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.209351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad68b16-c96a-430c-ae06-e6eb4de32036 None admin] RBAC: Authorizing `identity:get_user(user_id=57514b8d78af4c4d8d5b1768815c9e7b)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.210826 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad68b16-c96a-430c-ae06-e6eb4de32036 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.212517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 44/83] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/users/57514b8d78af4c4d8d5b1768815c9e7b => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:38.213283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68b16-c96a-430c-ae06-e6eb4de32036 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.284302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2b040-091e-4203-aaa5-2883221eeddc None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.309235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68b16-c96a-430c-ae06-e6eb4de32036 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.317346 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c2edf-e1d2-4871-80b0-880d6dc0b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.317992 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c2edf-e1d2-4871-80b0-880d6dc0b620 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.318276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c2edf-e1d2-4871-80b0-880d6dc0b620 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.318562 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c2edf-e1d2-4871-80b0-880d6dc0b620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.342077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179b66d-0b56-4025-b2e4-2df1457aea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.342865 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b66d-0b56-4025-b2e4-2df1457aea7d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.343153 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b66d-0b56-4025-b2e4-2df1457aea7d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.343437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179b66d-0b56-4025-b2e4-2df1457aea7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.344655 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179b66d-0b56-4025-b2e4-2df1457aea7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.346108 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179b66d-0b56-4025-b2e4-2df1457aea7d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.347744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 45/84] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:38.348764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179b66d-0b56-4025-b2e4-2df1457aea7d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.383639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c2edf-e1d2-4871-80b0-880d6dc0b620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.385128 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c2edf-e1d2-4871-80b0-880d6dc0b620 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.443587 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179b66d-0b56-4025-b2e4-2df1457aea7d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.475036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beadf2-381c-4328-912e-aa0f439dfb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.475942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beadf2-381c-4328-912e-aa0f439dfb91 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.476231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beadf2-381c-4328-912e-aa0f439dfb91 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.476509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beadf2-381c-4328-912e-aa0f439dfb91 None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.477713 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beadf2-381c-4328-912e-aa0f439dfb91 None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.477952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 40/85] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:38.486985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c2edf-e1d2-4871-80b0-880d6dc0b620 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.487084 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beadf2-381c-4328-912e-aa0f439dfb91 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.487084 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 46/86] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:38.487084 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beadf2-381c-4328-912e-aa0f439dfb91 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.572551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c2edf-e1d2-4871-80b0-880d6dc0b620 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.576411 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beadf2-381c-4328-912e-aa0f439dfb91 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.605308 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e7f74-65b0-4ad7-83cb-1e2b4d39a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.606162 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e7f74-65b0-4ad7-83cb-1e2b4d39a891 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.606447 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e7f74-65b0-4ad7-83cb-1e2b4d39a891 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.606729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e7f74-65b0-4ad7-83cb-1e2b4d39a891 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.607927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e7f74-65b0-4ad7-83cb-1e2b4d39a891 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.608911 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171308d4-3f05-4cae-b631-a1947bf5309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.609369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e7f74-65b0-4ad7-83cb-1e2b4d39a891 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.609596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171308d4-3f05-4cae-b631-a1947bf5309a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.609892 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171308d4-3f05-4cae-b631-a1947bf5309a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.610187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171308d4-3f05-4cae-b631-a1947bf5309a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.611162 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 41/87] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:38.612034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e7f74-65b0-4ad7-83cb-1e2b4d39a891 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.677653 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171308d4-3f05-4cae-b631-a1947bf5309a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.679234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171308d4-3f05-4cae-b631-a1947bf5309a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.708338 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e7f74-65b0-4ad7-83cb-1e2b4d39a891 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.741171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa1160-09ab-449e-ae6c-9155e3d5eb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.741846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa1160-09ab-449e-ae6c-9155e3d5eb93 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.742135 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa1160-09ab-449e-ae6c-9155e3d5eb93 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.742417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa1160-09ab-449e-ae6c-9155e3d5eb93 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.743132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa1160-09ab-449e-ae6c-9155e3d5eb93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.744608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa1160-09ab-449e-ae6c-9155e3d5eb93 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.770838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 42/88] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:41:38 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:38.784030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa1160-09ab-449e-ae6c-9155e3d5eb93 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.784158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 47/89] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:38.784158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171308d4-3f05-4cae-b631-a1947bf5309a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.882774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171308d4-3f05-4cae-b631-a1947bf5309a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.883000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa1160-09ab-449e-ae6c-9155e3d5eb93 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:38.919154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6cb89-05f9-4d54-8a3d-2e77921e0386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.919639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94274328-c990-4202-b2fb-db14f6e67d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:38.920075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6cb89-05f9-4d54-8a3d-2e77921e0386 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.920364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6cb89-05f9-4d54-8a3d-2e77921e0386 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.920467 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94274328-c990-4202-b2fb-db14f6e67d42 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:38.920648 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6cb89-05f9-4d54-8a3d-2e77921e0386 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.920756 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94274328-c990-4202-b2fb-db14f6e67d42 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:38.920973 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94274328-c990-4202-b2fb-db14f6e67d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:38.921939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6cb89-05f9-4d54-8a3d-2e77921e0386 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:38.923447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6cb89-05f9-4d54-8a3d-2e77921e0386 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:38.925337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 48/90] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:38.931427 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6cb89-05f9-4d54-8a3d-2e77921e0386 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:38.998674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94274328-c990-4202-b2fb-db14f6e67d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:39.000628 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94274328-c990-4202-b2fb-db14f6e67d42 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:39.038098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6cb89-05f9-4d54-8a3d-2e77921e0386 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:39.076668 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:39.077718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:39.078228 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:39.078733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:39.079847 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] RBAC: Adding query filter params (role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=104072102c8e4dddb773192263e064ba, user.id=d45befe87ee147b2ae291802a76a5ccf) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:39.080404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:39.081873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:39.088601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 49/91] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/role_assignments?user.id=d45befe87ee147b2ae291802a76a5ccf&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:39.089442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:39.122837 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 43/92] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:39.123872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94274328-c990-4202-b2fb-db14f6e67d42 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:39.209562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a7b0a-c015-43c3-9176-4372809ef094 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:39.241525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94274328-c990-4202-b2fb-db14f6e67d42 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:39.247229 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756ff9-62a4-4c57-b2d9-4012e803ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:39.248155 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756ff9-62a4-4c57-b2d9-4012e803ad3d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:39.248440 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756ff9-62a4-4c57-b2d9-4012e803ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:39.248717 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756ff9-62a4-4c57-b2d9-4012e803ad3d None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:39.249975 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7756ff9-62a4-4c57-b2d9-4012e803ad3d None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:39.251494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7756ff9-62a4-4c57-b2d9-4012e803ad3d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:39.253631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 50/93] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:39 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:39.255199 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756ff9-62a4-4c57-b2d9-4012e803ad3d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:39.279408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:39.280132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:39.280422 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:39.280704 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:39.281571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] RBAC: Adding query filter params (role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=104072102c8e4dddb773192263e064ba, user.id=d45befe87ee147b2ae291802a76a5ccf) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:39.281885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:39.283450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:39.293652 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 44/94] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:39 2022] GET /identity/v3/role_assignments?user.id=d45befe87ee147b2ae291802a76a5ccf&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:39.294533 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:39.405054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c02a-6f56-4853-92ab-e0e9006e7453 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:39.416702 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756ff9-62a4-4c57-b2d9-4012e803ad3d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:39.443565 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:39.444283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:39.444573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:39.444859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:39.445726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=104072102c8e4dddb773192263e064ba, user.id=57514b8d78af4c4d8d5b1768815c9e7b) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:39.446046 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:39.447558 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:39.453907 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 45/95] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:39 2022] GET /identity/v3/role_assignments?user.id=57514b8d78af4c4d8d5b1768815c9e7b&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:39.472479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a03b1-361d-40e9-b971-83996e52282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:39.474076 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a03b1-361d-40e9-b971-83996e52282f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:39.474366 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a03b1-361d-40e9-b971-83996e52282f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:39.474647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a03b1-361d-40e9-b971-83996e52282f None admin] PATH_INFO: `/v3/projects/0d2abcb89a52442dbecd0dc4dd7faf0a` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:39.477065 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a03b1-361d-40e9-b971-83996e52282f None admin] RBAC: Authorizing `identity:get_project(project_id=0d2abcb89a52442dbecd0dc4dd7faf0a)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:39.478605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a03b1-361d-40e9-b971-83996e52282f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:39.480901 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 51/96] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:39 2022] GET /identity/v3/projects/0d2abcb89a52442dbecd0dc4dd7faf0a => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:39.489805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:39.612715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ddd1d-fdd7-41b1-8b63-a817c96f44d8 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:39.651038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446abb3e-6b94-4462-bd11-531fb94ac6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:39.651721 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446abb3e-6b94-4462-bd11-531fb94ac6be None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:39.652041 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446abb3e-6b94-4462-bd11-531fb94ac6be None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:39.652326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446abb3e-6b94-4462-bd11-531fb94ac6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:39.653193 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446abb3e-6b94-4462-bd11-531fb94ac6be None admin] RBAC: Adding query filter params (role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=0d2abcb89a52442dbecd0dc4dd7faf0a, user.id=d45befe87ee147b2ae291802a76a5ccf) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:39.653511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446abb3e-6b94-4462-bd11-531fb94ac6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:39.654998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446abb3e-6b94-4462-bd11-531fb94ac6be None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:39.661801 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 46/97] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:39 2022] GET /identity/v3/role_assignments?user.id=d45befe87ee147b2ae291802a76a5ccf&scope.project.id=0d2abcb89a52442dbecd0dc4dd7faf0a&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:42.043454 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad50830-e714-4dba-ba6a-9a6cde0caf75 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.044146 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad50830-e714-4dba-ba6a-9a6cde0caf75 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.044146 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad50830-e714-4dba-ba6a-9a6cde0caf75 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.045572 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 52/98] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:42.052090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5120c9-19ef-4307-9c3e-8c4396e02688 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.052810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5120c9-19ef-4307-9c3e-8c4396e02688 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.052810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5120c9-19ef-4307-9c3e-8c4396e02688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.081043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-cb5120c9-19ef-4307-9c3e-8c4396e02688 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:42.082357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-cb5120c9-19ef-4307-9c3e-8c4396e02688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:42.160066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 47/99] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:42.202539 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80522a-3898-4ed6-923f-407302bf4e18 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.202888 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80522a-3898-4ed6-923f-407302bf4e18 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.203121 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80522a-3898-4ed6-923f-407302bf4e18 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.204817 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 53/100] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:42.210897 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80522a-3898-4ed6-923f-407302bf4e18 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:42.211850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7aba8-65c0-453b-918c-9e317160a1e9 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.212152 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7aba8-65c0-453b-918c-9e317160a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.212440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7aba8-65c0-453b-918c-9e317160a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.231981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-6ae7aba8-65c0-453b-918c-9e317160a1e9 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:42.233244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-6ae7aba8-65c0-453b-918c-9e317160a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:42.325036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 48/101] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:42.344632 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315644-57c0-47c1-829a-76d7b8679ed5 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.345022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315644-57c0-47c1-829a-76d7b8679ed5 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.345347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46315644-57c0-47c1-829a-76d7b8679ed5 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.346819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 49/102] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:41:42.352843 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46315644-57c0-47c1-829a-76d7b8679ed5 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:42.395301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80522a-3898-4ed6-923f-407302bf4e18 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:42.429798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea83c7b-3ce2-4e6c-90a3-cd0ac0cb406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:42.430979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea83c7b-3ce2-4e6c-90a3-cd0ac0cb406f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.431508 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea83c7b-3ce2-4e6c-90a3-cd0ac0cb406f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.432058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea83c7b-3ce2-4e6c-90a3-cd0ac0cb406f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.444353 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea83c7b-3ce2-4e6c-90a3-cd0ac0cb406f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-4ea83c7b-3ce2-4e6c-90a3-cd0ac0cb406f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:42.452754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:42.453905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:41:42.454952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:42.458384 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 54/103] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:41:42.458615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46315644-57c0-47c1-829a-76d7b8679ed5 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:42.464746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f73fd1-ddf2-45e1-a678-2a719bcb22e0 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.465328 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f73fd1-ddf2-45e1-a678-2a719bcb22e0 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.465845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f73fd1-ddf2-45e1-a678-2a719bcb22e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.484012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-75f73fd1-ddf2-45e1-a678-2a719bcb22e0 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:42.485566 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-75f73fd1-ddf2-45e1-a678-2a719bcb22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:42.494915 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18421c-2446-47df-a2f8-5525895dc62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:42.495741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18421c-2446-47df-a2f8-5525895dc62a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.496061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18421c-2446-47df-a2f8-5525895dc62a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.496344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18421c-2446-47df-a2f8-5525895dc62a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.506905 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18421c-2446-47df-a2f8-5525895dc62a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ee18421c-2446-47df-a2f8-5525895dc62a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:42.515429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:42.516595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:42.517526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 50/104] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:41:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:42.518327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff939-bf7e-43d6-9c1a-83f685faa70b None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.518327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff939-bf7e-43d6-9c1a-83f685faa70b None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.519263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff939-bf7e-43d6-9c1a-83f685faa70b None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.524442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 51/105] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:42.525520 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff939-bf7e-43d6-9c1a-83f685faa70b None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:42.570632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 55/106] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:42.570632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fcae0-df25-4266-8c42-d7edbe773e25 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.570632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fcae0-df25-4266-8c42-d7edbe773e25 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.570632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fcae0-df25-4266-8c42-d7edbe773e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.592108 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-0b1fcae0-df25-4266-8c42-d7edbe773e25 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:42.593233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-0b1fcae0-df25-4266-8c42-d7edbe773e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:42.655415 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff939-bf7e-43d6-9c1a-83f685faa70b None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:42.665052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 56/107] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:42.666232 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fcae0-df25-4266-8c42-d7edbe773e25 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:42.692592 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:42.693280 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.693568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.693850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.694624 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:42.695044 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:42.696370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:42.705668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 52/108] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:42.706661 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:42.777239 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fcae0-df25-4266-8c42-d7edbe773e25 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:42.811464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e34cd7-e4bb-4bc8-9165-b2c6ff9e1ca2 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:42.813864 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:42.814806 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.815324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.815874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.816946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:42.817490 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:42.819147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:42.828058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 57/109] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:41:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:42.829210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:42.852709 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25a391-dc1f-4904-85e4-371fc57081dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:42.853562 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25a391-dc1f-4904-85e4-371fc57081dd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.853767 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25a391-dc1f-4904-85e4-371fc57081dd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.854051 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25a391-dc1f-4904-85e4-371fc57081dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.865628 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25a391-dc1f-4904-85e4-371fc57081dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0f25a391-dc1f-4904-85e4-371fc57081dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:42.873569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:42.874647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 53/110] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:42.875607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25a391-dc1f-4904-85e4-371fc57081dd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:42.946978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bfedd-f4d9-4663-bce7-115a6d7baa78 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:42.983864 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373c196-3fec-4cc6-b711-0bbc60fc50a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:42.984262 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25a391-dc1f-4904-85e4-371fc57081dd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:42.985339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c196-3fec-4cc6-b711-0bbc60fc50a2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:42.985879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c196-3fec-4cc6-b711-0bbc60fc50a2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:42.986389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c196-3fec-4cc6-b711-0bbc60fc50a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:42.989200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373c196-3fec-4cc6-b711-0bbc60fc50a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:42.991231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373c196-3fec-4cc6-b711-0bbc60fc50a2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:42.993425 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 58/111] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:42.994531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373c196-3fec-4cc6-b711-0bbc60fc50a2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.023697 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09f98-b601-4006-95c7-1b3328882dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.024598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09f98-b601-4006-95c7-1b3328882dbd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.024943 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09f98-b601-4006-95c7-1b3328882dbd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.025226 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09f98-b601-4006-95c7-1b3328882dbd None admin] PATH_INFO: `/v3/users/2adc8088b947409d95b116c6b0d48dd9` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.042195 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c09f98-b601-4006-95c7-1b3328882dbd None admin] RBAC: Authorizing `identity:get_user(user_id=2adc8088b947409d95b116c6b0d48dd9)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.043794 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c09f98-b601-4006-95c7-1b3328882dbd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.045506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 54/112] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:42 2022] GET /identity/v3/users/2adc8088b947409d95b116c6b0d48dd9 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:43.050072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09f98-b601-4006-95c7-1b3328882dbd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.108268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373c196-3fec-4cc6-b711-0bbc60fc50a2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:43.144225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847691f-c85f-459b-b00b-51db70568be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.145804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847691f-c85f-459b-b00b-51db70568be5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.146337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847691f-c85f-459b-b00b-51db70568be5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.146844 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847691f-c85f-459b-b00b-51db70568be5 None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.148347 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847691f-c85f-459b-b00b-51db70568be5 None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.149356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09f98-b601-4006-95c7-1b3328882dbd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:43.150735 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847691f-c85f-459b-b00b-51db70568be5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.152700 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 59/113] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:42 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:43.153693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847691f-c85f-459b-b00b-51db70568be5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.193581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.194291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.194585 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.194871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.195665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] RBAC: Adding query filter params (name=member) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:43.196026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.197466 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.206929 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 55/114] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:43.212818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.273184 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847691f-c85f-459b-b00b-51db70568be5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:43.308066 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61267-d763-48ba-b26d-02912f3520c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.309115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61267-d763-48ba-b26d-02912f3520c7 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.309661 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61267-d763-48ba-b26d-02912f3520c7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.310048 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee61267-d763-48ba-b26d-02912f3520c7 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.310773 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee61267-d763-48ba-b26d-02912f3520c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.312534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee61267-d763-48ba-b26d-02912f3520c7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.315573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f710b94-091c-4265-9b0c-9b909745ad65 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:43.338458 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 60/115] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:41:43 2022] POST /identity/v3/projects => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:43.339312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61267-d763-48ba-b26d-02912f3520c7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.359459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aab2fb-5df0-46e9-9df2-9ef842b55af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.360981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aab2fb-5df0-46e9-9df2-9ef842b55af8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.361513 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aab2fb-5df0-46e9-9df2-9ef842b55af8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.362091 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aab2fb-5df0-46e9-9df2-9ef842b55af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.448185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aab2fb-5df0-46e9-9df2-9ef842b55af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.449912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aab2fb-5df0-46e9-9df2-9ef842b55af8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.451396 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee61267-d763-48ba-b26d-02912f3520c7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:43.487483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30511a-d4de-41f6-b50e-16dbcf9a15f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.488963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30511a-d4de-41f6-b50e-16dbcf9a15f0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.489251 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30511a-d4de-41f6-b50e-16dbcf9a15f0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.489521 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30511a-d4de-41f6-b50e-16dbcf9a15f0 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.490814 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30511a-d4de-41f6-b50e-16dbcf9a15f0 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.492375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30511a-d4de-41f6-b50e-16dbcf9a15f0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.494365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 61/116] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:43 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:43.495474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c4da-4bb0-4f06-9390-8a1ed2bd77a2 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.495787 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c4da-4bb0-4f06-9390-8a1ed2bd77a2 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.496066 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c4da-4bb0-4f06-9390-8a1ed2bd77a2 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.497463 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 62/117] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:43.500688 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c4da-4bb0-4f06-9390-8a1ed2bd77a2 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.569332 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 56/118] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:43.570521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195c06-7b98-42ad-ae8d-8c8661407fcb None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.570817 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195c06-7b98-42ad-ae8d-8c8661407fcb None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.571100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195c06-7b98-42ad-ae8d-8c8661407fcb None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.575847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 57/119] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:43.575847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195c06-7b98-42ad-ae8d-8c8661407fcb None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.616622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c4da-4bb0-4f06-9390-8a1ed2bd77a2 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:43.651049 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d8a7c-1480-4583-9788-8cf6819b28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.652083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d8a7c-1480-4583-9788-8cf6819b28ca None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.652367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d8a7c-1480-4583-9788-8cf6819b28ca None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.652642 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d8a7c-1480-4583-9788-8cf6819b28ca None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.653846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d8a7c-1480-4583-9788-8cf6819b28ca None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.655303 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d8a7c-1480-4583-9788-8cf6819b28ca None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.657201 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 63/120] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:43 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:43.658145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3edec-6512-46c2-b6fb-442f707150d3 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.658433 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3edec-6512-46c2-b6fb-442f707150d3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.658764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3edec-6512-46c2-b6fb-442f707150d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.676611 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-d7c3edec-6512-46c2-b6fb-442f707150d3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:43.678012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-d7c3edec-6512-46c2-b6fb-442f707150d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:43.678899 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195c06-7b98-42ad-ae8d-8c8661407fcb None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:43.713494 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154114b-ec07-4de1-94ce-3a4c07e04546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.714402 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154114b-ec07-4de1-94ce-3a4c07e04546 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.714695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154114b-ec07-4de1-94ce-3a4c07e04546 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.714981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154114b-ec07-4de1-94ce-3a4c07e04546 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba/users/d45befe87ee147b2ae291802a76a5ccf/roles/c0ef3a26cb124115962df9d8c742f9f1` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.717247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154114b-ec07-4de1-94ce-3a4c07e04546 None admin] RBAC: Authorizing `identity:create_grant(project_id=104072102c8e4dddb773192263e064ba, user_id=d45befe87ee147b2ae291802a76a5ccf, role_id=c0ef3a26cb124115962df9d8c742f9f1)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.718727 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154114b-ec07-4de1-94ce-3a4c07e04546 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.734965 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 58/121] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:41:43 2022] PUT /identity/v3/projects/104072102c8e4dddb773192263e064ba/users/d45befe87ee147b2ae291802a76a5ccf/roles/c0ef3a26cb124115962df9d8c742f9f1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:41:43.734965 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154114b-ec07-4de1-94ce-3a4c07e04546 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.763843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 64/122] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:43.765343 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93484-0fd4-4a06-a788-0949da8fb53d None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.765645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93484-0fd4-4a06-a788-0949da8fb53d None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.765933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e93484-0fd4-4a06-a788-0949da8fb53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.785913 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-54e93484-0fd4-4a06-a788-0949da8fb53d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:43.787619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-54e93484-0fd4-4a06-a788-0949da8fb53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:43.873762 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 65/123] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:43.874621 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e93484-0fd4-4a06-a788-0949da8fb53d None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:43.903789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154114b-ec07-4de1-94ce-3a4c07e04546 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:43.948775 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee66d5-49ff-4db9-8de1-319cc549a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:43.949675 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee66d5-49ff-4db9-8de1-319cc549a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:43.949967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee66d5-49ff-4db9-8de1-319cc549a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:43.950309 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee66d5-49ff-4db9-8de1-319cc549a5c1 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:43.951608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee66d5-49ff-4db9-8de1-319cc549a5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:43.953213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee66d5-49ff-4db9-8de1-319cc549a5c1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:43.955085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 59/124] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:43 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:43.955955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee66d5-49ff-4db9-8de1-319cc549a5c1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.022120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e93484-0fd4-4a06-a788-0949da8fb53d None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.061120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ae17a-06e7-4c10-a242-c1a0e2134d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.061996 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae17a-06e7-4c10-a242-c1a0e2134d05 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.062622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae17a-06e7-4c10-a242-c1a0e2134d05 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.062912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae17a-06e7-4c10-a242-c1a0e2134d05 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.064157 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ae17a-06e7-4c10-a242-c1a0e2134d05 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:44.065637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ae17a-06e7-4c10-a242-c1a0e2134d05 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:44.068660 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 66/125] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:43 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:44.069237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ae17a-06e7-4c10-a242-c1a0e2134d05 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.077451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee66d5-49ff-4db9-8de1-319cc549a5c1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.112537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6681a-426b-49f3-9bf3-23738c203656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.113409 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6681a-426b-49f3-9bf3-23738c203656 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.113764 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6681a-426b-49f3-9bf3-23738c203656 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.114051 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6681a-426b-49f3-9bf3-23738c203656 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.125128 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6681a-426b-49f3-9bf3-23738c203656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-37a6681a-426b-49f3-9bf3-23738c203656 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:44.133715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:44.134788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 60/126] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:41:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:44.137007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6681a-426b-49f3-9bf3-23738c203656 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.174277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ae17a-06e7-4c10-a242-c1a0e2134d05 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.213169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498e77-3945-422b-b439-539e2c75e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.213981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498e77-3945-422b-b439-539e2c75e832 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.214269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498e77-3945-422b-b439-539e2c75e832 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.214552 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d498e77-3945-422b-b439-539e2c75e832 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.226489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d498e77-3945-422b-b439-539e2c75e832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-6d498e77-3945-422b-b439-539e2c75e832 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:44.234560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:44.237309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 67/127] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:44.239478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498e77-3945-422b-b439-539e2c75e832 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.256729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6681a-426b-49f3-9bf3-23738c203656 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.292927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.293597 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.293886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.294170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.295021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] RBAC: Adding query filter params (role.id=a6a3e324423b44eca4bd874736714a3f, scope.project.id=104072102c8e4dddb773192263e064ba, user.id=2adc8088b947409d95b116c6b0d48dd9) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:44.295338 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:44.296895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:44.302629 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 61/128] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:44 2022] GET /identity/v3/role_assignments?user.id=2adc8088b947409d95b116c6b0d48dd9&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=a6a3e324423b44eca4bd874736714a3f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:44.303441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.346731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d498e77-3945-422b-b439-539e2c75e832 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.384911 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93158-8a8f-49b9-bd50-4b700517e46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.385744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93158-8a8f-49b9-bd50-4b700517e46d None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.386038 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93158-8a8f-49b9-bd50-4b700517e46d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.386324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93158-8a8f-49b9-bd50-4b700517e46d None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba/users/d45befe87ee147b2ae291802a76a5ccf/roles/7f13f524fe7d4fd4a929550d9f95b314` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.388480 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93158-8a8f-49b9-bd50-4b700517e46d None admin] RBAC: Authorizing `identity:create_grant(project_id=104072102c8e4dddb773192263e064ba, user_id=d45befe87ee147b2ae291802a76a5ccf, role_id=7f13f524fe7d4fd4a929550d9f95b314)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:44.389992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93158-8a8f-49b9-bd50-4b700517e46d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:44.420973 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 68/129] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:41:44 2022] PUT /identity/v3/projects/104072102c8e4dddb773192263e064ba/users/d45befe87ee147b2ae291802a76a5ccf/roles/7f13f524fe7d4fd4a929550d9f95b314 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:41:44.422074 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93158-8a8f-49b9-bd50-4b700517e46d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.563082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93158-8a8f-49b9-bd50-4b700517e46d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.607201 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.607946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.608240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.608528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.609317 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:44.609632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:44.611104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:44.622950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b65ca-a8e0-4253-9a80-934a73c24b3a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.623415 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 69/130] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:44.632959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.707789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.707789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.707789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.707789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.708668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:44.708668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:44.708668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:44.719032 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 62/131] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:44.726904 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.862091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc5ec5-dbb4-4778-9169-15792d83f7d2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.899288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59f197-ec6f-4052-9b34-de2f6a54878d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:44.928811 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7c36-f623-42b8-b087-838088305b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.929708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7c36-f623-42b8-b087-838088305b65 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.929997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7c36-f623-42b8-b087-838088305b65 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.930280 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7c36-f623-42b8-b087-838088305b65 None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.933924 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7c36-f623-42b8-b087-838088305b65 None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:44.935602 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7c36-f623-42b8-b087-838088305b65 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:44.936483 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b648-a918-4923-91ba-d871674d9215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:44.942515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 70/132] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:44 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:44.943336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b648-a918-4923-91ba-d871674d9215 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:44.943897 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b648-a918-4923-91ba-d871674d9215 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:44.944400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3b648-a918-4923-91ba-d871674d9215 None admin] PATH_INFO: `/v3/users/57514b8d78af4c4d8d5b1768815c9e7b` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:44.945957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b648-a918-4923-91ba-d871674d9215 None admin] RBAC: Authorizing `identity:get_user(user_id=57514b8d78af4c4d8d5b1768815c9e7b)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:44.947664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3b648-a918-4923-91ba-d871674d9215 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:44.949584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 63/133] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:44 2022] GET /identity/v3/users/57514b8d78af4c4d8d5b1768815c9e7b => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:44.951159 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7c36-f623-42b8-b087-838088305b65 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:44.955148 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b648-a918-4923-91ba-d871674d9215 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:45.154471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3b648-a918-4923-91ba-d871674d9215 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:45.162631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7c36-f623-42b8-b087-838088305b65 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:45.208455 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087e3f-1e83-49f8-9a14-a2690445260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:45.209464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087e3f-1e83-49f8-9a14-a2690445260c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:45.209755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087e3f-1e83-49f8-9a14-a2690445260c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:45.210037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a087e3f-1e83-49f8-9a14-a2690445260c None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:45.211299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087e3f-1e83-49f8-9a14-a2690445260c None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:45.212797 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a087e3f-1e83-49f8-9a14-a2690445260c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:45.214761 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 64/134] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:44 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:45.223475 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f117-9443-45d3-8c31-555e4b1ddb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:45.224045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087e3f-1e83-49f8-9a14-a2690445260c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:45.224504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f117-9443-45d3-8c31-555e4b1ddb06 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:45.224800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f117-9443-45d3-8c31-555e4b1ddb06 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:45.225084 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f117-9443-45d3-8c31-555e4b1ddb06 None admin] PATH_INFO: `/v3/projects/0d2abcb89a52442dbecd0dc4dd7faf0a` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:45.228577 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1f117-9443-45d3-8c31-555e4b1ddb06 None admin] RBAC: Authorizing `identity:get_project(project_id=0d2abcb89a52442dbecd0dc4dd7faf0a)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:45.230339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1f117-9443-45d3-8c31-555e4b1ddb06 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:45.234238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 71/135] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:44 2022] GET /identity/v3/projects/0d2abcb89a52442dbecd0dc4dd7faf0a => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:45.240420 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f117-9443-45d3-8c31-555e4b1ddb06 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:45.345424 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a087e3f-1e83-49f8-9a14-a2690445260c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:45.382306 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f117-9443-45d3-8c31-555e4b1ddb06 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:45.400504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde016b-56d6-4526-b433-ca2388176244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:45.401557 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde016b-56d6-4526-b433-ca2388176244 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:45.401690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde016b-56d6-4526-b433-ca2388176244 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:45.401963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde016b-56d6-4526-b433-ca2388176244 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba/users/57514b8d78af4c4d8d5b1768815c9e7b/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:45.404076 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde016b-56d6-4526-b433-ca2388176244 None admin] RBAC: Authorizing `identity:create_grant(project_id=104072102c8e4dddb773192263e064ba, user_id=57514b8d78af4c4d8d5b1768815c9e7b, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:45.406124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde016b-56d6-4526-b433-ca2388176244 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:45.421565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e81a0-0645-4197-b0f5-75576da211ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:45.423001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e81a0-0645-4197-b0f5-75576da211ee None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:45.423638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e81a0-0645-4197-b0f5-75576da211ee None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:45.424184 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e81a0-0645-4197-b0f5-75576da211ee None admin] PATH_INFO: `/v3/projects/0d2abcb89a52442dbecd0dc4dd7faf0a/users/d45befe87ee147b2ae291802a76a5ccf/roles/7f13f524fe7d4fd4a929550d9f95b314` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:45.427249 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e81a0-0645-4197-b0f5-75576da211ee None admin] RBAC: Authorizing `identity:create_grant(project_id=0d2abcb89a52442dbecd0dc4dd7faf0a, user_id=d45befe87ee147b2ae291802a76a5ccf, role_id=7f13f524fe7d4fd4a929550d9f95b314)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:45.427834 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 65/136] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:41:45 2022] PUT /identity/v3/projects/104072102c8e4dddb773192263e064ba/users/57514b8d78af4c4d8d5b1768815c9e7b/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:41:45.429492 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e81a0-0645-4197-b0f5-75576da211ee None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:45.457812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 72/137] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:41:45 2022] PUT /identity/v3/projects/0d2abcb89a52442dbecd0dc4dd7faf0a/users/d45befe87ee147b2ae291802a76a5ccf/roles/7f13f524fe7d4fd4a929550d9f95b314 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:41:46.113981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a30ec-a2c7-4800-8b6f-94977ad9ce46 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:46.114407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a30ec-a2c7-4800-8b6f-94977ad9ce46 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:46.114542 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a30ec-a2c7-4800-8b6f-94977ad9ce46 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:46.115981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 66/138] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:46.121907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28cfc5-214b-4ac0-bd6a-ea2f3d8be77c None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:46.122559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28cfc5-214b-4ac0-bd6a-ea2f3d8be77c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:46.123084 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28cfc5-214b-4ac0-bd6a-ea2f3d8be77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:46.146526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-1d28cfc5-214b-4ac0-bd6a-ea2f3d8be77c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:46.148169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-1d28cfc5-214b-4ac0-bd6a-ea2f3d8be77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:46.227843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 73/139] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:46.274762 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a30ec-a2c7-4800-8b6f-94977ad9ce46 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:46.413542 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a30ec-a2c7-4800-8b6f-94977ad9ce46 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:46.455287 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94af4-dbc8-45df-b4c9-53451bd9dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:46.456123 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94af4-dbc8-45df-b4c9-53451bd9dd75 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:46.456414 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94af4-dbc8-45df-b4c9-53451bd9dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:46.456699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94af4-dbc8-45df-b4c9-53451bd9dd75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:46.458809 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b94af4-dbc8-45df-b4c9-53451bd9dd75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:46.460316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b94af4-dbc8-45df-b4c9-53451bd9dd75 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:46.461961 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 67/140] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:46.470967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28cfc5-214b-4ac0-bd6a-ea2f3d8be77c None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:46.620485 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28cfc5-214b-4ac0-bd6a-ea2f3d8be77c None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:46.663098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac57f06-92bf-4433-b1d7-c049f4891abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:46.664270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac57f06-92bf-4433-b1d7-c049f4891abb None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:46.664801 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac57f06-92bf-4433-b1d7-c049f4891abb None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:46.665313 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac57f06-92bf-4433-b1d7-c049f4891abb None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:46.666257 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac57f06-92bf-4433-b1d7-c049f4891abb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:46.667971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac57f06-92bf-4433-b1d7-c049f4891abb None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:46.712520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 74/141] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:41:46 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:46.913978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113425bd-2192-4d1b-a11f-bfd851fded2c None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:46.914433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113425bd-2192-4d1b-a11f-bfd851fded2c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:46.914555 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113425bd-2192-4d1b-a11f-bfd851fded2c None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:46.915953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 68/142] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:46.921486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236301-2168-4f7c-ac7e-2db4013339a7 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:46.921846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236301-2168-4f7c-ac7e-2db4013339a7 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:46.922148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7236301-2168-4f7c-ac7e-2db4013339a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:46.944289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-c7236301-2168-4f7c-ac7e-2db4013339a7 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:46.945651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-c7236301-2168-4f7c-ac7e-2db4013339a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:47.029469 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 75/143] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:47.074000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113425bd-2192-4d1b-a11f-bfd851fded2c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:47.205461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113425bd-2192-4d1b-a11f-bfd851fded2c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:47.247334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3b337-791f-4ce0-9270-ec20ba4f490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:47.249876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b337-791f-4ce0-9270-ec20ba4f490d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:47.250170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b337-791f-4ce0-9270-ec20ba4f490d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:47.250453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3b337-791f-4ce0-9270-ec20ba4f490d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:47.264749 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3b337-791f-4ce0-9270-ec20ba4f490d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-2fd3b337-791f-4ce0-9270-ec20ba4f490d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:47.273115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:47.274149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:47.275088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 69/144] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:41:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:47.284938 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7236301-2168-4f7c-ac7e-2db4013339a7 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:47.416128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7236301-2168-4f7c-ac7e-2db4013339a7 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:47.448225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:47.448921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:47.449217 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:47.449507 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:47.450276 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:47.450596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:47.452064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:47.461185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 76/145] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:41:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:47.468929 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3b337-791f-4ce0-9270-ec20ba4f490d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:47.629379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3b337-791f-4ce0-9270-ec20ba4f490d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:47.668250 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289b36b-142e-4c00-a42d-1dbaa49a205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:47.669151 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289b36b-142e-4c00-a42d-1dbaa49a205e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:47.669445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289b36b-142e-4c00-a42d-1dbaa49a205e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:47.669732 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289b36b-142e-4c00-a42d-1dbaa49a205e None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:47.670964 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289b36b-142e-4c00-a42d-1dbaa49a205e None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:47.672462 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289b36b-142e-4c00-a42d-1dbaa49a205e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:47.674117 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 70/146] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:47 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:47.680540 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:47.759992 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a960-8aab-41f9-981d-285c76b125de None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:47.760364 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a960-8aab-41f9-981d-285c76b125de None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:47.760539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a960-8aab-41f9-981d-285c76b125de None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:47.762019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 71/147] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:41:47.767250 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b73ec-07f5-436f-9d02-66fd530010f1 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:47.767846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b73ec-07f5-436f-9d02-66fd530010f1 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:47.767846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b73ec-07f5-436f-9d02-66fd530010f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:47.803973 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef634b0-e0d7-499b-acde-350e30ba5fe4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:47.804808 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-d72b73ec-07f5-436f-9d02-66fd530010f1 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:47.806058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-d72b73ec-07f5-436f-9d02-66fd530010f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:47.841438 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8e614-03b7-4caa-9c19-6f370b4094b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:47.842113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8e614-03b7-4caa-9c19-6f370b4094b2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:47.842408 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8e614-03b7-4caa-9c19-6f370b4094b2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:47.842710 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8e614-03b7-4caa-9c19-6f370b4094b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:47.914018 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8e614-03b7-4caa-9c19-6f370b4094b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:47.915525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8e614-03b7-4caa-9c19-6f370b4094b2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:47.963993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 72/148] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:48.009424 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b73ec-07f5-436f-9d02-66fd530010f1 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:48.022728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 77/149] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:48.028419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8e614-03b7-4caa-9c19-6f370b4094b2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:48.133538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8e614-03b7-4caa-9c19-6f370b4094b2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:48.185059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a4c5-8103-4fa7-8aa5-06d1c43d4b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:48.186294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a4c5-8103-4fa7-8aa5-06d1c43d4b45 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.186806 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a4c5-8103-4fa7-8aa5-06d1c43d4b45 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.187568 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2a4c5-8103-4fa7-8aa5-06d1c43d4b45 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:48.190055 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2a4c5-8103-4fa7-8aa5-06d1c43d4b45 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:48.192696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2a4c5-8103-4fa7-8aa5-06d1c43d4b45 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:48.195528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 78/150] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:48 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:48.203828 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a4c5-8103-4fa7-8aa5-06d1c43d4b45 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:48.238130 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b73ec-07f5-436f-9d02-66fd530010f1 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:48.316952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff6c6-b0cf-4060-be9f-60fd3b0d4f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:48.318116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff6c6-b0cf-4060-be9f-60fd3b0d4f91 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.318623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff6c6-b0cf-4060-be9f-60fd3b0d4f91 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.319190 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff6c6-b0cf-4060-be9f-60fd3b0d4f91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:48.340650 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ff6c6-b0cf-4060-be9f-60fd3b0d4f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-cb2ff6c6-b0cf-4060-be9f-60fd3b0d4f91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:48.349615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:48.350631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:41:48.351548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:48.354410 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 73/151] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:41:48.360444 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff6c6-b0cf-4060-be9f-60fd3b0d4f91 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:48.418250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2a4c5-8103-4fa7-8aa5-06d1c43d4b45 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:48.485045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab285b-cf1f-4728-9c0c-a6294a387811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:48.485742 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab285b-cf1f-4728-9c0c-a6294a387811 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.486029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab285b-cf1f-4728-9c0c-a6294a387811 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.486312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab285b-cf1f-4728-9c0c-a6294a387811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:48.487170 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab285b-cf1f-4728-9c0c-a6294a387811 None admin] RBAC: Adding query filter params (role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=104072102c8e4dddb773192263e064ba, user.id=d45befe87ee147b2ae291802a76a5ccf) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:48.491790 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab285b-cf1f-4728-9c0c-a6294a387811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:48.491790 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab285b-cf1f-4728-9c0c-a6294a387811 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:48.501677 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 79/152] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:48 2022] GET /identity/v3/role_assignments?user.id=d45befe87ee147b2ae291802a76a5ccf&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:48.528023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03623-e8b4-4b6c-be61-68164b62a7af None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.528398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03623-e8b4-4b6c-be61-68164b62a7af None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.528596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff03623-e8b4-4b6c-be61-68164b62a7af None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:48.530365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 80/153] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:41:48.539488 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358c4d-9d43-451c-b68c-4d8190c7bfe3 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.539876 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358c4d-9d43-451c-b68c-4d8190c7bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.540091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b358c4d-9d43-451c-b68c-4d8190c7bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:48.576385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff6c6-b0cf-4060-be9f-60fd3b0d4f91 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:48.578045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-6b358c4d-9d43-451c-b68c-4d8190c7bfe3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:48.579501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-6b358c4d-9d43-451c-b68c-4d8190c7bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:48.621697 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:48.622447 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.622738 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.623027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:48.623839 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:48.624158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:48.625619 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:48.640277 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 74/154] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:48.658543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:48.730233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 81/155] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:48.765647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b358c4d-9d43-451c-b68c-4d8190c7bfe3 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:48.876309 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6784f3-bc53-486c-9bfe-51680329ac17 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:48.928957 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b358c4d-9d43-451c-b68c-4d8190c7bfe3 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:48.953438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a90f2-b8bf-470f-86ac-8f4aa807123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:48.954361 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a90f2-b8bf-470f-86ac-8f4aa807123b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.954656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a90f2-b8bf-470f-86ac-8f4aa807123b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.954941 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a90f2-b8bf-470f-86ac-8f4aa807123b None admin] PATH_INFO: `/v3/users/2adc8088b947409d95b116c6b0d48dd9` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:48.960749 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a90f2-b8bf-470f-86ac-8f4aa807123b None admin] RBAC: Authorizing `identity:get_user(user_id=2adc8088b947409d95b116c6b0d48dd9)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:48.962259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a90f2-b8bf-470f-86ac-8f4aa807123b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:48.964446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 75/156] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:48 2022] GET /identity/v3/users/2adc8088b947409d95b116c6b0d48dd9 => generated 289 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:48.965910 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350dca-939e-4b73-9aab-e37cd4cc4259 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.966201 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350dca-939e-4b73-9aab-e37cd4cc4259 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.966488 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee350dca-939e-4b73-9aab-e37cd4cc4259 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:48.967793 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 76/157] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:48.969646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350dca-939e-4b73-9aab-e37cd4cc4259 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:48.974876 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e2d44-b76b-4dff-8628-9aabf0218b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:48.975699 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e2d44-b76b-4dff-8628-9aabf0218b37 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:48.976014 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e2d44-b76b-4dff-8628-9aabf0218b37 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:48.976293 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e2d44-b76b-4dff-8628-9aabf0218b37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:49.001664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e2d44-b76b-4dff-8628-9aabf0218b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-992e2d44-b76b-4dff-8628-9aabf0218b37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:49.010399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:49.011430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:49.012413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:49.015069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 82/158] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:41:49.021304 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce95f8-263b-4a6b-b005-df45c0c3be15 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:49.021711 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce95f8-263b-4a6b-b005-df45c0c3be15 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:49.021998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce95f8-263b-4a6b-b005-df45c0c3be15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:49.068355 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-41ce95f8-263b-4a6b-b005-df45c0c3be15 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:49.070320 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-41ce95f8-263b-4a6b-b005-df45c0c3be15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:49.174135 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee350dca-939e-4b73-9aab-e37cd4cc4259 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:49.225501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 83/159] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:49.226388 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce95f8-263b-4a6b-b005-df45c0c3be15 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:49.246039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eb5ff-d05a-4b90-9ab7-a5484e0fcbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:49.246915 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eb5ff-d05a-4b90-9ab7-a5484e0fcbb5 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:49.247203 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eb5ff-d05a-4b90-9ab7-a5484e0fcbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:49.247484 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eb5ff-d05a-4b90-9ab7-a5484e0fcbb5 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:49.248848 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eb5ff-d05a-4b90-9ab7-a5484e0fcbb5 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:49.250327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eb5ff-d05a-4b90-9ab7-a5484e0fcbb5 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:49.260836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 77/160] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:48 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:49.267183 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eb5ff-d05a-4b90-9ab7-a5484e0fcbb5 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:49.419566 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce95f8-263b-4a6b-b005-df45c0c3be15 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:49.463345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16522be2-e3ed-44af-8719-4e7470d05ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:49.464057 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522be2-e3ed-44af-8719-4e7470d05ed9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:49.464342 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522be2-e3ed-44af-8719-4e7470d05ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:49.464618 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16522be2-e3ed-44af-8719-4e7470d05ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:49.465388 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16522be2-e3ed-44af-8719-4e7470d05ed9 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:49.465697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16522be2-e3ed-44af-8719-4e7470d05ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:49.467093 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16522be2-e3ed-44af-8719-4e7470d05ed9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:49.477601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eb5ff-d05a-4b90-9ab7-a5484e0fcbb5 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:49.487314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 84/161] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:49.490124 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56de78-1b61-4e1f-94e5-831a872c1ce8 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:49.490736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56de78-1b61-4e1f-94e5-831a872c1ce8 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:49.491231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56de78-1b61-4e1f-94e5-831a872c1ce8 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:49.492951 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 85/162] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:49.494012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56de78-1b61-4e1f-94e5-831a872c1ce8 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:49.526699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ed969-073a-461f-8759-f5e287b24cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:49.527614 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed969-073a-461f-8759-f5e287b24cd7 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:49.527939 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed969-073a-461f-8759-f5e287b24cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:49.528938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ed969-073a-461f-8759-f5e287b24cd7 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba/users/2adc8088b947409d95b116c6b0d48dd9/roles/a6a3e324423b44eca4bd874736714a3f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:49.533332 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ed969-073a-461f-8759-f5e287b24cd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=104072102c8e4dddb773192263e064ba, user_id=2adc8088b947409d95b116c6b0d48dd9, role_id=a6a3e324423b44eca4bd874736714a3f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:49.534814 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ed969-073a-461f-8759-f5e287b24cd7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:49.580198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 78/163] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:41:49 2022] PUT /identity/v3/projects/104072102c8e4dddb773192263e064ba/users/2adc8088b947409d95b116c6b0d48dd9/roles/a6a3e324423b44eca4bd874736714a3f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:41:49.581518 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822364-0058-418c-8fd5-bad88f0cb34b None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:49.581858 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822364-0058-418c-8fd5-bad88f0cb34b None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:49.582185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61822364-0058-418c-8fd5-bad88f0cb34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:49.618114 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-61822364-0058-418c-8fd5-bad88f0cb34b None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:49.619337 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-61822364-0058-418c-8fd5-bad88f0cb34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:49.673531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56de78-1b61-4e1f-94e5-831a872c1ce8 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:49.736748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d533-7e93-4cd2-9354-0c2d79cd969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:49.738054 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d533-7e93-4cd2-9354-0c2d79cd969f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:49.739200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d533-7e93-4cd2-9354-0c2d79cd969f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:49.739738 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d533-7e93-4cd2-9354-0c2d79cd969f None admin] PATH_INFO: `/v3/roles/member` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:49.760968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537d533-7e93-4cd2-9354-0c2d79cd969f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-c537d533-7e93-4cd2-9354-0c2d79cd969f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:49.769694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:49.770816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:49.771728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:49.781933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 86/164] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:49.783152 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d533-7e93-4cd2-9354-0c2d79cd969f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:49.854251 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 79/165] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:49.855229 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61822364-0058-418c-8fd5-bad88f0cb34b None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:49.999732 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537d533-7e93-4cd2-9354-0c2d79cd969f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:50.007929 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61822364-0058-418c-8fd5-bad88f0cb34b None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:50.047525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:50.048534 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:50.049062 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:50.049412 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:50.050320 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] RBAC: Adding query filter params (name=member) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:50.055785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:50.055785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:50.064021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 80/166] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:50.065316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:50.088487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ff30-ae6c-43fb-84d9-2af0f3f6a6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:50.089775 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ff30-ae6c-43fb-84d9-2af0f3f6a6e5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:50.090286 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ff30-ae6c-43fb-84d9-2af0f3f6a6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:50.090786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ff30-ae6c-43fb-84d9-2af0f3f6a6e5 None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:50.092296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8ff30-ae6c-43fb-84d9-2af0f3f6a6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:50.094090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8ff30-ae6c-43fb-84d9-2af0f3f6a6e5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:50.095997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 87/167] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:49 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:50.097007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ff30-ae6c-43fb-84d9-2af0f3f6a6e5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:50.190484 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab8934-5d9a-4395-9d1c-040a5b262942 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:50.235101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb97517-6636-4d6b-87cc-6dfd087aadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:50.235964 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97517-6636-4d6b-87cc-6dfd087aadc1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:50.236254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97517-6636-4d6b-87cc-6dfd087aadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:50.236532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97517-6636-4d6b-87cc-6dfd087aadc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:50.249026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb97517-6636-4d6b-87cc-6dfd087aadc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0cb97517-6636-4d6b-87cc-6dfd087aadc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:50.258743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:50.259798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:50.260755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 81/168] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:41:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:50.261508 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb97517-6636-4d6b-87cc-6dfd087aadc1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:50.318640 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ff30-ae6c-43fb-84d9-2af0f3f6a6e5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:50.367638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cffd9-2483-430e-852c-cd1b19997217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:50.368568 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cffd9-2483-430e-852c-cd1b19997217 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:50.368855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cffd9-2483-430e-852c-cd1b19997217 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:50.369134 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cffd9-2483-430e-852c-cd1b19997217 None admin] PATH_INFO: `/v3/users/d45befe87ee147b2ae291802a76a5ccf` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:50.371540 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cffd9-2483-430e-852c-cd1b19997217 None admin] RBAC: Authorizing `identity:get_user(user_id=d45befe87ee147b2ae291802a76a5ccf)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:50.373038 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cffd9-2483-430e-852c-cd1b19997217 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:50.375782 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 88/169] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:50 2022] GET /identity/v3/users/d45befe87ee147b2ae291802a76a5ccf => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:50.376594 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cffd9-2483-430e-852c-cd1b19997217 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:50.462990 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb97517-6636-4d6b-87cc-6dfd087aadc1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:50.526452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dcafa-2362-4900-993a-456df573b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:50.527041 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dcafa-2362-4900-993a-456df573b108 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:50.527379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dcafa-2362-4900-993a-456df573b108 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:50.527666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dcafa-2362-4900-993a-456df573b108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:50.564609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cffd9-2483-430e-852c-cd1b19997217 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:50.642133 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:50.642835 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:50.643127 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:50.643412 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:50.644228 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:50.644613 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:50.646033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:50.653857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dcafa-2362-4900-993a-456df573b108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:50.655347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dcafa-2362-4900-993a-456df573b108 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:50.673779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 89/170] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:50.674651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:50.860695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 82/171] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:50.861517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dcafa-2362-4900-993a-456df573b108 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:50.901986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fd8a5-266b-4857-8aa7-fe8f591dc417 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:50.972700 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9cd1a-4d73-4aa6-a60e-17a2dd539c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:50.973259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9cd1a-4d73-4aa6-a60e-17a2dd539c08 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:50.973556 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9cd1a-4d73-4aa6-a60e-17a2dd539c08 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:50.973840 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9cd1a-4d73-4aa6-a60e-17a2dd539c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.017852 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dcafa-2362-4900-993a-456df573b108 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:51.077268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9cd1a-4d73-4aa6-a60e-17a2dd539c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:51.078757 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9cd1a-4d73-4aa6-a60e-17a2dd539c08 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:51.084490 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a677-e58b-48b7-9152-7486cf27c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:51.085397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a677-e58b-48b7-9152-7486cf27c16a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.085688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a677-e58b-48b7-9152-7486cf27c16a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.085971 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8a677-e58b-48b7-9152-7486cf27c16a None admin] PATH_INFO: `/v3/users/57514b8d78af4c4d8d5b1768815c9e7b` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.087275 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8a677-e58b-48b7-9152-7486cf27c16a None admin] RBAC: Authorizing `identity:get_user(user_id=57514b8d78af4c4d8d5b1768815c9e7b)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:51.088747 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8a677-e58b-48b7-9152-7486cf27c16a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:51.090413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 83/172] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:50 2022] GET /identity/v3/users/57514b8d78af4c4d8d5b1768815c9e7b => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:51.091192 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a677-e58b-48b7-9152-7486cf27c16a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:51.182541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 90/173] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:51.184035 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9cd1a-4d73-4aa6-a60e-17a2dd539c08 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:51.290341 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9cd1a-4d73-4aa6-a60e-17a2dd539c08 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:51.303991 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8a677-e58b-48b7-9152-7486cf27c16a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:51.327044 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116723b3-1a83-4f59-b96b-5deabad2798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:51.328075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116723b3-1a83-4f59-b96b-5deabad2798d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.328603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116723b3-1a83-4f59-b96b-5deabad2798d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.329098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116723b3-1a83-4f59-b96b-5deabad2798d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.384501 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dd018-0f86-4da3-9883-32eb18f68917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:51.385502 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd018-0f86-4da3-9883-32eb18f68917 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.385863 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd018-0f86-4da3-9883-32eb18f68917 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.386216 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dd018-0f86-4da3-9883-32eb18f68917 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.387540 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dd018-0f86-4da3-9883-32eb18f68917 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:51.389111 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dd018-0f86-4da3-9883-32eb18f68917 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:51.391272 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 84/174] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:51 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:51.395811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a1cbc-81e4-42ff-9542-e86338dab6ad None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.395811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a1cbc-81e4-42ff-9542-e86338dab6ad None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.395811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a1cbc-81e4-42ff-9542-e86338dab6ad None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.395811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 85/175] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:51.402951 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a1cbc-81e4-42ff-9542-e86338dab6ad None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:51.406141 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116723b3-1a83-4f59-b96b-5deabad2798d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:51.409482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116723b3-1a83-4f59-b96b-5deabad2798d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:51.528695 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 91/176] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:51.530333 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca232b4-1c75-4518-9ce9-a93a43090e64 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.530823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca232b4-1c75-4518-9ce9-a93a43090e64 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.531283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca232b4-1c75-4518-9ce9-a93a43090e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.548380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-fca232b4-1c75-4518-9ce9-a93a43090e64 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:51.549920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-fca232b4-1c75-4518-9ce9-a93a43090e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:51.619200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 92/177] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:51.620923 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca232b4-1c75-4518-9ce9-a93a43090e64 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:51.657537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a1cbc-81e4-42ff-9542-e86338dab6ad None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:51.713003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826a0a-a546-4697-b52e-86e3704932e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:51.713903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826a0a-a546-4697-b52e-86e3704932e2 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.714189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826a0a-a546-4697-b52e-86e3704932e2 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.714470 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826a0a-a546-4697-b52e-86e3704932e2 None admin] PATH_INFO: `/v3/projects/0d2abcb89a52442dbecd0dc4dd7faf0a` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.715798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4826a0a-a546-4697-b52e-86e3704932e2 None admin] RBAC: Authorizing `identity:get_project(project_id=0d2abcb89a52442dbecd0dc4dd7faf0a)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:51.717338 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4826a0a-a546-4697-b52e-86e3704932e2 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:51.724151 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 86/178] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:51 2022] GET /identity/v3/projects/0d2abcb89a52442dbecd0dc4dd7faf0a => generated 312 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:51.725614 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826a0a-a546-4697-b52e-86e3704932e2 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:51.727992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca232b4-1c75-4518-9ce9-a93a43090e64 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:51.768493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:51.769733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.770255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.770748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.771855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] RBAC: Adding query filter params (role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=104072102c8e4dddb773192263e064ba, user.id=d45befe87ee147b2ae291802a76a5ccf) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:51.772383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:51.774072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:51.780551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 93/179] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:51 2022] GET /identity/v3/role_assignments?user.id=d45befe87ee147b2ae291802a76a5ccf&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:51.781596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:51.837922 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826a0a-a546-4697-b52e-86e3704932e2 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:51.884075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214587b7-c383-46e9-9464-8ddac42726ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:51.885016 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214587b7-c383-46e9-9464-8ddac42726ab None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.885309 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214587b7-c383-46e9-9464-8ddac42726ab None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.885586 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214587b7-c383-46e9-9464-8ddac42726ab None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.892180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a10a8-7d0a-4376-b43d-aff7beef1a3a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:51.892739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214587b7-c383-46e9-9464-8ddac42726ab None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:51.894955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214587b7-c383-46e9-9464-8ddac42726ab None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:51.897573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 87/180] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:51 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:51.898872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fdd02-e440-4067-8ac4-2a5c94638e2c None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.899165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fdd02-e440-4067-8ac4-2a5c94638e2c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.899446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fdd02-e440-4067-8ac4-2a5c94638e2c None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.900850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 88/181] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:51.901559 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fdd02-e440-4067-8ac4-2a5c94638e2c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:51.942267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dda2b-9180-4374-b88e-cbaaac2f3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:51.943589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dda2b-9180-4374-b88e-cbaaac2f3289 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.944094 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dda2b-9180-4374-b88e-cbaaac2f3289 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.944539 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dda2b-9180-4374-b88e-cbaaac2f3289 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.957743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31dda2b-9180-4374-b88e-cbaaac2f3289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-d31dda2b-9180-4374-b88e-cbaaac2f3289 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:51.966442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:51.967560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:51.968536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:51.971132 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 94/182] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:41:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:51.973306 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523de3-acd2-46da-ac28-a9eda86d4849 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:51.973884 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523de3-acd2-46da-ac28-a9eda86d4849 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:51.974371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523de3-acd2-46da-ac28-a9eda86d4849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:51.992543 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-6f523de3-acd2-46da-ac28-a9eda86d4849 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:51.994214 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-6f523de3-acd2-46da-ac28-a9eda86d4849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:52.030303 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fdd02-e440-4067-8ac4-2a5c94638e2c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.068120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 95/183] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:52.069101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2689b-3963-4214-9987-fcc8fa99521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.069546 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f523de3-acd2-46da-ac28-a9eda86d4849 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.069937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2689b-3963-4214-9987-fcc8fa99521b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.070283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2689b-3963-4214-9987-fcc8fa99521b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.070626 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2689b-3963-4214-9987-fcc8fa99521b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.071552 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2689b-3963-4214-9987-fcc8fa99521b None admin] RBAC: Adding query filter params (role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=0d2abcb89a52442dbecd0dc4dd7faf0a, user.id=d45befe87ee147b2ae291802a76a5ccf) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:52.071976 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2689b-3963-4214-9987-fcc8fa99521b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:52.073500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2689b-3963-4214-9987-fcc8fa99521b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:52.080282 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 89/184] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:51 2022] GET /identity/v3/role_assignments?user.id=d45befe87ee147b2ae291802a76a5ccf&scope.project.id=0d2abcb89a52442dbecd0dc4dd7faf0a&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:52.082121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5973b-a6d8-4ea2-8437-af41e580ccdf None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.082249 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5973b-a6d8-4ea2-8437-af41e580ccdf None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.082509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5973b-a6d8-4ea2-8437-af41e580ccdf None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.084186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 90/185] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:52.084692 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5973b-a6d8-4ea2-8437-af41e580ccdf None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.184441 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f523de3-acd2-46da-ac28-a9eda86d4849 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.201813 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5973b-a6d8-4ea2-8437-af41e580ccdf None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.226070 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaccba8-bd5f-4026-9248-b58b75f6e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.227150 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccba8-bd5f-4026-9248-b58b75f6e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.227720 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccba8-bd5f-4026-9248-b58b75f6e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.228300 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccba8-bd5f-4026-9248-b58b75f6e6c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.229385 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaccba8-bd5f-4026-9248-b58b75f6e6c5 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=104072102c8e4dddb773192263e064ba, user.id=57514b8d78af4c4d8d5b1768815c9e7b) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:52.229965 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaccba8-bd5f-4026-9248-b58b75f6e6c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:52.231723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaccba8-bd5f-4026-9248-b58b75f6e6c5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:52.240300 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 96/186] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/role_assignments?user.id=57514b8d78af4c4d8d5b1768815c9e7b&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:52.241381 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.242169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.242537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.242665 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b2c5b-01ff-4571-874a-bf92a53675db None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.242871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.243337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b2c5b-01ff-4571-874a-bf92a53675db None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.243809 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:52.244036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b2c5b-01ff-4571-874a-bf92a53675db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.244198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:52.245774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:52.256804 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 91/187] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:52.257855 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.264641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-8d0b2c5b-01ff-4571-874a-bf92a53675db None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:52.266210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-8d0b2c5b-01ff-4571-874a-bf92a53675db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:52.342687 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 97/188] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:52.344048 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b2c5b-01ff-4571-874a-bf92a53675db None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.375158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5e845-bca1-497e-8ef6-b3f6d76b793d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.412936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94211d5-74ee-49e3-969e-1b97de44a583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.413552 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94211d5-74ee-49e3-969e-1b97de44a583 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.413942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94211d5-74ee-49e3-969e-1b97de44a583 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.414383 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94211d5-74ee-49e3-969e-1b97de44a583 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.427299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94211d5-74ee-49e3-969e-1b97de44a583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a94211d5-74ee-49e3-969e-1b97de44a583 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:52.435819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:52.436934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:52.438204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 92/189] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:52.438968 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94211d5-74ee-49e3-969e-1b97de44a583 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.462817 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b2c5b-01ff-4571-874a-bf92a53675db None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.500407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b2759-4470-46f6-b2e2-3e250c023c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.501612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b2759-4470-46f6-b2e2-3e250c023c1a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.502071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b2759-4470-46f6-b2e2-3e250c023c1a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.502503 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b2759-4470-46f6-b2e2-3e250c023c1a None admin] PATH_INFO: `/v3/users/2c2b0d56cbed4c3e81ba943404c62095` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.518306 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b2759-4470-46f6-b2e2-3e250c023c1a None admin] RBAC: Authorizing `identity:get_user(user_id=2c2b0d56cbed4c3e81ba943404c62095)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:52.520784 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b2759-4470-46f6-b2e2-3e250c023c1a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:52.523137 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 98/190] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/users/2c2b0d56cbed4c3e81ba943404c62095 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:52.524142 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b2759-4470-46f6-b2e2-3e250c023c1a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.559379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94211d5-74ee-49e3-969e-1b97de44a583 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.607695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fb0d7-f5cc-4ce9-8cc6-fcda9be499b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.607695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb0d7-f5cc-4ce9-8cc6-fcda9be499b0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.608248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb0d7-f5cc-4ce9-8cc6-fcda9be499b0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.608633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb0d7-f5cc-4ce9-8cc6-fcda9be499b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.610548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fb0d7-f5cc-4ce9-8cc6-fcda9be499b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:52.612483 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fb0d7-f5cc-4ce9-8cc6-fcda9be499b0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:52.615060 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 93/191] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:52.616477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fb0d7-f5cc-4ce9-8cc6-fcda9be499b0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.651014 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b2759-4470-46f6-b2e2-3e250c023c1a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.695407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.696202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.696491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.696769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.697555 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:52.697866 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:52.699281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:52.708353 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 99/192] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:52.709152 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.737714 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fb0d7-f5cc-4ce9-8cc6-fcda9be499b0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.772323 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6dfb7-c878-44ff-9b83-827bc580a355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.772979 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6dfb7-c878-44ff-9b83-827bc580a355 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.773265 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6dfb7-c878-44ff-9b83-827bc580a355 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.773551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6dfb7-c878-44ff-9b83-827bc580a355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.813327 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64b488-0812-4fac-b2e3-669420804e91 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:52.838627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6dfb7-c878-44ff-9b83-827bc580a355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:52.840177 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6dfb7-c878-44ff-9b83-827bc580a355 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:52.844740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ace0e-b76e-4073-bcbe-4903491e9254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:52.845413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ace0e-b76e-4073-bcbe-4903491e9254 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.845702 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ace0e-b76e-4073-bcbe-4903491e9254 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.845983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ace0e-b76e-4073-bcbe-4903491e9254 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.846693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ace0e-b76e-4073-bcbe-4903491e9254 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:52.848691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ace0e-b76e-4073-bcbe-4903491e9254 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:52.868227 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 100/193] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:41:52 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:52.869721 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ace0e-b76e-4073-bcbe-4903491e9254 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.946397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 94/194] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:52.948557 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c415-a7ab-4a3b-9c04-74aeec665bb8 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:52.949099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c415-a7ab-4a3b-9c04-74aeec665bb8 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:52.949593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6c415-a7ab-4a3b-9c04-74aeec665bb8 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:52.951456 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 95/195] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:52.952570 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6c415-a7ab-4a3b-9c04-74aeec665bb8 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:52.993765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ace0e-b76e-4073-bcbe-4903491e9254 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:53.031065 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39402df-f883-49f6-b14f-6fa4e8bb316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:53.031980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39402df-f883-49f6-b14f-6fa4e8bb316d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.032266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39402df-f883-49f6-b14f-6fa4e8bb316d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.032544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39402df-f883-49f6-b14f-6fa4e8bb316d None admin] PATH_INFO: `/v3/users/2c2b0d56cbed4c3e81ba943404c62095` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.033811 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39402df-f883-49f6-b14f-6fa4e8bb316d None admin] RBAC: Authorizing `identity:get_user(user_id=2c2b0d56cbed4c3e81ba943404c62095)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:53.036059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39402df-f883-49f6-b14f-6fa4e8bb316d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:53.037778 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 101/196] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/users/2c2b0d56cbed4c3e81ba943404c62095 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:53.039024 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c831da-38eb-4e50-a57b-29050a09df62 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.039312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c831da-38eb-4e50-a57b-29050a09df62 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.039596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c831da-38eb-4e50-a57b-29050a09df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.058583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-94c831da-38eb-4e50-a57b-29050a09df62 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:53.059793 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-94c831da-38eb-4e50-a57b-29050a09df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:53.090708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6c415-a7ab-4a3b-9c04-74aeec665bb8 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:53.131840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41c95-a355-4815-8075-2c866c00ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:53.134611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41c95-a355-4815-8075-2c866c00ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.134611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41c95-a355-4815-8075-2c866c00ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.134611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41c95-a355-4815-8075-2c866c00ccd8 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.134888 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 102/197] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:53.134977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41c95-a355-4815-8075-2c866c00ccd8 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:53.135925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41c95-a355-4815-8075-2c866c00ccd8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:53.136879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c831da-38eb-4e50-a57b-29050a09df62 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:53.137644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 96/198] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:52 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:53.144576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41c95-a355-4815-8075-2c866c00ccd8 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:53.261427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41c95-a355-4815-8075-2c866c00ccd8 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:53.270767 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c831da-38eb-4e50-a57b-29050a09df62 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:53.297741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:53.298409 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.298690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.298964 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.299832 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=11cfce196d9849c1a4cc1837312570af, user.id=2c2b0d56cbed4c3e81ba943404c62095) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:53.300150 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:53.301638 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:53.307618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 97/199] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:53 2022] GET /identity/v3/role_assignments?user.id=2c2b0d56cbed4c3e81ba943404c62095&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:53.312327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:53.325349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b85f9-6d62-4e3d-9ab6-a08e8203fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:53.326037 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b85f9-6d62-4e3d-9ab6-a08e8203fb80 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.326324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b85f9-6d62-4e3d-9ab6-a08e8203fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.326609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b85f9-6d62-4e3d-9ab6-a08e8203fb80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.424939 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67ccf7-1e4c-4d14-b881-7e70e784bf77 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:53.464867 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b85f9-6d62-4e3d-9ab6-a08e8203fb80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:53.467364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b85f9-6d62-4e3d-9ab6-a08e8203fb80 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:53.473246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876037-37a9-47d6-aab1-837f5b2b60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:53.474354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876037-37a9-47d6-aab1-837f5b2b60dc None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.474643 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876037-37a9-47d6-aab1-837f5b2b60dc None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.474921 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41876037-37a9-47d6-aab1-837f5b2b60dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.493595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41876037-37a9-47d6-aab1-837f5b2b60dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-41876037-37a9-47d6-aab1-837f5b2b60dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:53.509642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:53.510986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:53.511962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 98/200] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:53.516661 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876037-37a9-47d6-aab1-837f5b2b60dc None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:53.612785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 103/201] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:53.619485 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b85f9-6d62-4e3d-9ab6-a08e8203fb80 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:53.676827 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41876037-37a9-47d6-aab1-837f5b2b60dc None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:53.719779 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:53.719779 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.719779 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.720170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.720999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:53.721313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:53.723375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:53.732483 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 99/202] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:53.741203 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:53.834338 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b85f9-6d62-4e3d-9ab6-a08e8203fb80 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:53.872347 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45409689-fde6-471b-a1b5-b33eaf929aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:53.873221 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45409689-fde6-471b-a1b5-b33eaf929aa6 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.873512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45409689-fde6-471b-a1b5-b33eaf929aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.873793 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45409689-fde6-471b-a1b5-b33eaf929aa6 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.875018 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45409689-fde6-471b-a1b5-b33eaf929aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:53.876570 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45409689-fde6-471b-a1b5-b33eaf929aa6 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:53.878363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 104/203] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:53 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:53.884737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45409689-fde6-471b-a1b5-b33eaf929aa6 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:53.906781 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd13ec0-f913-4bd2-b60b-c35484982ed9 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:53.951929 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397d3fe-2331-481e-a9b5-c35c50028c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:53.952832 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397d3fe-2331-481e-a9b5-c35c50028c31 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:53.953113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397d3fe-2331-481e-a9b5-c35c50028c31 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:53.953389 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397d3fe-2331-481e-a9b5-c35c50028c31 None admin] PATH_INFO: `/v3/users/2adc8088b947409d95b116c6b0d48dd9` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:53.954635 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397d3fe-2331-481e-a9b5-c35c50028c31 None admin] RBAC: Authorizing `identity:get_user(user_id=2adc8088b947409d95b116c6b0d48dd9)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:53.956155 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397d3fe-2331-481e-a9b5-c35c50028c31 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:53.958627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 100/204] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:53 2022] GET /identity/v3/users/2adc8088b947409d95b116c6b0d48dd9 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:53.964293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397d3fe-2331-481e-a9b5-c35c50028c31 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:54.077997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45409689-fde6-471b-a1b5-b33eaf929aa6 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:54.116557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:54.117608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:54.118117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:54.118651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:54.119705 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] RBAC: Adding query filter params (role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=11cfce196d9849c1a4cc1837312570af, user.id=2c2b0d56cbed4c3e81ba943404c62095) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:54.120279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:54.122468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:54.130316 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 105/205] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:53 2022] GET /identity/v3/role_assignments?user.id=2c2b0d56cbed4c3e81ba943404c62095&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:54.137833 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397d3fe-2331-481e-a9b5-c35c50028c31 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:54.175874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05abc56-ea0e-4f14-9cc4-f9d97c8bdf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:54.175874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05abc56-ea0e-4f14-9cc4-f9d97c8bdf85 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:54.176263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05abc56-ea0e-4f14-9cc4-f9d97c8bdf85 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:54.176263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05abc56-ea0e-4f14-9cc4-f9d97c8bdf85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:54.275966 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05abc56-ea0e-4f14-9cc4-f9d97c8bdf85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:54.277403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05abc56-ea0e-4f14-9cc4-f9d97c8bdf85 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:54.411192 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 101/206] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:41:54.417102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:54.540289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6a1b7-5509-404f-a815-e9831c374bc2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:54.579244 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6233b-aa7e-4b59-a1b7-bb373dc69b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:54.580155 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6233b-aa7e-4b59-a1b7-bb373dc69b31 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:54.580444 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6233b-aa7e-4b59-a1b7-bb373dc69b31 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:54.580722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6233b-aa7e-4b59-a1b7-bb373dc69b31 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:54.582055 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6233b-aa7e-4b59-a1b7-bb373dc69b31 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:54.583523 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6233b-aa7e-4b59-a1b7-bb373dc69b31 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:54.585622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 106/207] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:54 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:54.591155 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05abc56-ea0e-4f14-9cc4-f9d97c8bdf85 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:54.724733 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05abc56-ea0e-4f14-9cc4-f9d97c8bdf85 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:54.766882 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf3837-9c2e-4232-ad3a-915bb3721762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:54.767545 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3837-9c2e-4232-ad3a-915bb3721762 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:54.767927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3837-9c2e-4232-ad3a-915bb3721762 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:54.768211 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf3837-9c2e-4232-ad3a-915bb3721762 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:54.769160 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf3837-9c2e-4232-ad3a-915bb3721762 None admin] RBAC: Adding query filter params (role.id=a6a3e324423b44eca4bd874736714a3f, scope.project.id=104072102c8e4dddb773192263e064ba, user.id=2adc8088b947409d95b116c6b0d48dd9) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:54.769572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf3837-9c2e-4232-ad3a-915bb3721762 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:54.771362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf3837-9c2e-4232-ad3a-915bb3721762 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:54.777791 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 102/208] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:54 2022] GET /identity/v3/role_assignments?user.id=2adc8088b947409d95b116c6b0d48dd9&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=a6a3e324423b44eca4bd874736714a3f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:55.593033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd2b2-dfb4-4c62-a7af-406638a7e667 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:55.593603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd2b2-dfb4-4c62-a7af-406638a7e667 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:55.593603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dd2b2-dfb4-4c62-a7af-406638a7e667 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:55.595225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 107/209] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:55.601661 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbfef-b994-4a90-a088-31c008f90dae None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:55.601963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbfef-b994-4a90-a088-31c008f90dae None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:55.602248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbfef-b994-4a90-a088-31c008f90dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:55.619519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-0dadbfef-b994-4a90-a088-31c008f90dae None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:55.620755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-0dadbfef-b994-4a90-a088-31c008f90dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:55.696825 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 103/210] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:55.723021 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dd2b2-dfb4-4c62-a7af-406638a7e667 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:55.834049 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dd2b2-dfb4-4c62-a7af-406638a7e667 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:55.869131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd543d-4dc0-4ffe-8c7f-bbe030f48f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:55.869854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd543d-4dc0-4ffe-8c7f-bbe030f48f0b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:55.870146 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd543d-4dc0-4ffe-8c7f-bbe030f48f0b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:55.870428 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd543d-4dc0-4ffe-8c7f-bbe030f48f0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:55.871713 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd543d-4dc0-4ffe-8c7f-bbe030f48f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:55.873018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fc9f8-7efb-4d6b-a734-f6eea2bc73d4 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:55.873465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd543d-4dc0-4ffe-8c7f-bbe030f48f0b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:55.873558 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fc9f8-7efb-4d6b-a734-f6eea2bc73d4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:55.873648 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fc9f8-7efb-4d6b-a734-f6eea2bc73d4 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:55.874851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 108/211] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:55.876542 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 104/212] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:41:55.881125 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fc9f8-7efb-4d6b-a734-f6eea2bc73d4 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:55.881479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a2eb-92a3-4f65-bfdc-d78a8f4822a7 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:55.881882 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a2eb-92a3-4f65-bfdc-d78a8f4822a7 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:55.882175 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a2eb-92a3-4f65-bfdc-d78a8f4822a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:55.903876 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-cf16a2eb-92a3-4f65-bfdc-d78a8f4822a7 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:55.905382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-cf16a2eb-92a3-4f65-bfdc-d78a8f4822a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:55.981742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fc9f8-7efb-4d6b-a734-f6eea2bc73d4 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:55.988265 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 109/213] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:41:55.990011 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b3313-9ed7-4fcd-873f-61577aa260f2 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:55.990307 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b3313-9ed7-4fcd-873f-61577aa260f2 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:55.990589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b3313-9ed7-4fcd-873f-61577aa260f2 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:55.992275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 110/214] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:55.998750 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5dd66-1253-41f6-a70f-b3913b622d56 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:55.999050 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5dd66-1253-41f6-a70f-b3913b622d56 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:55.999339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5dd66-1253-41f6-a70f-b3913b622d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.017509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-92d5dd66-1253-41f6-a70f-b3913b622d56 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:56.018703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-92d5dd66-1253-41f6-a70f-b3913b622d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:56.026678 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c36a6-83b5-4798-871a-ee27c87340a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.027600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c36a6-83b5-4798-871a-ee27c87340a9 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.028081 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c36a6-83b5-4798-871a-ee27c87340a9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.028540 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c36a6-83b5-4798-871a-ee27c87340a9 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.029421 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c36a6-83b5-4798-871a-ee27c87340a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:56.031019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c36a6-83b5-4798-871a-ee27c87340a9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:56.062576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 105/215] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:41:55 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:56.062576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c36a6-83b5-4798-871a-ee27c87340a9 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.115938 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 111/216] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:56.141978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5dd66-1253-41f6-a70f-b3913b622d56 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.213226 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c36a6-83b5-4798-871a-ee27c87340a9 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:56.253444 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5dd66-1253-41f6-a70f-b3913b622d56 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:56.259179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52379b-5b87-471c-ab4d-59dbd60d721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.259718 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52379b-5b87-471c-ab4d-59dbd60d721e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.260034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52379b-5b87-471c-ab4d-59dbd60d721e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.260315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52379b-5b87-471c-ab4d-59dbd60d721e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.274033 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52379b-5b87-471c-ab4d-59dbd60d721e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ce52379b-5b87-471c-ab4d-59dbd60d721e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:56.281871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:56.283358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:56.286895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 106/217] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:41:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:56.290641 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52379b-5b87-471c-ab4d-59dbd60d721e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.305889 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb8c1-611e-4cae-a495-a8a985f44981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.306703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb8c1-611e-4cae-a495-a8a985f44981 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.306993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb8c1-611e-4cae-a495-a8a985f44981 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.307270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb8c1-611e-4cae-a495-a8a985f44981 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.319810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb8c1-611e-4cae-a495-a8a985f44981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-ebedb8c1-611e-4cae-a495-a8a985f44981 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:56.327960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:56.328971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:41:56.329920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 112/218] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:41:56.336422 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb8c1-611e-4cae-a495-a8a985f44981 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.422901 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52379b-5b87-471c-ab4d-59dbd60d721e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:56.465122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb8c1-611e-4cae-a495-a8a985f44981 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:56.471922 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.473405 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.473888 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.474384 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.475342 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:56.475879 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:56.477473 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:56.486909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 107/219] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:56.493249 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.508089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.508776 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.509063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.509415 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.510111 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:56.510421 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:56.511847 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:56.523806 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 113/220] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:56.526465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.661638 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a6f5d-58e6-4d89-aa96-6a1d2df2de66 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:56.692482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57213be4-74db-4138-abf5-547f585ebcf9 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:56.727743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e3b8-6bf2-4280-849c-46114e61f30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.728471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce6bc3-2898-49c2-bc31-331bdfe9b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.728640 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e3b8-6bf2-4280-849c-46114e61f30b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.728934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e3b8-6bf2-4280-849c-46114e61f30b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.729211 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e3b8-6bf2-4280-849c-46114e61f30b None admin] PATH_INFO: `/v3/users/0c08913084604c22a38f3b79ab093127` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.730123 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce6bc3-2898-49c2-bc31-331bdfe9b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.730600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce6bc3-2898-49c2-bc31-331bdfe9b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.731082 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce6bc3-2898-49c2-bc31-331bdfe9b4a7 None admin] PATH_INFO: `/v3/users/2c2b0d56cbed4c3e81ba943404c62095` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.736536 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce6bc3-2898-49c2-bc31-331bdfe9b4a7 None admin] RBAC: Authorizing `identity:get_user(user_id=2c2b0d56cbed4c3e81ba943404c62095)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:56.739282 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce6bc3-2898-49c2-bc31-331bdfe9b4a7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:56.741557 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 108/221] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:56 2022] GET /identity/v3/users/2c2b0d56cbed4c3e81ba943404c62095 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:56.744720 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e3b8-6bf2-4280-849c-46114e61f30b None admin] RBAC: Authorizing `identity:get_user(user_id=0c08913084604c22a38f3b79ab093127)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:56.746289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e3b8-6bf2-4280-849c-46114e61f30b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:56.747014 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce6bc3-2898-49c2-bc31-331bdfe9b4a7 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.748538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 114/222] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:56 2022] GET /identity/v3/users/0c08913084604c22a38f3b79ab093127 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:56.754086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e3b8-6bf2-4280-849c-46114e61f30b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.852004 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce6bc3-2898-49c2-bc31-331bdfe9b4a7 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:56.856171 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e3b8-6bf2-4280-849c-46114e61f30b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:56.889710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3eb21-cda2-472a-a981-ad535c83d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.891235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3eb21-cda2-472a-a981-ad535c83d4fb None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.891750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3eb21-cda2-472a-a981-ad535c83d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.892263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3eb21-cda2-472a-a981-ad535c83d4fb None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.892395 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd6d30-8b5b-487e-8ff7-976a598f2fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:56.893043 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd6d30-8b5b-487e-8ff7-976a598f2fc5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.893330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd6d30-8b5b-487e-8ff7-976a598f2fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.893612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd6d30-8b5b-487e-8ff7-976a598f2fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.895011 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3eb21-cda2-472a-a981-ad535c83d4fb None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:56.896742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3eb21-cda2-472a-a981-ad535c83d4fb None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:56.898693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 109/223] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:56 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:56.900148 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fba41c-819b-49dd-b638-3f3fffe39d63 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:56.900639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fba41c-819b-49dd-b638-3f3fffe39d63 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:56.901132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fba41c-819b-49dd-b638-3f3fffe39d63 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:56.902598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 110/224] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:56.904431 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fba41c-819b-49dd-b638-3f3fffe39d63 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:56.979495 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd6d30-8b5b-487e-8ff7-976a598f2fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:56.980947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd6d30-8b5b-487e-8ff7-976a598f2fc5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:57.025560 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fba41c-819b-49dd-b638-3f3fffe39d63 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:57.059185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f886560-0b70-4fb8-902f-0d2ae0a2a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:57.060121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f886560-0b70-4fb8-902f-0d2ae0a2a6e7 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:57.060404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f886560-0b70-4fb8-902f-0d2ae0a2a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:57.060678 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f886560-0b70-4fb8-902f-0d2ae0a2a6e7 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af/users/2c2b0d56cbed4c3e81ba943404c62095/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:57.062916 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f886560-0b70-4fb8-902f-0d2ae0a2a6e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=11cfce196d9849c1a4cc1837312570af, user_id=2c2b0d56cbed4c3e81ba943404c62095, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:57.064507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f886560-0b70-4fb8-902f-0d2ae0a2a6e7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:57.080071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 111/225] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:41:56 2022] PUT /identity/v3/projects/11cfce196d9849c1a4cc1837312570af/users/2c2b0d56cbed4c3e81ba943404c62095/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:41:57.082626 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ab8a-09d4-4bd9-a3a8-e42ace7444ef None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:57.082932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ab8a-09d4-4bd9-a3a8-e42ace7444ef None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:57.083379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ab8a-09d4-4bd9-a3a8-e42ace7444ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:57.103992 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-7574ab8a-09d4-4bd9-a3a8-e42ace7444ef None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:57.105477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-7574ab8a-09d4-4bd9-a3a8-e42ace7444ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:57.126878 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 115/226] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:41:57.133152 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd6d30-8b5b-487e-8ff7-976a598f2fc5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:57.264465 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 112/227] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:57.264800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd6d30-8b5b-487e-8ff7-976a598f2fc5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:57.316378 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574ab8a-09d4-4bd9-a3a8-e42ace7444ef None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:57.318711 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab374b6-255e-4e22-94c5-607f15704dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:57.319859 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab374b6-255e-4e22-94c5-607f15704dc8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:57.320144 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab374b6-255e-4e22-94c5-607f15704dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:57.320422 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab374b6-255e-4e22-94c5-607f15704dc8 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:57.321637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab374b6-255e-4e22-94c5-607f15704dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:57.323111 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab374b6-255e-4e22-94c5-607f15704dc8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:57.325804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 116/228] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:57 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:41:57.332582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab374b6-255e-4e22-94c5-607f15704dc8 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:57.451807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab374b6-255e-4e22-94c5-607f15704dc8 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:57.490974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:57.491690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:57.492019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:57.492298 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:57.493434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] RBAC: Adding query filter params (role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=11cfce196d9849c1a4cc1837312570af, user.id=0c08913084604c22a38f3b79ab093127) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:57.493751 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:57.494524 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574ab8a-09d4-4bd9-a3a8-e42ace7444ef None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:57.495215 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:57.502203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 117/229] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:41:57 2022] GET /identity/v3/role_assignments?user.id=0c08913084604c22a38f3b79ab093127&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:57.561320 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeb4d9-e840-45af-b116-7db9c1d60f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:57.562324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb4d9-e840-45af-b116-7db9c1d60f16 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:57.562609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb4d9-e840-45af-b116-7db9c1d60f16 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:57.562887 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeb4d9-e840-45af-b116-7db9c1d60f16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:57.584737 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caeb4d9-e840-45af-b116-7db9c1d60f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0caeb4d9-e840-45af-b116-7db9c1d60f16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:57.592959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:57.595247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:57.598038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 113/230] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:41:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:41:57.603795 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:57.790552 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ca9ba-6deb-400f-8d35-37e12c37c9e9 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:57.837330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:57.837330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:57.837330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:57.837330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:57.838139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:57.838139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:57.838139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:57.850295 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 118/231] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:41:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:57.856146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeb4d9-e840-45af-b116-7db9c1d60f16 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:57.965617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeb4d9-e840-45af-b116-7db9c1d60f16 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:58.000035 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c14f6-31aa-4c34-a2f6-2ca2a222fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:58.000934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c14f6-31aa-4c34-a2f6-2ca2a222fac0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:58.001222 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c14f6-31aa-4c34-a2f6-2ca2a222fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:58.001504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c14f6-31aa-4c34-a2f6-2ca2a222fac0 None admin] PATH_INFO: `/v3/users/2c2b0d56cbed4c3e81ba943404c62095` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:58.002727 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c14f6-31aa-4c34-a2f6-2ca2a222fac0 None admin] RBAC: Authorizing `identity:get_user(user_id=2c2b0d56cbed4c3e81ba943404c62095)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:58.005016 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c14f6-31aa-4c34-a2f6-2ca2a222fac0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:58.006986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 114/232] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:57 2022] GET /identity/v3/users/2c2b0d56cbed4c3e81ba943404c62095 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:58.012346 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:58.134067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45107d2-65ba-4758-be30-095620939a05 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:58.168128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee1c9e-7bfe-48e7-9fdd-4694bf5fed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:58.168999 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1c9e-7bfe-48e7-9fdd-4694bf5fed30 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:58.169286 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1c9e-7bfe-48e7-9fdd-4694bf5fed30 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:58.169566 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1c9e-7bfe-48e7-9fdd-4694bf5fed30 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:58.170765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee1c9e-7bfe-48e7-9fdd-4694bf5fed30 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:58.172275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee1c9e-7bfe-48e7-9fdd-4694bf5fed30 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:58.174012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 119/233] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:41:58 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:58.180023 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c14f6-31aa-4c34-a2f6-2ca2a222fac0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:58.312294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c14f6-31aa-4c34-a2f6-2ca2a222fac0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:58.358512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aeb84-07a4-4b9d-9c4e-a303e7c753dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:58.359418 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aeb84-07a4-4b9d-9c4e-a303e7c753dd None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:58.359701 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aeb84-07a4-4b9d-9c4e-a303e7c753dd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:58.360007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aeb84-07a4-4b9d-9c4e-a303e7c753dd None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af/users/2c2b0d56cbed4c3e81ba943404c62095/roles/c0ef3a26cb124115962df9d8c742f9f1` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:58.362267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aeb84-07a4-4b9d-9c4e-a303e7c753dd None admin] RBAC: Authorizing `identity:create_grant(project_id=11cfce196d9849c1a4cc1837312570af, user_id=2c2b0d56cbed4c3e81ba943404c62095, role_id=c0ef3a26cb124115962df9d8c742f9f1)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:58.363757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aeb84-07a4-4b9d-9c4e-a303e7c753dd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:58.398570 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 115/234] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:41:58 2022] PUT /identity/v3/projects/11cfce196d9849c1a4cc1837312570af/users/2c2b0d56cbed4c3e81ba943404c62095/roles/c0ef3a26cb124115962df9d8c742f9f1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:41:58.852102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474189ef-6e16-4135-b0f8-ad82cc09856e None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:58.852630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474189ef-6e16-4135-b0f8-ad82cc09856e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:58.852746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474189ef-6e16-4135-b0f8-ad82cc09856e None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:58.854328 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 120/235] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:41:58.859688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32532149-1bcf-45af-8c7c-456b3827e934 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:58.860022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32532149-1bcf-45af-8c7c-456b3827e934 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:58.860304 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32532149-1bcf-45af-8c7c-456b3827e934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:58.879677 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-32532149-1bcf-45af-8c7c-456b3827e934 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:58.880859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-32532149-1bcf-45af-8c7c-456b3827e934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:58.954168 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 116/236] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:58.982537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474189ef-6e16-4135-b0f8-ad82cc09856e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:59.116619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474189ef-6e16-4135-b0f8-ad82cc09856e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:59.151476 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3d1b6-bcd7-47b5-94d0-763a5ddbcbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:59.152308 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d1b6-bcd7-47b5-94d0-763a5ddbcbea None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:59.152593 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d1b6-bcd7-47b5-94d0-763a5ddbcbea None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:59.152876 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d1b6-bcd7-47b5-94d0-763a5ddbcbea None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:59.154057 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3d1b6-bcd7-47b5-94d0-763a5ddbcbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:59.155534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3d1b6-bcd7-47b5-94d0-763a5ddbcbea None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:59.157534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 121/237] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:59.163919 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32532149-1bcf-45af-8c7c-456b3827e934 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:59.268300 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32532149-1bcf-45af-8c7c-456b3827e934 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:59.297440 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc2bca-b700-477c-ba87-57d83cd31c19 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:59.298091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc2bca-b700-477c-ba87-57d83cd31c19 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:59.298605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc2bca-b700-477c-ba87-57d83cd31c19 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:59.304169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636f3e8-6f52-45ce-9acb-a3914620a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:59.304490 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 122/238] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:41:59.305681 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636f3e8-6f52-45ce-9acb-a3914620a081 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:59.305681 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636f3e8-6f52-45ce-9acb-a3914620a081 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:59.305681 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636f3e8-6f52-45ce-9acb-a3914620a081 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:59.306169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636f3e8-6f52-45ce-9acb-a3914620a081 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:59.307634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636f3e8-6f52-45ce-9acb-a3914620a081 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:59.307807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7909d-4665-44f2-bb37-4b97146258b6 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:59.307994 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7909d-4665-44f2-bb37-4b97146258b6 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:59.308282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7909d-4665-44f2-bb37-4b97146258b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:59.333251 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-2ef7909d-4665-44f2-bb37-4b97146258b6 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:41:59.334804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-2ef7909d-4665-44f2-bb37-4b97146258b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:41:59.356324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 117/239] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:41:59 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:41:59.426804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 123/240] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:41:59.463697 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636f3e8-6f52-45ce-9acb-a3914620a081 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:59.591231 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636f3e8-6f52-45ce-9acb-a3914620a081 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:59.627885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56ef53-1466-41f3-a646-829b342f30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:59.629356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ef53-1466-41f3-a646-829b342f30ca None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:59.629865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ef53-1466-41f3-a646-829b342f30ca None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:59.630380 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56ef53-1466-41f3-a646-829b342f30ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:59.641769 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56ef53-1466-41f3-a646-829b342f30ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-2f56ef53-1466-41f3-a646-829b342f30ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:41:59.650450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:41:59.651503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:41:59.652519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:41:59.655091 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 118/241] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:41:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:41:59.662420 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7909d-4665-44f2-bb37-4b97146258b6 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:59.777135 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7909d-4665-44f2-bb37-4b97146258b6 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:41:59.815304 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:41:59.816576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:41:59.817097 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:41:59.817614 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:41:59.818599 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] RBAC: Adding query filter params (name=reader) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:41:59.819134 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:41:59.820807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:41:59.830366 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 124/242] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:41:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:41:59.836342 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56ef53-1466-41f3-a646-829b342f30ca None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:41:59.970237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56ef53-1466-41f3-a646-829b342f30ca None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:00.009573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926b6a8-e0bf-4e4e-9114-97f8cceecfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:00.010462 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b6a8-e0bf-4e4e-9114-97f8cceecfdd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.010755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b6a8-e0bf-4e4e-9114-97f8cceecfdd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.011036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926b6a8-e0bf-4e4e-9114-97f8cceecfdd None admin] PATH_INFO: `/v3/users/85eaca925f774a1095b6d49d4ecf9781` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.027511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926b6a8-e0bf-4e4e-9114-97f8cceecfdd None admin] RBAC: Authorizing `identity:get_user(user_id=85eaca925f774a1095b6d49d4ecf9781)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:00.029043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926b6a8-e0bf-4e4e-9114-97f8cceecfdd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:00.031107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 119/243] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:41:59 2022] GET /identity/v3/users/85eaca925f774a1095b6d49d4ecf9781 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:00.036681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:00.078108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845e0d-819e-4241-9691-206da8c4b806 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.078470 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845e0d-819e-4241-9691-206da8c4b806 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.078672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845e0d-819e-4241-9691-206da8c4b806 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.080790 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 120/244] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:00.087048 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec80a-301d-4f82-ba70-78e4f3d09dff None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.087679 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec80a-301d-4f82-ba70-78e4f3d09dff None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.088221 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec80a-301d-4f82-ba70-78e4f3d09dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.110655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-0f4ec80a-301d-4f82-ba70-78e4f3d09dff None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:00.112254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-0f4ec80a-301d-4f82-ba70-78e4f3d09dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:00.166185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532ed9-1d83-43ad-a862-4e84bf684144 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:00.201982 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 121/245] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:00.202621 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfca7b-ff6c-4280-a2e1-7cfbb8f85ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:00.203479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfca7b-ff6c-4280-a2e1-7cfbb8f85ab9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.204063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfca7b-ff6c-4280-a2e1-7cfbb8f85ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.204518 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfca7b-ff6c-4280-a2e1-7cfbb8f85ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.229127 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec80a-301d-4f82-ba70-78e4f3d09dff None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:00.278722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfca7b-ff6c-4280-a2e1-7cfbb8f85ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:00.280491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfca7b-ff6c-4280-a2e1-7cfbb8f85ab9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:00.335205 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec80a-301d-4f82-ba70-78e4f3d09dff None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:00.384513 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e32d0f-eb68-4a4d-8343-1990482c6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:00.385489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 125/246] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:00.385754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32d0f-eb68-4a4d-8343-1990482c6e72 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.386042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32d0f-eb68-4a4d-8343-1990482c6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.386317 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32d0f-eb68-4a4d-8343-1990482c6e72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.387778 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a611-7648-4517-9cca-0fc4490642e3 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.388289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a611-7648-4517-9cca-0fc4490642e3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.388812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a611-7648-4517-9cca-0fc4490642e3 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.390574 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 126/247] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:00.397296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0732-2c84-4150-8774-e6252747e778 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.397890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0732-2c84-4150-8774-e6252747e778 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.398405 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0732-2c84-4150-8774-e6252747e778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.401136 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e32d0f-eb68-4a4d-8343-1990482c6e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-31e32d0f-eb68-4a4d-8343-1990482c6e72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:00.411623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:00.412940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:00.414121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:00.416612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 122/248] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:00.417568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e32d0f-eb68-4a4d-8343-1990482c6e72 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:00.438252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-3b7f0732-2c84-4150-8774-e6252747e778 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:00.440126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-3b7f0732-2c84-4150-8774-e6252747e778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:00.566287 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 127/249] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:00.567092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f0732-2c84-4150-8774-e6252747e778 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:00.603652 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e32d0f-eb68-4a4d-8343-1990482c6e72 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:00.685269 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178a1f4-0ddb-44f5-aa6a-f52f8f939967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:00.686142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178a1f4-0ddb-44f5-aa6a-f52f8f939967 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.686424 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178a1f4-0ddb-44f5-aa6a-f52f8f939967 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.686700 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178a1f4-0ddb-44f5-aa6a-f52f8f939967 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.688374 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178a1f4-0ddb-44f5-aa6a-f52f8f939967 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:00.694773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178a1f4-0ddb-44f5-aa6a-f52f8f939967 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:00.696744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 123/250] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:00 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:00.697660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178a1f4-0ddb-44f5-aa6a-f52f8f939967 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:00.743568 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f0732-2c84-4150-8774-e6252747e778 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:00.821474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:00.822518 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.823046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.823554 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.824547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:00.825064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:00.826696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:00.835792 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178a1f4-0ddb-44f5-aa6a-f52f8f939967 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:00.847418 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 128/251] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:00.848645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:00.875950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ba06f-5cb4-4d44-819f-83e80ff73334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:00.876883 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba06f-5cb4-4d44-819f-83e80ff73334 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:00.877076 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba06f-5cb4-4d44-819f-83e80ff73334 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:00.877321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba06f-5cb4-4d44-819f-83e80ff73334 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:00.902893 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ba06f-5cb4-4d44-819f-83e80ff73334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-e66ba06f-5cb4-4d44-819f-83e80ff73334 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:00.917544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:00.918656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:00.919577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 124/252] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:00.925293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ba06f-5cb4-4d44-819f-83e80ff73334 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:00.999925 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45813f-e6d8-41d8-a6bc-861c89b8c0f2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:01.041040 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:01.041818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:01.042046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:01.042328 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:01.043226 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] RBAC: Adding query filter params (role.id=a6a3e324423b44eca4bd874736714a3f, scope.project.id=11cfce196d9849c1a4cc1837312570af, user.id=85eaca925f774a1095b6d49d4ecf9781) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:01.043544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:01.045187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:01.052580 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 129/253] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:00 2022] GET /identity/v3/role_assignments?user.id=85eaca925f774a1095b6d49d4ecf9781&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=a6a3e324423b44eca4bd874736714a3f => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:01.053738 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:01.191434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935158e-1249-40d2-9700-9550b91dc130 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:01.202632 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ba06f-5cb4-4d44-819f-83e80ff73334 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:01.234026 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:01.235008 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:01.235453 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:01.235928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:01.237327 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:01.238098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:01.239833 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:01.249768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 130/254] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:01.259427 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:01.286226 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e485f-5510-41fd-8eb5-aed2eb7cb422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:01.287130 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e485f-5510-41fd-8eb5-aed2eb7cb422 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:01.287416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e485f-5510-41fd-8eb5-aed2eb7cb422 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:01.287696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e485f-5510-41fd-8eb5-aed2eb7cb422 None admin] PATH_INFO: `/v3/users/2c2b0d56cbed4c3e81ba943404c62095` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:01.290431 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e485f-5510-41fd-8eb5-aed2eb7cb422 None admin] RBAC: Authorizing `identity:get_user(user_id=2c2b0d56cbed4c3e81ba943404c62095)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:01.292866 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e485f-5510-41fd-8eb5-aed2eb7cb422 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:01.296053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 125/255] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:00 2022] GET /identity/v3/users/2c2b0d56cbed4c3e81ba943404c62095 => generated 283 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:01.301080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e485f-5510-41fd-8eb5-aed2eb7cb422 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:01.451473 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e485f-5510-41fd-8eb5-aed2eb7cb422 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:01.471512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9633fe-0bf2-42b3-b2b7-c06e490665f0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:01.493004 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa9e46-954c-409b-bab1-a1ca964c755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:01.493672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9e46-954c-409b-bab1-a1ca964c755d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:01.493958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9e46-954c-409b-bab1-a1ca964c755d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:01.494236 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa9e46-954c-409b-bab1-a1ca964c755d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:01.554016 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d73-9351-413b-a159-1327f00b1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:01.554907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d73-9351-413b-a159-1327f00b1025 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:01.555191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d73-9351-413b-a159-1327f00b1025 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:01.555466 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d73-9351-413b-a159-1327f00b1025 None admin] PATH_INFO: `/v3/users/0c08913084604c22a38f3b79ab093127` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:01.556879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99d73-9351-413b-a159-1327f00b1025 None admin] RBAC: Authorizing `identity:get_user(user_id=0c08913084604c22a38f3b79ab093127)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:01.559605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99d73-9351-413b-a159-1327f00b1025 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:01.563158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 131/256] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:01 2022] GET /identity/v3/users/0c08913084604c22a38f3b79ab093127 => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:01.569331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d73-9351-413b-a159-1327f00b1025 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:01.588952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa9e46-954c-409b-bab1-a1ca964c755d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:01.590533 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa9e46-954c-409b-bab1-a1ca964c755d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:01.690222 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d73-9351-413b-a159-1327f00b1025 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:01.724759 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb62f-ec5e-4e71-a908-0464cce5f683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:01.725558 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb62f-ec5e-4e71-a908-0464cce5f683 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:01.725840 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb62f-ec5e-4e71-a908-0464cce5f683 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:01.726113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb62f-ec5e-4e71-a908-0464cce5f683 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:01.727308 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb62f-ec5e-4e71-a908-0464cce5f683 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:01.728949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb62f-ec5e-4e71-a908-0464cce5f683 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:01.732065 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 132/257] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:01 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:01.732209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc96510-a779-4bd0-88d4-65d241ca5312 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:01.732531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc96510-a779-4bd0-88d4-65d241ca5312 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:01.732871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc96510-a779-4bd0-88d4-65d241ca5312 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:01.734442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 133/258] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:01.740973 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc96510-a779-4bd0-88d4-65d241ca5312 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:01.805330 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 126/259] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:01.806656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59c03a-2b81-43cc-9020-36b56da719b1 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:01.806950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59c03a-2b81-43cc-9020-36b56da719b1 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:01.807234 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59c03a-2b81-43cc-9020-36b56da719b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:01.839584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-4f59c03a-2b81-43cc-9020-36b56da719b1 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:01.842346 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-4f59c03a-2b81-43cc-9020-36b56da719b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:01.934672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc96510-a779-4bd0-88d4-65d241ca5312 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:01.951066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 127/260] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:01.952542 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59c03a-2b81-43cc-9020-36b56da719b1 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:02.000310 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f5539-9dde-4aa7-b965-7909277888e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:02.001610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5539-9dde-4aa7-b965-7909277888e8 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:02.001911 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5539-9dde-4aa7-b965-7909277888e8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:02.002486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f5539-9dde-4aa7-b965-7909277888e8 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af/users/0c08913084604c22a38f3b79ab093127/roles/7f13f524fe7d4fd4a929550d9f95b314` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:02.005499 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f5539-9dde-4aa7-b965-7909277888e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=11cfce196d9849c1a4cc1837312570af, user_id=0c08913084604c22a38f3b79ab093127, role_id=7f13f524fe7d4fd4a929550d9f95b314)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:02.006990 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f5539-9dde-4aa7-b965-7909277888e8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:02.025712 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 134/261] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:42:01 2022] PUT /identity/v3/projects/11cfce196d9849c1a4cc1837312570af/users/0c08913084604c22a38f3b79ab093127/roles/7f13f524fe7d4fd4a929550d9f95b314 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:02.027330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f5539-9dde-4aa7-b965-7909277888e8 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:02.167093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59c03a-2b81-43cc-9020-36b56da719b1 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:02.196690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f5539-9dde-4aa7-b965-7909277888e8 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:02.238902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af3e9e-2b94-448a-8861-223b875a3dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:02.240696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3e9e-2b94-448a-8861-223b875a3dc3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:02.241209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3e9e-2b94-448a-8861-223b875a3dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:02.241729 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af3e9e-2b94-448a-8861-223b875a3dc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:02.258083 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b24f0-8aa0-4652-814f-30ca2f6c8f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:02.259825 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b24f0-8aa0-4652-814f-30ca2f6c8f92 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:02.260336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b24f0-8aa0-4652-814f-30ca2f6c8f92 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:02.261379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b24f0-8aa0-4652-814f-30ca2f6c8f92 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:02.263394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af3e9e-2b94-448a-8861-223b875a3dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:02.264385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b24f0-8aa0-4652-814f-30ca2f6c8f92 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:02.273219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b24f0-8aa0-4652-814f-30ca2f6c8f92 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:02.275610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 128/262] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:01 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-17af3e9e-2b94-448a-8861-223b875a3dc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:02.278125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:02.279191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:02.280158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 135/263] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:42:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:02.288949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af3e9e-2b94-448a-8861-223b875a3dc3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:02.289169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b24f0-8aa0-4652-814f-30ca2f6c8f92 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:02.423233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af3e9e-2b94-448a-8861-223b875a3dc3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:02.430595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b24f0-8aa0-4652-814f-30ca2f6c8f92 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:02.468539 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:02.469248 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:02.469524 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:02.469832 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:02.470585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:02.470895 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:02.473168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:02.482734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 136/264] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:02.484158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:02.485042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:02.485473 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:02.485907 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:02.486989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=11cfce196d9849c1a4cc1837312570af, user.id=2c2b0d56cbed4c3e81ba943404c62095) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:02.487465 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:02.488220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:02.489377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:02.502079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 129/265] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:02 2022] GET /identity/v3/role_assignments?user.id=2c2b0d56cbed4c3e81ba943404c62095&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:02.665305 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433124e-0ecf-4fd4-8a63-026312cc16a0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:02.713080 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fd921-7e5e-4e62-9a1e-74d415f471dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:02.713968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd921-7e5e-4e62-9a1e-74d415f471dd None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:02.714251 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd921-7e5e-4e62-9a1e-74d415f471dd None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:02.714525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd921-7e5e-4e62-9a1e-74d415f471dd None admin] PATH_INFO: `/v3/users/2c2b0d56cbed4c3e81ba943404c62095` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:02.715728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fd921-7e5e-4e62-9a1e-74d415f471dd None admin] RBAC: Authorizing `identity:get_user(user_id=2c2b0d56cbed4c3e81ba943404c62095)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:02.717217 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fd921-7e5e-4e62-9a1e-74d415f471dd None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:02.718857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 137/266] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:02 2022] GET /identity/v3/users/2c2b0d56cbed4c3e81ba943404c62095 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:02.725415 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:02.883670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886260d2-82bd-4291-8a21-4713dd1e2647 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:02.932510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e233-c859-463f-ba00-79276b38f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:02.933195 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e233-c859-463f-ba00-79276b38f69f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:02.933481 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e233-c859-463f-ba00-79276b38f69f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:02.933759 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e233-c859-463f-ba00-79276b38f69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.003107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e233-c859-463f-ba00-79276b38f69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:03.005238 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e233-c859-463f-ba00-79276b38f69f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:03.100531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c5805-4c63-469e-9b01-d750aa39ff88 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.100871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c5805-4c63-469e-9b01-d750aa39ff88 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.101091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c5805-4c63-469e-9b01-d750aa39ff88 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.102805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 138/267] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:03.113718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdedf8-a82e-4ff6-a853-6d93da92d15b None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.114001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdedf8-a82e-4ff6-a853-6d93da92d15b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.114282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdedf8-a82e-4ff6-a853-6d93da92d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.128932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 130/268] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:03.139908 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e233-c859-463f-ba00-79276b38f69f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:03.144883 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-66bdedf8-a82e-4ff6-a853-6d93da92d15b None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:03.146083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-66bdedf8-a82e-4ff6-a853-6d93da92d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:03.247183 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 139/269] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:03.281613 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdedf8-a82e-4ff6-a853-6d93da92d15b None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:03.297058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e233-c859-463f-ba00-79276b38f69f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:03.337691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059caec-2523-4e1f-a03e-101640fa3aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:03.338924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059caec-2523-4e1f-a03e-101640fa3aa9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.339417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059caec-2523-4e1f-a03e-101640fa3aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.340032 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059caec-2523-4e1f-a03e-101640fa3aa9 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.341447 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059caec-2523-4e1f-a03e-101640fa3aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:03.343091 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059caec-2523-4e1f-a03e-101640fa3aa9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:03.345411 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 131/270] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:03 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:03.346870 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86e402-ce70-4f8e-8d48-de526f0692d5 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.347397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86e402-ce70-4f8e-8d48-de526f0692d5 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.347916 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86e402-ce70-4f8e-8d48-de526f0692d5 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.349395 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 132/271] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:03.356093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86e402-ce70-4f8e-8d48-de526f0692d5 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:03.406711 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdedf8-a82e-4ff6-a853-6d93da92d15b None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:03.444024 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12571b9f-1729-4e6a-a298-bfdd2d218836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:03.445289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571b9f-1729-4e6a-a298-bfdd2d218836 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.447241 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571b9f-1729-4e6a-a298-bfdd2d218836 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.447755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12571b9f-1729-4e6a-a298-bfdd2d218836 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.449256 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12571b9f-1729-4e6a-a298-bfdd2d218836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:03.450936 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12571b9f-1729-4e6a-a298-bfdd2d218836 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:03.453161 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 140/272] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:03.454679 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7c68-e648-46c7-8bbb-89ec9ddcc67c None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.455218 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7c68-e648-46c7-8bbb-89ec9ddcc67c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.455719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7c68-e648-46c7-8bbb-89ec9ddcc67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.474652 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-95ee7c68-e648-46c7-8bbb-89ec9ddcc67c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:03.476237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-95ee7c68-e648-46c7-8bbb-89ec9ddcc67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:03.484745 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86e402-ce70-4f8e-8d48-de526f0692d5 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:03.531345 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:03.532022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.532304 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.532579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.533953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] RBAC: Adding query filter params (role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=11cfce196d9849c1a4cc1837312570af, user.id=2c2b0d56cbed4c3e81ba943404c62095) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:03.534898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:03.536766 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:03.552079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 133/274] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:03 2022] GET /identity/v3/role_assignments?user.id=2c2b0d56cbed4c3e81ba943404c62095&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:03.552458 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 141/274] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:03.555786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:03.575048 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee7c68-e648-46c7-8bbb-89ec9ddcc67c None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:03.711263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee7c68-e648-46c7-8bbb-89ec9ddcc67c None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:03.753835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f90fc-7104-41ff-977c-60740c7d940f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:03.766181 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2167c93-7478-433b-b044-a8b2b6b0ad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:03.767006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2167c93-7478-433b-b044-a8b2b6b0ad23 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.767293 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2167c93-7478-433b-b044-a8b2b6b0ad23 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.767580 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2167c93-7478-433b-b044-a8b2b6b0ad23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.792838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2167c93-7478-433b-b044-a8b2b6b0ad23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-e2167c93-7478-433b-b044-a8b2b6b0ad23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:03.804583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:03.805698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:03.806626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:03.812804 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6332a-99e5-45fe-9bf6-d50e55acd71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:03.813498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6332a-99e5-45fe-9bf6-d50e55acd71a None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.813780 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6332a-99e5-45fe-9bf6-d50e55acd71a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.814054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6332a-99e5-45fe-9bf6-d50e55acd71a None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.814787 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6332a-99e5-45fe-9bf6-d50e55acd71a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:03.816303 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6332a-99e5-45fe-9bf6-d50e55acd71a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:03.818259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 142/275] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:03.819255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2167c93-7478-433b-b044-a8b2b6b0ad23 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:03.855530 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 134/276] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:42:03 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:03.950050 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2167c93-7478-433b-b044-a8b2b6b0ad23 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:03.994968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2a7f8-70d3-4ebf-b564-0233720fe62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:03.995658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a7f8-70d3-4ebf-b564-0233720fe62c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:03.995974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a7f8-70d3-4ebf-b564-0233720fe62c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:03.996250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2a7f8-70d3-4ebf-b564-0233720fe62c None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:03.997911 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2a7f8-70d3-4ebf-b564-0233720fe62c None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:03.998219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2a7f8-70d3-4ebf-b564-0233720fe62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:03.999644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2a7f8-70d3-4ebf-b564-0233720fe62c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:04.010284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 143/277] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:04.015923 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6332a-99e5-45fe-9bf6-d50e55acd71a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:04.120968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b646c64-d598-46d7-90d9-5e1c07b02e27 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:04.121177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b646c64-d598-46d7-90d9-5e1c07b02e27 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:04.121436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b646c64-d598-46d7-90d9-5e1c07b02e27 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:04.123088 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 144/278] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:04.128464 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31166307-3b9f-4331-8837-68bef39b62c5 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:04.128860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31166307-3b9f-4331-8837-68bef39b62c5 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:04.129265 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31166307-3b9f-4331-8837-68bef39b62c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:04.147481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-31166307-3b9f-4331-8837-68bef39b62c5 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:04.148708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-31166307-3b9f-4331-8837-68bef39b62c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:04.168935 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6332a-99e5-45fe-9bf6-d50e55acd71a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:04.207309 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7916e9-2ada-45b8-94e5-c66a9f340697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:04.208237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7916e9-2ada-45b8-94e5-c66a9f340697 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:04.208529 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7916e9-2ada-45b8-94e5-c66a9f340697 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:04.208809 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7916e9-2ada-45b8-94e5-c66a9f340697 None admin] PATH_INFO: `/v3/users/39727fa810e14e6385762835844987ac` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:04.221136 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 145/279] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:04.224646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7916e9-2ada-45b8-94e5-c66a9f340697 None admin] RBAC: Authorizing `identity:get_user(user_id=39727fa810e14e6385762835844987ac)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:04.226426 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7916e9-2ada-45b8-94e5-c66a9f340697 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:04.228770 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 135/280] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:04 2022] GET /identity/v3/users/39727fa810e14e6385762835844987ac => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:04.234692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31166307-3b9f-4331-8837-68bef39b62c5 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:04.248642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7916e9-2ada-45b8-94e5-c66a9f340697 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:04.367071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31166307-3b9f-4331-8837-68bef39b62c5 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:04.389630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7916e9-2ada-45b8-94e5-c66a9f340697 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:04.408000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:04.408975 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:04.409368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:04.409651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:04.410849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] RBAC: Adding query filter params (role.id=7f13f524fe7d4fd4a929550d9f95b314, user.id=39727fa810e14e6385762835844987ac, scope.system=all) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:04.411464 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:04.413000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:04.420371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 146/281] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:42:04 2022] GET /identity/v3/role_assignments?user.id=39727fa810e14e6385762835844987ac&scope.system=all&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:04.432989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024a80d-4a96-41dc-ba70-b9c5d760042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:04.433821 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024a80d-4a96-41dc-ba70-b9c5d760042d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:04.434107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024a80d-4a96-41dc-ba70-b9c5d760042d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:04.434385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024a80d-4a96-41dc-ba70-b9c5d760042d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:04.447732 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024a80d-4a96-41dc-ba70-b9c5d760042d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-1024a80d-4a96-41dc-ba70-b9c5d760042d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:04.456071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:04.458092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:04.459468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 136/282] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:04.464058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:04.586251 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd3dc1-90b6-431e-b440-588b9f208afd None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:04.637237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:04.637946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:04.638239 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:04.638525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:04.639367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:04.639742 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:04.641185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:04.654033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 147/283] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:04.660743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024a80d-4a96-41dc-ba70-b9c5d760042d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:04.767411 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024a80d-4a96-41dc-ba70-b9c5d760042d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:04.801854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308b8b1-6cda-4aca-b362-48f7971b8522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:04.802749 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308b8b1-6cda-4aca-b362-48f7971b8522 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:04.803036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308b8b1-6cda-4aca-b362-48f7971b8522 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:04.803317 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308b8b1-6cda-4aca-b362-48f7971b8522 None admin] PATH_INFO: `/v3/users/85eaca925f774a1095b6d49d4ecf9781` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:04.804566 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308b8b1-6cda-4aca-b362-48f7971b8522 None admin] RBAC: Authorizing `identity:get_user(user_id=85eaca925f774a1095b6d49d4ecf9781)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:04.806027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308b8b1-6cda-4aca-b362-48f7971b8522 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:04.812418 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 137/284] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:04 2022] GET /identity/v3/users/85eaca925f774a1095b6d49d4ecf9781 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:04.813930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:04.917033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfaf65-3b55-41b9-aa8e-063c8379a3b7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:04.965029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ec523-e9e2-4619-b569-79dabbf3fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:04.965974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec523-e9e2-4619-b569-79dabbf3fc1d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:04.966271 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec523-e9e2-4619-b569-79dabbf3fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:04.966554 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec523-e9e2-4619-b569-79dabbf3fc1d None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:04.967812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ec523-e9e2-4619-b569-79dabbf3fc1d None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:04.969279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ec523-e9e2-4619-b569-79dabbf3fc1d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:04.971007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 148/285] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:04 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:04.977781 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308b8b1-6cda-4aca-b362-48f7971b8522 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:05.092131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308b8b1-6cda-4aca-b362-48f7971b8522 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:05.135925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40f87c-2017-428e-820e-a4445b86264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:05.136916 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f87c-2017-428e-820e-a4445b86264b None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:05.137209 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f87c-2017-428e-820e-a4445b86264b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:05.137543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f87c-2017-428e-820e-a4445b86264b None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af/users/85eaca925f774a1095b6d49d4ecf9781/roles/a6a3e324423b44eca4bd874736714a3f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:05.145069 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40f87c-2017-428e-820e-a4445b86264b None admin] RBAC: Authorizing `identity:create_grant(project_id=11cfce196d9849c1a4cc1837312570af, user_id=85eaca925f774a1095b6d49d4ecf9781, role_id=a6a3e324423b44eca4bd874736714a3f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:05.146602 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40f87c-2017-428e-820e-a4445b86264b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:05.174472 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 138/286] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:42:04 2022] PUT /identity/v3/projects/11cfce196d9849c1a4cc1837312570af/users/85eaca925f774a1095b6d49d4ecf9781/roles/a6a3e324423b44eca4bd874736714a3f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:05.289394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e1ffc-2630-48ca-85b6-aefc6e60a85e None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:05.289748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e1ffc-2630-48ca-85b6-aefc6e60a85e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:05.289959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e1ffc-2630-48ca-85b6-aefc6e60a85e None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:05.291357 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 149/287] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:05.297149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860316-db26-4b9f-9fdf-213c9745c5bd None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:05.297642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860316-db26-4b9f-9fdf-213c9745c5bd None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:05.298106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91860316-db26-4b9f-9fdf-213c9745c5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:05.316797 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-91860316-db26-4b9f-9fdf-213c9745c5bd None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:05.318377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-91860316-db26-4b9f-9fdf-213c9745c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:05.398431 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 139/288] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:05.421007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e1ffc-2630-48ca-85b6-aefc6e60a85e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:05.532615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e1ffc-2630-48ca-85b6-aefc6e60a85e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:05.569901 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b887-749e-40de-aa8a-4df6bcbb3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:05.570763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b887-749e-40de-aa8a-4df6bcbb3eb3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:05.571058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b887-749e-40de-aa8a-4df6bcbb3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:05.571335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b887-749e-40de-aa8a-4df6bcbb3eb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:05.582501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862b887-749e-40de-aa8a-4df6bcbb3eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-1862b887-749e-40de-aa8a-4df6bcbb3eb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:05.590748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:05.593203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:05.595340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:05.597512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 150/289] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:05.603805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91860316-db26-4b9f-9fdf-213c9745c5bd None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:05.702626 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91860316-db26-4b9f-9fdf-213c9745c5bd None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:05.740019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:05.740711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:05.740999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:05.741279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:05.742054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:05.742366 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:05.743797 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:05.758474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 140/290] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:05.759995 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b887-749e-40de-aa8a-4df6bcbb3eb3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:05.868232 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b887-749e-40de-aa8a-4df6bcbb3eb3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:05.904129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747660c3-c026-4e23-9bd7-32db55effe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:05.905020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747660c3-c026-4e23-9bd7-32db55effe6c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:05.905311 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747660c3-c026-4e23-9bd7-32db55effe6c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:05.905590 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747660c3-c026-4e23-9bd7-32db55effe6c None admin] PATH_INFO: `/v3/users/0c08913084604c22a38f3b79ab093127` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:05.906814 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747660c3-c026-4e23-9bd7-32db55effe6c None admin] RBAC: Authorizing `identity:get_user(user_id=0c08913084604c22a38f3b79ab093127)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:05.908329 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747660c3-c026-4e23-9bd7-32db55effe6c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:05.914972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 151/291] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:05 2022] GET /identity/v3/users/0c08913084604c22a38f3b79ab093127 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:05.916376 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:06.022125 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1473d7-2de1-4e1e-a058-f39c5f8f78f4 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:06.057121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545887-7026-442d-8116-a7ae634e7931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:06.057785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545887-7026-442d-8116-a7ae634e7931 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:06.058075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545887-7026-442d-8116-a7ae634e7931 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:06.058359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545887-7026-442d-8116-a7ae634e7931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:06.127554 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77545887-7026-442d-8116-a7ae634e7931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:06.129515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77545887-7026-442d-8116-a7ae634e7931 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:06.263374 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 141/292] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:06.270070 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747660c3-c026-4e23-9bd7-32db55effe6c None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:06.429863 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747660c3-c026-4e23-9bd7-32db55effe6c None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:06.470932 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b815-7fe6-44e3-a766-f0c33343c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:06.472467 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b815-7fe6-44e3-a766-f0c33343c308 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:06.472758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b815-7fe6-44e3-a766-f0c33343c308 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:06.473033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b815-7fe6-44e3-a766-f0c33343c308 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:06.474348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b815-7fe6-44e3-a766-f0c33343c308 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:06.475836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b815-7fe6-44e3-a766-f0c33343c308 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:06.477557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 152/293] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:06 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:06.483539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545887-7026-442d-8116-a7ae634e7931 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:06.658862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545887-7026-442d-8116-a7ae634e7931 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:06.704618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8f89-2b10-4ca2-8ed4-fd55e100c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:06.705495 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8f89-2b10-4ca2-8ed4-fd55e100c953 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:06.705912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8f89-2b10-4ca2-8ed4-fd55e100c953 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:06.706850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8f89-2b10-4ca2-8ed4-fd55e100c953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:06.708199 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8f89-2b10-4ca2-8ed4-fd55e100c953 None admin] RBAC: Adding query filter params (role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=11cfce196d9849c1a4cc1837312570af, user.id=0c08913084604c22a38f3b79ab093127) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:06.708670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8f89-2b10-4ca2-8ed4-fd55e100c953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:06.710885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8f89-2b10-4ca2-8ed4-fd55e100c953 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:06.726257 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 142/294] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:06 2022] GET /identity/v3/role_assignments?user.id=0c08913084604c22a38f3b79ab093127&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:07.107365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93910-61b2-4023-947b-9015772fe462 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.107731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93910-61b2-4023-947b-9015772fe462 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.108142 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93910-61b2-4023-947b-9015772fe462 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.110402 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 153/295] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:07.116864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0bd8f-cab2-4105-8745-02912eee44df None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.117157 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0bd8f-cab2-4105-8745-02912eee44df None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.117503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0bd8f-cab2-4105-8745-02912eee44df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.139678 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-79a0bd8f-cab2-4105-8745-02912eee44df None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:07.140899 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-79a0bd8f-cab2-4105-8745-02912eee44df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:07.172993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c204f-3947-42bc-80b1-5dc9657d1bd1 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.172993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c204f-3947-42bc-80b1-5dc9657d1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.172993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c204f-3947-42bc-80b1-5dc9657d1bd1 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.174226 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 154/296] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:07.179643 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ac1b-33fe-41e7-b165-f56037ee2c84 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.179959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ac1b-33fe-41e7-b165-f56037ee2c84 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.180492 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ac1b-33fe-41e7-b165-f56037ee2c84 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.181802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 155/297] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:07.183085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a23f-3083-48ca-a415-7428267facf5 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.183592 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a23f-3083-48ca-a415-7428267facf5 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.184118 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a23f-3083-48ca-a415-7428267facf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.203672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-e811a23f-3083-48ca-a415-7428267facf5 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:07.205225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-e811a23f-3083-48ca-a415-7428267facf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:07.230660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 143/298] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:07.232339 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009309-e65e-4c7e-a555-07ba424352d9 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.232871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009309-e65e-4c7e-a555-07ba424352d9 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.233361 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009309-e65e-4c7e-a555-07ba424352d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.250543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-77009309-e65e-4c7e-a555-07ba424352d9 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:07.252071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-77009309-e65e-4c7e-a555-07ba424352d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:07.277292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 156/299] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:07.280849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811a23f-3083-48ca-a415-7428267facf5 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.319640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 144/300] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:07.320656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009309-e65e-4c7e-a555-07ba424352d9 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.393269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811a23f-3083-48ca-a415-7428267facf5 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:07.418833 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009309-e65e-4c7e-a555-07ba424352d9 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:07.427871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279172a-6466-481e-8b3a-ce3837896104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:07.428682 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279172a-6466-481e-8b3a-ce3837896104 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.428968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279172a-6466-481e-8b3a-ce3837896104 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.429245 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279172a-6466-481e-8b3a-ce3837896104 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.439515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279172a-6466-481e-8b3a-ce3837896104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-1279172a-6466-481e-8b3a-ce3837896104 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:07.448110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:07.449301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:07.450361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:07.454107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 157/301] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:07.455074 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279172a-6466-481e-8b3a-ce3837896104 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.456931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd626e5-6045-4d88-a001-078d2af0931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:07.457765 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd626e5-6045-4d88-a001-078d2af0931a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.458046 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd626e5-6045-4d88-a001-078d2af0931a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.458319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd626e5-6045-4d88-a001-078d2af0931a None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.468620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd626e5-6045-4d88-a001-078d2af0931a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-dbd626e5-6045-4d88-a001-078d2af0931a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:07.476497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:07.477519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:07.478438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 145/302] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:07.479228 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd626e5-6045-4d88-a001-078d2af0931a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.559966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279172a-6466-481e-8b3a-ce3837896104 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:07.585169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd626e5-6045-4d88-a001-078d2af0931a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:07.596483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a1cd-1a36-455a-be19-243eaffd6de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:07.598052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a1cd-1a36-455a-be19-243eaffd6de2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.598339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a1cd-1a36-455a-be19-243eaffd6de2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.598621 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a1cd-1a36-455a-be19-243eaffd6de2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.599846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8a1cd-1a36-455a-be19-243eaffd6de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:07.601310 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8a1cd-1a36-455a-be19-243eaffd6de2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:07.607825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 158/303] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:07.608683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a1cd-1a36-455a-be19-243eaffd6de2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.618732 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:07.619406 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.619689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.620758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:07.621063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:07.622440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:07.630549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 146/304] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:07.631330 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.715578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a1cd-1a36-455a-be19-243eaffd6de2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:07.734559 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d7e90-886e-4ccb-82ff-76f58043aa5c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:07.751506 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:07.752212 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.752500 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.752779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.754180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:07.754806 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:07.756515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:07.765356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 159/305] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:07.766482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.771924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80a82-5853-4c3c-bfa2-232b13f22d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:07.772603 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80a82-5853-4c3c-bfa2-232b13f22d1a None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.772885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80a82-5853-4c3c-bfa2-232b13f22d1a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.773887 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c80a82-5853-4c3c-bfa2-232b13f22d1a None admin] PATH_INFO: `/v3/groups` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.773887 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c80a82-5853-4c3c-bfa2-232b13f22d1a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:07.775261 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c80a82-5853-4c3c-bfa2-232b13f22d1a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:07.791498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 147/306] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 9 15:42:07 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:07.792363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80a82-5853-4c3c-bfa2-232b13f22d1a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.916300 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c80a82-5853-4c3c-bfa2-232b13f22d1a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:07.920954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a3f59-ae6c-4716-a597-73cb19c930f3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:07.968023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e141b45-4eb5-4a4f-ab58-26be1f9789ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:07.968842 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e141b45-4eb5-4a4f-ab58-26be1f9789ed None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.969122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e141b45-4eb5-4a4f-ab58-26be1f9789ed None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.969396 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e141b45-4eb5-4a4f-ab58-26be1f9789ed None admin] PATH_INFO: `/v3/users/2bee47bac83b4427a053667472fa0cee` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.974449 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80b882-d69d-4835-97f9-288a60e37b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:07.975706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80b882-d69d-4835-97f9-288a60e37b48 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:07.976290 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80b882-d69d-4835-97f9-288a60e37b48 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:07.976796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80b882-d69d-4835-97f9-288a60e37b48 None admin] PATH_INFO: `/v3/users/39727fa810e14e6385762835844987ac` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:07.978888 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80b882-d69d-4835-97f9-288a60e37b48 None admin] RBAC: Authorizing `identity:get_user(user_id=39727fa810e14e6385762835844987ac)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:07.981058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80b882-d69d-4835-97f9-288a60e37b48 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:07.984253 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 148/307] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:07 2022] GET /identity/v3/users/39727fa810e14e6385762835844987ac => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:07.984972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e141b45-4eb5-4a4f-ab58-26be1f9789ed None admin] RBAC: Authorizing `identity:get_user(user_id=2bee47bac83b4427a053667472fa0cee)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:07.986474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e141b45-4eb5-4a4f-ab58-26be1f9789ed None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:07.991794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 160/308] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:07 2022] GET /identity/v3/users/2bee47bac83b4427a053667472fa0cee => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:07.993366 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80b882-d69d-4835-97f9-288a60e37b48 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:07.994951 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e141b45-4eb5-4a4f-ab58-26be1f9789ed None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:08.113659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e141b45-4eb5-4a4f-ab58-26be1f9789ed None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:08.113915 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80b882-d69d-4835-97f9-288a60e37b48 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:08.148521 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904f453-dbda-4432-9cdb-2bbc640207d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:08.149192 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f453-dbda-4432-9cdb-2bbc640207d5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:08.149479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f453-dbda-4432-9cdb-2bbc640207d5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:08.149621 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658b55c-3d79-4825-86ac-db3f8064dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:08.149817 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904f453-dbda-4432-9cdb-2bbc640207d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:08.150444 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658b55c-3d79-4825-86ac-db3f8064dd2c None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:08.150728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658b55c-3d79-4825-86ac-db3f8064dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:08.150892 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904f453-dbda-4432-9cdb-2bbc640207d5 None admin] RBAC: Adding query filter params (role.id=a6a3e324423b44eca4bd874736714a3f, user.id=2bee47bac83b4427a053667472fa0cee, scope.system=all) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:08.151006 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658b55c-3d79-4825-86ac-db3f8064dd2c None admin] PATH_INFO: `/v3/system/users/39727fa810e14e6385762835844987ac/roles/7f13f524fe7d4fd4a929550d9f95b314` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:08.151238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904f453-dbda-4432-9cdb-2bbc640207d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:08.152577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658b55c-3d79-4825-86ac-db3f8064dd2c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39727fa810e14e6385762835844987ac, role_id=7f13f524fe7d4fd4a929550d9f95b314)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:08.152691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904f453-dbda-4432-9cdb-2bbc640207d5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:08.153950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658b55c-3d79-4825-86ac-db3f8064dd2c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:08.160038 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 161/309] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:42:07 2022] GET /identity/v3/role_assignments?user.id=2bee47bac83b4427a053667472fa0cee&scope.system=all&role.id=a6a3e324423b44eca4bd874736714a3f => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:08.161045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4faa62-f6cd-41d6-a28d-5cf8e19cde40 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:08.161339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4faa62-f6cd-41d6-a28d-5cf8e19cde40 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:08.161622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4faa62-f6cd-41d6-a28d-5cf8e19cde40 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:08.163085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 162/310] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:08.169041 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6ccb4-e619-4cf1-be9c-17403331e90b None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:08.169410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6ccb4-e619-4cf1-be9c-17403331e90b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:08.169673 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6ccb4-e619-4cf1-be9c-17403331e90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:08.174125 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 149/311] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 9 15:42:07 2022] PUT /identity/v3/system/users/39727fa810e14e6385762835844987ac/roles/7f13f524fe7d4fd4a929550d9f95b314 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:42:08.201231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-15d6ccb4-e619-4cf1-be9c-17403331e90b None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:08.203299 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-15d6ccb4-e619-4cf1-be9c-17403331e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:08.293767 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 163/312] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:08.319362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658b55c-3d79-4825-86ac-db3f8064dd2c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:08.439217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658b55c-3d79-4825-86ac-db3f8064dd2c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:08.476233 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c505c-4633-4b58-9505-d559aa5a9283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:08.477378 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c505c-4633-4b58-9505-d559aa5a9283 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:08.477862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c505c-4633-4b58-9505-d559aa5a9283 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:08.478335 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c505c-4633-4b58-9505-d559aa5a9283 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:08.490367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c505c-4633-4b58-9505-d559aa5a9283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-2e6c505c-4633-4b58-9505-d559aa5a9283 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:08.498580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:08.499653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:08.500720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:08.507892 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 150/313] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:08.510434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6ccb4-e619-4cf1-be9c-17403331e90b None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:08.619944 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6ccb4-e619-4cf1-be9c-17403331e90b None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:08.656539 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:08.657519 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:08.657971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:08.658421 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:08.659985 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] RBAC: Adding query filter params (name=reader) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:08.660570 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:08.662132 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:08.671653 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 164/314] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:08.678665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c505c-4633-4b58-9505-d559aa5a9283 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:08.791183 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c505c-4633-4b58-9505-d559aa5a9283 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:08.829282 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c398b-dea9-4c8c-9d08-b1a563f3dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:08.830174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c398b-dea9-4c8c-9d08-b1a563f3dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:08.830457 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c398b-dea9-4c8c-9d08-b1a563f3dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:08.830737 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c398b-dea9-4c8c-9d08-b1a563f3dbe0 None admin] PATH_INFO: `/v3/users/85eaca925f774a1095b6d49d4ecf9781` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:08.834289 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c398b-dea9-4c8c-9d08-b1a563f3dbe0 None admin] RBAC: Authorizing `identity:get_user(user_id=85eaca925f774a1095b6d49d4ecf9781)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:08.836015 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c398b-dea9-4c8c-9d08-b1a563f3dbe0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:08.838220 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 151/315] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:08 2022] GET /identity/v3/users/85eaca925f774a1095b6d49d4ecf9781 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:08.843794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:08.949641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeabaeb-ae62-44b9-9055-21d61d67527f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:08.984695 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f694f7e-7cee-44c8-aed3-8a51449ed2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:08.985769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694f7e-7cee-44c8-aed3-8a51449ed2b9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:08.986293 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694f7e-7cee-44c8-aed3-8a51449ed2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:08.986783 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694f7e-7cee-44c8-aed3-8a51449ed2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:09.062851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f694f7e-7cee-44c8-aed3-8a51449ed2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:09.064741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f694f7e-7cee-44c8-aed3-8a51449ed2b9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:09.170786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 165/316] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:09.180904 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c398b-dea9-4c8c-9d08-b1a563f3dbe0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:09.289255 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c398b-dea9-4c8c-9d08-b1a563f3dbe0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:09.324812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7bb54-b370-447f-b4a3-33c943d31e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:09.326070 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7bb54-b370-447f-b4a3-33c943d31e27 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:09.326586 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7bb54-b370-447f-b4a3-33c943d31e27 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:09.327090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7bb54-b370-447f-b4a3-33c943d31e27 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:09.328531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7bb54-b370-447f-b4a3-33c943d31e27 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:09.330205 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7bb54-b370-447f-b4a3-33c943d31e27 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:09.333395 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 152/317] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:09 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:09.339375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f694f7e-7cee-44c8-aed3-8a51449ed2b9 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:09.444011 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f694f7e-7cee-44c8-aed3-8a51449ed2b9 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:09.481386 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa9399-04b9-458b-aa18-aa847a5293e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:09.482482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa9399-04b9-458b-aa18-aa847a5293e2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:09.483053 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa9399-04b9-458b-aa18-aa847a5293e2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:09.483549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa9399-04b9-458b-aa18-aa847a5293e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:09.484636 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa9399-04b9-458b-aa18-aa847a5293e2 None admin] RBAC: Adding query filter params (role.id=a6a3e324423b44eca4bd874736714a3f, scope.project.id=11cfce196d9849c1a4cc1837312570af, user.id=85eaca925f774a1095b6d49d4ecf9781) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:09.485184 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa9399-04b9-458b-aa18-aa847a5293e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:09.486855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa9399-04b9-458b-aa18-aa847a5293e2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:09.493606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 166/318] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:09 2022] GET /identity/v3/role_assignments?user.id=85eaca925f774a1095b6d49d4ecf9781&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=a6a3e324423b44eca4bd874736714a3f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:10.319893 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdc101-6a70-471d-88db-ef18254b5dd6 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.320422 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdc101-6a70-471d-88db-ef18254b5dd6 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.320506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdc101-6a70-471d-88db-ef18254b5dd6 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.321983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 153/319] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:10.327065 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4628-3db5-400c-8bf9-9c0ca61bb3da None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.327455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4628-3db5-400c-8bf9-9c0ca61bb3da None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.327631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4628-3db5-400c-8bf9-9c0ca61bb3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.344600 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-84fa4628-3db5-400c-8bf9-9c0ca61bb3da None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:10.345806 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-84fa4628-3db5-400c-8bf9-9c0ca61bb3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:10.415313 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 167/320] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:10.439181 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdc101-6a70-471d-88db-ef18254b5dd6 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:10.540249 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdc101-6a70-471d-88db-ef18254b5dd6 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:10.594996 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be85fb-1d34-4ce0-aef6-5717cb4ef19f None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.595372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be85fb-1d34-4ce0-aef6-5717cb4ef19f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.595564 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be85fb-1d34-4ce0-aef6-5717cb4ef19f None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.595830 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea79c54-6fe0-43cf-a440-fb95c358ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:10.596856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea79c54-6fe0-43cf-a440-fb95c358ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.597406 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea79c54-6fe0-43cf-a440-fb95c358ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.597608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 168/321] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:10.597717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea79c54-6fe0-43cf-a440-fb95c358ceb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.599510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea79c54-6fe0-43cf-a440-fb95c358ceb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:10.600505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6ae82-0b6c-4325-9ac6-55dc9f3f7540 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.600803 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6ae82-0b6c-4325-9ac6-55dc9f3f7540 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.600993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea79c54-6fe0-43cf-a440-fb95c358ceb6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:10.601098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6ae82-0b6c-4325-9ac6-55dc9f3f7540 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.602365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 169/322] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:10.607017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 154/323] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:10.607187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfcbac-b39a-400a-b0f7-aae1702b5239 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.607187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfcbac-b39a-400a-b0f7-aae1702b5239 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.607187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfcbac-b39a-400a-b0f7-aae1702b5239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.607885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634757-6c57-4e96-90cd-d8d5f058a786 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.608178 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634757-6c57-4e96-90cd-d8d5f058a786 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.608458 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634757-6c57-4e96-90cd-d8d5f058a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.621104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-02cfcbac-b39a-400a-b0f7-aae1702b5239 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:10.622300 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-02cfcbac-b39a-400a-b0f7-aae1702b5239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:10.624674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-d0634757-6c57-4e96-90cd-d8d5f058a786 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:10.625839 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-d0634757-6c57-4e96-90cd-d8d5f058a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:10.688760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 170/324] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:10.689739 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfcbac-b39a-400a-b0f7-aae1702b5239 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:10.694003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 155/325] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:10.712599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634757-6c57-4e96-90cd-d8d5f058a786 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:10.788732 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfcbac-b39a-400a-b0f7-aae1702b5239 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:10.809249 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634757-6c57-4e96-90cd-d8d5f058a786 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:10.821538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023742a-16fd-48fe-a859-667782ccb097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:10.822235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023742a-16fd-48fe-a859-667782ccb097 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.822517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023742a-16fd-48fe-a859-667782ccb097 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.822792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023742a-16fd-48fe-a859-667782ccb097 None admin] PATH_INFO: `/v3/groups` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.823475 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023742a-16fd-48fe-a859-667782ccb097 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:10.824940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023742a-16fd-48fe-a859-667782ccb097 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:10.840374 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 171/326] 10.222.0.32 () {60 vars in 1134 bytes} [Mon May 9 15:42:10 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:10.841195 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023742a-16fd-48fe-a859-667782ccb097 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:10.844538 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f70a7-b2bb-44a8-a405-05a29ee18198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:10.845436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f70a7-b2bb-44a8-a405-05a29ee18198 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:10.845795 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f70a7-b2bb-44a8-a405-05a29ee18198 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:10.846170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f70a7-b2bb-44a8-a405-05a29ee18198 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:10.858593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f70a7-b2bb-44a8-a405-05a29ee18198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-7a3f70a7-b2bb-44a8-a405-05a29ee18198 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:10.867029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:10.868247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:10.869179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 156/327] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:10.874281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f70a7-b2bb-44a8-a405-05a29ee18198 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:10.963567 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023742a-16fd-48fe-a859-667782ccb097 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:10.987226 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f70a7-b2bb-44a8-a405-05a29ee18198 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:11.001075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97511adb-8d57-49bf-9813-a036dc3d071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:11.001887 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97511adb-8d57-49bf-9813-a036dc3d071f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:11.002170 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97511adb-8d57-49bf-9813-a036dc3d071f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:11.002445 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97511adb-8d57-49bf-9813-a036dc3d071f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:11.014209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97511adb-8d57-49bf-9813-a036dc3d071f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-97511adb-8d57-49bf-9813-a036dc3d071f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:11.022565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:11.023718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:11.024771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 172/328] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:11.026250 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:11.026883 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:11.027126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:11.027469 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:11.028357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:11.028673 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:11.030081 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:11.032003 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97511adb-8d57-49bf-9813-a036dc3d071f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:11.044315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 157/329] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:11.045712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:11.152597 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3089c-1812-4b3c-bd02-3ebdbcdd17d4 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:11.154030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97511adb-8d57-49bf-9813-a036dc3d071f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:11.189901 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48333e-cf24-44f8-842d-4296ae60ec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:11.191885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48333e-cf24-44f8-842d-4296ae60ec99 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:11.192371 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48333e-cf24-44f8-842d-4296ae60ec99 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:11.192857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48333e-cf24-44f8-842d-4296ae60ec99 None admin] PATH_INFO: `/v3/users/39727fa810e14e6385762835844987ac` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:11.194324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48333e-cf24-44f8-842d-4296ae60ec99 None admin] RBAC: Authorizing `identity:get_user(user_id=39727fa810e14e6385762835844987ac)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:11.196418 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48333e-cf24-44f8-842d-4296ae60ec99 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:11.198449 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 158/330] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:11 2022] GET /identity/v3/users/39727fa810e14e6385762835844987ac => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:11.204814 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48333e-cf24-44f8-842d-4296ae60ec99 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:11.205247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:11.206736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:11.207043 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:11.207325 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:11.208169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] RBAC: Adding query filter params (name=reader) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:11.208484 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:11.209901 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:11.220835 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 173/331] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:11.230770 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:11.321693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48333e-cf24-44f8-842d-4296ae60ec99 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:11.356363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:11.357027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:11.357313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:11.357591 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:11.358430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] RBAC: Adding query filter params (role.id=7f13f524fe7d4fd4a929550d9f95b314, user.id=39727fa810e14e6385762835844987ac, scope.system=all) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:11.358739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:11.360207 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:11.363347 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c619-87ce-4163-a27c-0fcf0fb1d454 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:11.373575 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 159/332] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:42:11 2022] GET /identity/v3/role_assignments?user.id=39727fa810e14e6385762835844987ac&scope.system=all&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:11.403141 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe5ce-a18d-416b-a98c-11e7a729fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:11.404130 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe5ce-a18d-416b-a98c-11e7a729fc83 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:11.404415 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe5ce-a18d-416b-a98c-11e7a729fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:11.404691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe5ce-a18d-416b-a98c-11e7a729fc83 None admin] PATH_INFO: `/v3/users/2bee47bac83b4427a053667472fa0cee` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:11.406002 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fe5ce-a18d-416b-a98c-11e7a729fc83 None admin] RBAC: Authorizing `identity:get_user(user_id=2bee47bac83b4427a053667472fa0cee)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:11.407541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fe5ce-a18d-416b-a98c-11e7a729fc83 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:11.410032 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 174/333] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:11 2022] GET /identity/v3/users/2bee47bac83b4427a053667472fa0cee => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:11.416095 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:11.531965 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78cbd4-54b9-476f-8765-d11c8fc2dedd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:11.570107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53986e2-8953-43b4-b6c6-18509b38c190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:11.570994 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53986e2-8953-43b4-b6c6-18509b38c190 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:11.571278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53986e2-8953-43b4-b6c6-18509b38c190 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:11.571556 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53986e2-8953-43b4-b6c6-18509b38c190 None admin] PATH_INFO: `/v3/system/users/2bee47bac83b4427a053667472fa0cee/roles/a6a3e324423b44eca4bd874736714a3f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:11.573142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53986e2-8953-43b4-b6c6-18509b38c190 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2bee47bac83b4427a053667472fa0cee, role_id=a6a3e324423b44eca4bd874736714a3f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:11.574556 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53986e2-8953-43b4-b6c6-18509b38c190 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:11.585439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 160/334] 10.222.0.32 () {58 vars in 1334 bytes} [Mon May 9 15:42:11 2022] PUT /identity/v3/system/users/2bee47bac83b4427a053667472fa0cee/roles/a6a3e324423b44eca4bd874736714a3f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:13.568201 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd700d-0576-47c0-be1c-219bd789ea97 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:13.569316 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd700d-0576-47c0-be1c-219bd789ea97 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:13.569834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd700d-0576-47c0-be1c-219bd789ea97 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:13.571731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 175/335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:13.579136 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871351-a18c-4260-9d7d-6b39c9d668bf None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:13.580115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871351-a18c-4260-9d7d-6b39c9d668bf None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:13.580654 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871351-a18c-4260-9d7d-6b39c9d668bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:13.590160 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2085532-9274-44a3-b990-81caf809c7e5 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:13.590814 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2085532-9274-44a3-b990-81caf809c7e5 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:13.591322 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2085532-9274-44a3-b990-81caf809c7e5 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:13.592985 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 176/336] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:13.598841 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c34c2-ae08-4cfb-b784-5cce082333f8 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:13.599142 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c34c2-ae08-4cfb-b784-5cce082333f8 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:13.599414 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c34c2-ae08-4cfb-b784-5cce082333f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:13.613432 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-4d871351-a18c-4260-9d7d-6b39c9d668bf None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:13.615095 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-4d871351-a18c-4260-9d7d-6b39c9d668bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:13.629477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-6f0c34c2-ae08-4cfb-b784-5cce082333f8 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:13.630750 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-6f0c34c2-ae08-4cfb-b784-5cce082333f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:13.726488 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 177/337] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:13.741414 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 161/338] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:13.767632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c34c2-ae08-4cfb-b784-5cce082333f8 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:13.777620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871351-a18c-4260-9d7d-6b39c9d668bf None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:13.928207 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c34c2-ae08-4cfb-b784-5cce082333f8 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:13.956529 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871351-a18c-4260-9d7d-6b39c9d668bf None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:13.983826 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a3951-1a0d-4425-b4a0-8f43acb48dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:13.983826 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a3951-1a0d-4425-b4a0-8f43acb48dac None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:13.983826 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a3951-1a0d-4425-b4a0-8f43acb48dac None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:13.983826 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a3951-1a0d-4425-b4a0-8f43acb48dac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:14.001899 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a3951-1a0d-4425-b4a0-8f43acb48dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-958a3951-1a0d-4425-b4a0-8f43acb48dac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:14.015465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:14.016807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:14.017854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 178/339] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:42:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:14.023405 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a3951-1a0d-4425-b4a0-8f43acb48dac None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:14.029053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0637-595e-4731-a71b-3c87ea2be2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:14.029888 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0637-595e-4731-a71b-3c87ea2be2e8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:14.030179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0637-595e-4731-a71b-3c87ea2be2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:14.030460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0637-595e-4731-a71b-3c87ea2be2e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:14.053876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c0637-595e-4731-a71b-3c87ea2be2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ed1c0637-595e-4731-a71b-3c87ea2be2e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:14.066773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:14.069158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:14.071403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:14.073086 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 162/340] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:14.081572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0637-595e-4731-a71b-3c87ea2be2e8 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:14.157497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a3951-1a0d-4425-b4a0-8f43acb48dac None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:14.205567 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:14.206533 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:14.206886 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:14.207111 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:14.208117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:14.208446 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:14.209869 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:14.215177 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0637-595e-4731-a71b-3c87ea2be2e8 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:14.223321 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 179/341] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:14.228977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:14.252075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:14.254458 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:14.254925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:14.255379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:14.256353 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] RBAC: Adding query filter params (name=member) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:14.256840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:14.259235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:14.271308 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 163/342] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:14.278006 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:14.358513 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a75b63-fb82-43ab-8842-573c7681b9cc None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:14.419052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795bec9-eeee-40e6-8642-1c1e5b00c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:14.419721 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795bec9-eeee-40e6-8642-1c1e5b00c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:14.420035 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795bec9-eeee-40e6-8642-1c1e5b00c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:14.420315 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795bec9-eeee-40e6-8642-1c1e5b00c6c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:14.443741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc0658-2e38-49fe-87bb-fe98c1f08e64 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:14.508485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a19c-29c1-4255-8ce6-a816cb002321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:14.509225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a19c-29c1-4255-8ce6-a816cb002321 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:14.509517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a19c-29c1-4255-8ce6-a816cb002321 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:14.509800 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3a19c-29c1-4255-8ce6-a816cb002321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:14.539653 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795bec9-eeee-40e6-8642-1c1e5b00c6c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:14.541170 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795bec9-eeee-40e6-8642-1c1e5b00c6c4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:14.637648 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3a19c-29c1-4255-8ce6-a816cb002321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:14.639130 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3a19c-29c1-4255-8ce6-a816cb002321 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:14.725817 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 180/343] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:14.727185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e9aa-2224-4753-a9b0-570ef61cc098 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:14.727478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e9aa-2224-4753-a9b0-570ef61cc098 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:14.727758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e9aa-2224-4753-a9b0-570ef61cc098 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:14.730002 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 181/344] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:14.738224 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb410-7cd6-45aa-a8fb-0c361931bd40 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:14.738519 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb410-7cd6-45aa-a8fb-0c361931bd40 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:14.738789 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb410-7cd6-45aa-a8fb-0c361931bd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:14.765524 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-909fb410-7cd6-45aa-a8fb-0c361931bd40 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:14.766651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-909fb410-7cd6-45aa-a8fb-0c361931bd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:14.830427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 164/345] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:42:14.832861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a19c-29c1-4255-8ce6-a816cb002321 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:14.901162 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 182/346] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:14.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fb410-7cd6-45aa-a8fb-0c361931bd40 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.022901 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3a19c-29c1-4255-8ce6-a816cb002321 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.064717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe7a2-b3e3-49fe-bd28-a9616954a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.066330 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe7a2-b3e3-49fe-bd28-a9616954a5ec None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.066850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe7a2-b3e3-49fe-bd28-a9616954a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.067386 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfe7a2-b3e3-49fe-bd28-a9616954a5ec None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.067658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fb410-7cd6-45aa-a8fb-0c361931bd40 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.069298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe7a2-b3e3-49fe-bd28-a9616954a5ec None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:15.072002 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfe7a2-b3e3-49fe-bd28-a9616954a5ec None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:15.074377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 165/347] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:14 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:15.075406 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe7a2-b3e3-49fe-bd28-a9616954a5ec None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.119695 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1d53e-f427-4cfb-afc6-a623e1d89b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.120603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d53e-f427-4cfb-afc6-a623e1d89b6c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.120893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d53e-f427-4cfb-afc6-a623e1d89b6c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.121234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1d53e-f427-4cfb-afc6-a623e1d89b6c None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.122515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1d53e-f427-4cfb-afc6-a623e1d89b6c None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:15.124405 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1d53e-f427-4cfb-afc6-a623e1d89b6c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:15.126338 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 183/348] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:14 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:15.127657 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820ddf-07c9-478e-a80d-d22ea44a2db3 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.128001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820ddf-07c9-478e-a80d-d22ea44a2db3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.128610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee820ddf-07c9-478e-a80d-d22ea44a2db3 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.129876 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 184/349] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:15.130998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820ddf-07c9-478e-a80d-d22ea44a2db3 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.214563 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfe7a2-b3e3-49fe-bd28-a9616954a5ec None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.247592 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee820ddf-07c9-478e-a80d-d22ea44a2db3 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.258480 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948135e-a21c-43ef-b482-36601d2ae900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.259674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948135e-a21c-43ef-b482-36601d2ae900 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.260262 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948135e-a21c-43ef-b482-36601d2ae900 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.260770 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948135e-a21c-43ef-b482-36601d2ae900 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.282666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948135e-a21c-43ef-b482-36601d2ae900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:15.290004 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ca701-387f-4bf3-95fc-9afc9303d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.290887 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ca701-387f-4bf3-95fc-9afc9303d1af None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-5948135e-a21c-43ef-b482-36601d2ae900 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:15.291140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:15.292179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:15.293116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:15.293831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ca701-387f-4bf3-95fc-9afc9303d1af None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.293831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ca701-387f-4bf3-95fc-9afc9303d1af None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.299803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 166/350] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:15.301461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecb229-6a0b-4c81-861e-79209668b425 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.301751 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecb229-6a0b-4c81-861e-79209668b425 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.302032 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecb229-6a0b-4c81-861e-79209668b425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.302279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ca701-387f-4bf3-95fc-9afc9303d1af None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:15.304827 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ca701-387f-4bf3-95fc-9afc9303d1af None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:15.306708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 185/351] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:15.309958 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ca701-387f-4bf3-95fc-9afc9303d1af None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.324601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-b0ecb229-6a0b-4c81-861e-79209668b425 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:15.326198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-b0ecb229-6a0b-4c81-861e-79209668b425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:15.401619 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 167/352] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:15.403005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecb229-6a0b-4c81-861e-79209668b425 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.428913 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ca701-387f-4bf3-95fc-9afc9303d1af None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.467332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2ef5-f6c1-4788-8e32-a58f0719e1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.468237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2ef5-f6c1-4788-8e32-a58f0719e1a1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.468525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2ef5-f6c1-4788-8e32-a58f0719e1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.468804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd2ef5-f6c1-4788-8e32-a58f0719e1a1 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.470000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd2ef5-f6c1-4788-8e32-a58f0719e1a1 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:15.472772 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd2ef5-f6c1-4788-8e32-a58f0719e1a1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:15.474775 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 186/353] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:15.475574 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2ef5-f6c1-4788-8e32-a58f0719e1a1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.512938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecb229-6a0b-4c81-861e-79209668b425 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.557064 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.557992 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.558378 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.558756 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.560156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:15.560579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:15.562690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:15.577016 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 168/354] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:15.577862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.618290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd2ef5-f6c1-4788-8e32-a58f0719e1a1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.663709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.664467 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.664755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.665535 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.665928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] RBAC: Adding query filter params (group.id=d4bd990c9ec54595890b2014dbe63931, role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=104072102c8e4dddb773192263e064ba) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:15.666248 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:15.667704 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:15.673570 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 187/355] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/role_assignments?group.id=d4bd990c9ec54595890b2014dbe63931&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:15.675148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.713485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e562-5b9b-48d3-907e-2931ea5c1aa1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.753236 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570853c-f503-4709-b638-a2cc5ac2cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.754379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570853c-f503-4709-b638-a2cc5ac2cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.755451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570853c-f503-4709-b638-a2cc5ac2cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.756071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570853c-f503-4709-b638-a2cc5ac2cbb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.772693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570853c-f503-4709-b638-a2cc5ac2cbb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-4570853c-f503-4709-b638-a2cc5ac2cbb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:15.784625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:15.785944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 169/356] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:15.786857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570853c-f503-4709-b638-a2cc5ac2cbb6 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.824268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815d7e-c34c-4df6-a034-0e318b22d3c7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:15.867258 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec4f71-af40-4132-a5cf-a117061f5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:15.868167 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4f71-af40-4132-a5cf-a117061f5873 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.868566 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4f71-af40-4132-a5cf-a117061f5873 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.868948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4f71-af40-4132-a5cf-a117061f5873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.869964 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec4f71-af40-4132-a5cf-a117061f5873 None admin] RBAC: Adding query filter params (group.id=d4bd990c9ec54595890b2014dbe63931, role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=104072102c8e4dddb773192263e064ba) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:15.870290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec4f71-af40-4132-a5cf-a117061f5873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:15.871811 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec4f71-af40-4132-a5cf-a117061f5873 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:15.879155 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 188/357] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/role_assignments?group.id=d4bd990c9ec54595890b2014dbe63931&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:15.879997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35709-1d2e-43d9-aa3b-b122d4e8aee8 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:15.880296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35709-1d2e-43d9-aa3b-b122d4e8aee8 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:15.880581 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d35709-1d2e-43d9-aa3b-b122d4e8aee8 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:15.883023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 189/358] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:15.883945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35709-1d2e-43d9-aa3b-b122d4e8aee8 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:15.965911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570853c-f503-4709-b638-a2cc5ac2cbb6 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:16.029705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18167a6e-21a3-43aa-beae-ab38d8023eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:16.030385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167a6e-21a3-43aa-beae-ab38d8023eef None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.030674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167a6e-21a3-43aa-beae-ab38d8023eef None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.030957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167a6e-21a3-43aa-beae-ab38d8023eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.061727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d35709-1d2e-43d9-aa3b-b122d4e8aee8 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:16.105645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275b355-4514-494b-a0cc-da21b29fdcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:16.106246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275b355-4514-494b-a0cc-da21b29fdcc2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.106532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275b355-4514-494b-a0cc-da21b29fdcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.106860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275b355-4514-494b-a0cc-da21b29fdcc2 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.107618 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275b355-4514-494b-a0cc-da21b29fdcc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:16.108001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275b355-4514-494b-a0cc-da21b29fdcc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:16.109422 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275b355-4514-494b-a0cc-da21b29fdcc2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:16.111161 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18167a6e-21a3-43aa-beae-ab38d8023eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:16.113244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18167a6e-21a3-43aa-beae-ab38d8023eef None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:16.120591 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 190/359] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:16.121917 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b9fd4-4180-4963-af49-70d415084a3b None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.122208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b9fd4-4180-4963-af49-70d415084a3b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.122486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b9fd4-4180-4963-af49-70d415084a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.141307 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-214b9fd4-4180-4963-af49-70d415084a3b None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:16.142599 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-214b9fd4-4180-4963-af49-70d415084a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:16.228758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 191/360] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:16.229637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b9fd4-4180-4963-af49-70d415084a3b None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:16.241262 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 170/361] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:16.246911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18167a6e-21a3-43aa-beae-ab38d8023eef None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:16.346179 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b9fd4-4180-4963-af49-70d415084a3b None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:16.385595 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4995bff-2e0a-4808-871c-88c076bfc045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:16.386404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4995bff-2e0a-4808-871c-88c076bfc045 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.386689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4995bff-2e0a-4808-871c-88c076bfc045 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.386967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4995bff-2e0a-4808-871c-88c076bfc045 None admin] PATH_INFO: `/v3/users/2bee47bac83b4427a053667472fa0cee` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.388238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4995bff-2e0a-4808-871c-88c076bfc045 None admin] RBAC: Authorizing `identity:get_user(user_id=2bee47bac83b4427a053667472fa0cee)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:16.389693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4995bff-2e0a-4808-871c-88c076bfc045 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:16.391666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 192/362] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:42:16 2022] GET /identity/v3/users/2bee47bac83b4427a053667472fa0cee => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:16.395085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18167a6e-21a3-43aa-beae-ab38d8023eef None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:16.396009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4995bff-2e0a-4808-871c-88c076bfc045 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:16.434340 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588bcd5-91a9-4353-a2e6-05151fb9ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:16.435219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bcd5-91a9-4353-a2e6-05151fb9ad1d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.435508 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bcd5-91a9-4353-a2e6-05151fb9ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.435805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588bcd5-91a9-4353-a2e6-05151fb9ad1d None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.437284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588bcd5-91a9-4353-a2e6-05151fb9ad1d None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:16.438738 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588bcd5-91a9-4353-a2e6-05151fb9ad1d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:16.441176 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 171/363] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:16 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:16.442454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3122c-34bd-475c-8e4c-4077c9aaadff None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.442747 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3122c-34bd-475c-8e4c-4077c9aaadff None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.443033 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3122c-34bd-475c-8e4c-4077c9aaadff None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.444589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 172/364] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:16.445321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3122c-34bd-475c-8e4c-4077c9aaadff None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:16.506112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4995bff-2e0a-4808-871c-88c076bfc045 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:16.543582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9c915-ee46-481a-ae80-0dc02812e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:16.544449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c915-ee46-481a-ae80-0dc02812e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.544736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c915-ee46-481a-ae80-0dc02812e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.545016 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9c915-ee46-481a-ae80-0dc02812e1a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.551175 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3122c-34bd-475c-8e4c-4077c9aaadff None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:16.556456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9c915-ee46-481a-ae80-0dc02812e1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-1ec9c915-ee46-481a-ae80-0dc02812e1a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:16.565147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:16.567839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 193/365] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:42:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:16.569921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaad507-a232-4969-8f14-c2ad1045127e None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.570924 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaad507-a232-4969-8f14-c2ad1045127e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.570924 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaad507-a232-4969-8f14-c2ad1045127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.594583 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:16.594863 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-efaad507-a232-4969-8f14-c2ad1045127e None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:16.595496 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.595921 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.596202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-efaad507-a232-4969-8f14-c2ad1045127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:16.596996 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.597978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] RBAC: Adding query filter params (role.id=a6a3e324423b44eca4bd874736714a3f, user.id=2bee47bac83b4427a053667472fa0cee, scope.system=all) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:16.598304 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:16.600829 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:16.615345 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 173/366] 10.222.0.32 () {56 vars in 1308 bytes} [Mon May 9 15:42:16 2022] GET /identity/v3/role_assignments?user.id=2bee47bac83b4427a053667472fa0cee&scope.system=all&role.id=a6a3e324423b44eca4bd874736714a3f => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:16.616588 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:16.707121 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 194/367] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:16.708192 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaad507-a232-4969-8f14-c2ad1045127e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:16.766537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2196c2-3bde-41c8-a91c-3f296fa865bd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:16.810213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5188d1-acac-4274-ad8b-16f3cddadee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:16.811569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5188d1-acac-4274-ad8b-16f3cddadee6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.812410 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5188d1-acac-4274-ad8b-16f3cddadee6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.812918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5188d1-acac-4274-ad8b-16f3cddadee6 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.814880 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5188d1-acac-4274-ad8b-16f3cddadee6 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:16.817621 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5188d1-acac-4274-ad8b-16f3cddadee6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:16.819667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 174/368] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:16 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:16.823429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5188d1-acac-4274-ad8b-16f3cddadee6 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:16.900302 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaad507-a232-4969-8f14-c2ad1045127e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:16.953156 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:16.953849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:16.954131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:16.954406 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:16.955172 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:16.955483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:16.956970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:16.970234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 195/369] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:16.972315 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:16.988888 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5188d1-acac-4274-ad8b-16f3cddadee6 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:17.048469 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e15e6-189e-4868-aea8-3f2e2fa1ff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:17.050088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e15e6-189e-4868-aea8-3f2e2fa1ff63 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:17.050381 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e15e6-189e-4868-aea8-3f2e2fa1ff63 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:17.050702 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e15e6-189e-4868-aea8-3f2e2fa1ff63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:17.065912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e15e6-189e-4868-aea8-3f2e2fa1ff63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-f92e15e6-189e-4868-aea8-3f2e2fa1ff63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:17.077865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:17.078924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:17.079912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:17.083075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 175/370] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:17.084315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e15e6-189e-4868-aea8-3f2e2fa1ff63 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:17.127283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2a19d-8c9a-4506-85ef-5d1ac3b0f395 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:17.168627 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:17.169294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:17.169581 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:17.169858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:17.170702 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] RBAC: Adding query filter params (group.id=d4bd990c9ec54595890b2014dbe63931, role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=11cfce196d9849c1a4cc1837312570af) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:17.171097 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:17.172745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:17.188151 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 196/371] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:16 2022] GET /identity/v3/role_assignments?group.id=d4bd990c9ec54595890b2014dbe63931&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:17.188932 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:17.218605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e15e6-189e-4868-aea8-3f2e2fa1ff63 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:17.261126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2328c3f-afcc-46be-9190-74bbdb43ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:17.262167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328c3f-afcc-46be-9190-74bbdb43ba3f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:17.262792 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328c3f-afcc-46be-9190-74bbdb43ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:17.263299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2328c3f-afcc-46be-9190-74bbdb43ba3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:17.346850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2328c3f-afcc-46be-9190-74bbdb43ba3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:17.349354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2328c3f-afcc-46be-9190-74bbdb43ba3f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:17.475176 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 176/372] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:17.481158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2328c3f-afcc-46be-9190-74bbdb43ba3f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:17.491885 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d1b9-a559-4cf0-a6ad-64f38eb00090 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:17.532923 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:17.534510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:17.534510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:17.534832 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:17.535622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:17.535967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:17.537522 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:17.548508 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 197/373] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:17.555498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:17.645585 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2328c3f-afcc-46be-9190-74bbdb43ba3f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:17.717537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098e33c-8b00-4824-8e69-c5266465b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:17.718853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e33c-8b00-4824-8e69-c5266465b781 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:17.719375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e33c-8b00-4824-8e69-c5266465b781 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:17.719909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098e33c-8b00-4824-8e69-c5266465b781 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:17.723510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098e33c-8b00-4824-8e69-c5266465b781 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:17.725245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098e33c-8b00-4824-8e69-c5266465b781 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:17.731499 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 177/374] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:17 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:17.733778 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098e33c-8b00-4824-8e69-c5266465b781 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:17.755612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f813f-ed42-41fc-80b3-8ed97738c347 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:17.797788 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316f5c5-24c8-48d7-936a-70e4fa9d0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:17.798822 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f5c5-24c8-48d7-936a-70e4fa9d0d11 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:17.799520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f5c5-24c8-48d7-936a-70e4fa9d0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:17.801091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f5c5-24c8-48d7-936a-70e4fa9d0d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:17.856672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098e33c-8b00-4824-8e69-c5266465b781 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:17.880557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316f5c5-24c8-48d7-936a-70e4fa9d0d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:17.882430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316f5c5-24c8-48d7-936a-70e4fa9d0d11 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:17.892939 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ef6b-f37e-41ec-be9f-69f5e89fe677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:17.894593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ef6b-f37e-41ec-be9f-69f5e89fe677 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:17.894879 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ef6b-f37e-41ec-be9f-69f5e89fe677 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:17.895156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ef6b-f37e-41ec-be9f-69f5e89fe677 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:17.896407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4ef6b-f37e-41ec-be9f-69f5e89fe677 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:17.897878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4ef6b-f37e-41ec-be9f-69f5e89fe677 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:17.899874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 178/375] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:17 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:17.905293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ef6b-f37e-41ec-be9f-69f5e89fe677 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:18.032177 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ef6b-f37e-41ec-be9f-69f5e89fe677 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:18.077334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:18.077934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.078221 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.078502 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:18.079363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] RBAC: Adding query filter params (group.id=d4bd990c9ec54595890b2014dbe63931, role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=11cfce196d9849c1a4cc1837312570af) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:18.079678 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:18.081949 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:18.099755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 179/376] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:17 2022] GET /identity/v3/role_assignments?group.id=d4bd990c9ec54595890b2014dbe63931&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:18.106064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 198/377] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:42:18.111658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:18.233537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03d8f-d79e-4481-98d0-f89034e726d4 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:18.275457 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bcdaf-6d9a-43f7-a5d1-59111b874382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:18.276386 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bcdaf-6d9a-43f7-a5d1-59111b874382 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.276679 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bcdaf-6d9a-43f7-a5d1-59111b874382 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.276963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bcdaf-6d9a-43f7-a5d1-59111b874382 None admin] PATH_INFO: `/v3/projects/cc880447f6bd497e832e82cd644c7320` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:18.278182 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bcdaf-6d9a-43f7-a5d1-59111b874382 None admin] RBAC: Authorizing `identity:get_project(project_id=cc880447f6bd497e832e82cd644c7320)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:18.279645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bcdaf-6d9a-43f7-a5d1-59111b874382 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:18.281413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 180/378] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:18 2022] GET /identity/v3/projects/cc880447f6bd497e832e82cd644c7320 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:18.288203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316f5c5-24c8-48d7-936a-70e4fa9d0d11 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:18.414904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316f5c5-24c8-48d7-936a-70e4fa9d0d11 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:18.462133 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bbf1f-c503-4625-8b91-66bc9373aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:18.463020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bbf1f-c503-4625-8b91-66bc9373aca1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.463307 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bbf1f-c503-4625-8b91-66bc9373aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.463649 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bbf1f-c503-4625-8b91-66bc9373aca1 None admin] PATH_INFO: `/v3/groups/d50fecc2a8204974a337b9c1f469ff3b` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:18.470997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bbf1f-c503-4625-8b91-66bc9373aca1 None admin] RBAC: Authorizing `identity:get_group(group_id=d50fecc2a8204974a337b9c1f469ff3b)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:18.473206 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3bbf1f-c503-4625-8b91-66bc9373aca1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:18.475260 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 199/379] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:18 2022] GET /identity/v3/groups/d50fecc2a8204974a337b9c1f469ff3b => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:18.481076 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bcdaf-6d9a-43f7-a5d1-59111b874382 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:18.613652 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bcdaf-6d9a-43f7-a5d1-59111b874382 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:18.649279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3d6fd-bed3-4e84-91af-0aa431e188d2 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.649644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3d6fd-bed3-4e84-91af-0aa431e188d2 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.649842 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3d6fd-bed3-4e84-91af-0aa431e188d2 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:18.651390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 200/380] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:18.657058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263993f-2583-4a81-8b0d-361f59447426 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.657677 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263993f-2583-4a81-8b0d-361f59447426 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.658174 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263993f-2583-4a81-8b0d-361f59447426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:18.658896 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:18.660234 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.660582 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.660857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:18.661963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] RBAC: Adding query filter params (group.id=d50fecc2a8204974a337b9c1f469ff3b, role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=cc880447f6bd497e832e82cd644c7320) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:18.662176 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:18.663604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:18.678054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 181/381] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:18 2022] GET /identity/v3/role_assignments?group.id=d50fecc2a8204974a337b9c1f469ff3b&scope.project.id=cc880447f6bd497e832e82cd644c7320&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:18.685879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-5263993f-2583-4a81-8b0d-361f59447426 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:18.687456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-5263993f-2583-4a81-8b0d-361f59447426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:18.769558 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 201/382] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:18.793161 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:18.915552 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d349f-b201-4b3a-ac42-20fdc64d7db3 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:18.954090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985155af-a680-4d9c-90ac-0be16ceb79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:18.954913 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985155af-a680-4d9c-90ac-0be16ceb79e5 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.955200 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985155af-a680-4d9c-90ac-0be16ceb79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.955478 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985155af-a680-4d9c-90ac-0be16ceb79e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:18.967529 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985155af-a680-4d9c-90ac-0be16ceb79e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-985155af-a680-4d9c-90ac-0be16ceb79e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:18.976213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:18.977295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:18.978258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 182/383] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:42:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:18.985275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263993f-2583-4a81-8b0d-361f59447426 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:18.989628 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83c63-6f6a-499e-b31a-b815cbdf13ff None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.989832 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83c63-6f6a-499e-b31a-b815cbdf13ff None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.990024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83c63-6f6a-499e-b31a-b815cbdf13ff None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:18.992094 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 183/384] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:18.999786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8f81-24cd-4faa-af90-f589cc4a243b None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:18.999786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8f81-24cd-4faa-af90-f589cc4a243b None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:18.999786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8f81-24cd-4faa-af90-f589cc4a243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:19.015506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-ba0b8f81-24cd-4faa-af90-f589cc4a243b None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:19.016754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-ba0b8f81-24cd-4faa-af90-f589cc4a243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:19.095536 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 184/385] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:19.130719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8f81-24cd-4faa-af90-f589cc4a243b None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:19.154164 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263993f-2583-4a81-8b0d-361f59447426 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:19.219072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:19.219690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:19.220096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:19.220381 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:19.221202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:19.221544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:19.222943 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:19.242557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 202/386] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:19.244903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:19.303873 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8f81-24cd-4faa-af90-f589cc4a243b None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:19.358436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11214ce-b1ae-4252-acc2-de7955b5d7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:19.359253 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11214ce-b1ae-4252-acc2-de7955b5d7e0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:19.359547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11214ce-b1ae-4252-acc2-de7955b5d7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:19.359877 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11214ce-b1ae-4252-acc2-de7955b5d7e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:19.381698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11214ce-b1ae-4252-acc2-de7955b5d7e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a11214ce-b1ae-4252-acc2-de7955b5d7e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:19.389666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:19.390739 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:19.391674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 185/387] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:19.398198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11214ce-b1ae-4252-acc2-de7955b5d7e0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:19.434058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a13ffc-abad-4b7e-a8e4-4c41b576ab90 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:19.471503 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e288-0a0a-4c3c-ac0c-a4c3b44daf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:19.472629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e288-0a0a-4c3c-ac0c-a4c3b44daf30 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:19.472920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e288-0a0a-4c3c-ac0c-a4c3b44daf30 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:19.473202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e288-0a0a-4c3c-ac0c-a4c3b44daf30 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:19.475202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11e288-0a0a-4c3c-ac0c-a4c3b44daf30 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:19.476698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11e288-0a0a-4c3c-ac0c-a4c3b44daf30 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:19.478551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 203/388] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:19 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:19.486404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e288-0a0a-4c3c-ac0c-a4c3b44daf30 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:19.579730 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11214ce-b1ae-4252-acc2-de7955b5d7e0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:19.621564 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:19.622539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:19.622828 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:19.623341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:19.624181 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] RBAC: Adding query filter params (name=member) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:19.624493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:19.625869 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:19.637803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 186/389] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:19.647438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:19.715393 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e288-0a0a-4c3c-ac0c-a4c3b44daf30 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:19.782753 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c891f7-831f-43af-a110-7c4ac8b03cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:19.783549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c891f7-831f-43af-a110-7c4ac8b03cad None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:19.784372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c891f7-831f-43af-a110-7c4ac8b03cad None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:19.784651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c891f7-831f-43af-a110-7c4ac8b03cad None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:19.786543 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c891f7-831f-43af-a110-7c4ac8b03cad None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:19.788290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c891f7-831f-43af-a110-7c4ac8b03cad None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:19.796508 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 204/390] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:19 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:19.802141 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399418-4e71-4b39-8a4b-a4e3344c5bce None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:19.810672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c891f7-831f-43af-a110-7c4ac8b03cad None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:19.875509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47293d3-7fc7-4c97-ae39-9be4181dfef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:19.876455 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47293d3-7fc7-4c97-ae39-9be4181dfef5 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:19.876744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47293d3-7fc7-4c97-ae39-9be4181dfef5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:19.877024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47293d3-7fc7-4c97-ae39-9be4181dfef5 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:19.881973 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47293d3-7fc7-4c97-ae39-9be4181dfef5 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:19.883465 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47293d3-7fc7-4c97-ae39-9be4181dfef5 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:19.888189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 187/391] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:19 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:19.894981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47293d3-7fc7-4c97-ae39-9be4181dfef5 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:20.017460 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c891f7-831f-43af-a110-7c4ac8b03cad None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:20.089024 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114d92f-dc6b-4118-b26b-c26f15727745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:20.089836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114d92f-dc6b-4118-b26b-c26f15727745 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.090122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114d92f-dc6b-4118-b26b-c26f15727745 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.090400 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114d92f-dc6b-4118-b26b-c26f15727745 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba/groups/d4bd990c9ec54595890b2014dbe63931/roles/c0ef3a26cb124115962df9d8c742f9f1` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.093037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47293d3-7fc7-4c97-ae39-9be4181dfef5 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:20.096986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114d92f-dc6b-4118-b26b-c26f15727745 None admin] RBAC: Authorizing `identity:create_grant(project_id=104072102c8e4dddb773192263e064ba, group_id=d4bd990c9ec54595890b2014dbe63931, role_id=c0ef3a26cb124115962df9d8c742f9f1)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:20.098479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114d92f-dc6b-4118-b26b-c26f15727745 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:20.121889 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 205/392] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:42:19 2022] PUT /identity/v3/projects/104072102c8e4dddb773192263e064ba/groups/d4bd990c9ec54595890b2014dbe63931/roles/c0ef3a26cb124115962df9d8c742f9f1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:42:20.123851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d75b-cabe-4305-ba63-85239265aa68 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.124601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d75b-cabe-4305-ba63-85239265aa68 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.125128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326d75b-cabe-4305-ba63-85239265aa68 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.128075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 206/393] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:20.135560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a8bf0-aa45-4e00-a4e1-ad1ff599b016 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.136268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a8bf0-aa45-4e00-a4e1-ad1ff599b016 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.136774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a8bf0-aa45-4e00-a4e1-ad1ff599b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.160575 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-6d3a8bf0-aa45-4e00-a4e1-ad1ff599b016 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:20.162926 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-6d3a8bf0-aa45-4e00-a4e1-ad1ff599b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:20.164461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc668-1412-439c-a7f8-11295e9f4335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:20.165352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc668-1412-439c-a7f8-11295e9f4335 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.165635 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc668-1412-439c-a7f8-11295e9f4335 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.165912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc668-1412-439c-a7f8-11295e9f4335 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.168092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cc668-1412-439c-a7f8-11295e9f4335 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:20.171387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cc668-1412-439c-a7f8-11295e9f4335 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:20.171387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 188/394] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:19 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:20.178193 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc668-1412-439c-a7f8-11295e9f4335 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:20.261312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 207/395] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:20.289877 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a8bf0-aa45-4e00-a4e1-ad1ff599b016 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:20.410928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a8bf0-aa45-4e00-a4e1-ad1ff599b016 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:20.450434 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc668-1412-439c-a7f8-11295e9f4335 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:20.451671 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1205f6-3ff2-4126-8bf8-b45fe50d13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:20.453728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1205f6-3ff2-4126-8bf8-b45fe50d13a5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.454218 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1205f6-3ff2-4126-8bf8-b45fe50d13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.454693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1205f6-3ff2-4126-8bf8-b45fe50d13a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.468875 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1205f6-3ff2-4126-8bf8-b45fe50d13a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-da1205f6-3ff2-4126-8bf8-b45fe50d13a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:20.479945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:20.481009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:20.481947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:20.485032 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 208/396] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:20.492223 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1205f6-3ff2-4126-8bf8-b45fe50d13a5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:20.495740 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58dbea-d053-4b62-ad6d-04e72685397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:20.497219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58dbea-d053-4b62-ad6d-04e72685397e None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.497219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58dbea-d053-4b62-ad6d-04e72685397e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.497464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58dbea-d053-4b62-ad6d-04e72685397e None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba/groups/d4bd990c9ec54595890b2014dbe63931/roles/7f13f524fe7d4fd4a929550d9f95b314` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.499549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58dbea-d053-4b62-ad6d-04e72685397e None admin] RBAC: Authorizing `identity:create_grant(project_id=104072102c8e4dddb773192263e064ba, group_id=d4bd990c9ec54595890b2014dbe63931, role_id=7f13f524fe7d4fd4a929550d9f95b314)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:20.501132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58dbea-d053-4b62-ad6d-04e72685397e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:20.522339 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 189/397] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:42:20 2022] PUT /identity/v3/projects/104072102c8e4dddb773192263e064ba/groups/d4bd990c9ec54595890b2014dbe63931/roles/7f13f524fe7d4fd4a929550d9f95b314 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:42:20.616891 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1205f6-3ff2-4126-8bf8-b45fe50d13a5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:20.653597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:20.654331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.654641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.654943 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.655787 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:20.656112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:20.657516 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:20.667644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 209/398] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:20.674967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58dbea-d053-4b62-ad6d-04e72685397e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:20.786558 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58dbea-d053-4b62-ad6d-04e72685397e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:20.823581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaa9e8-9db3-46ba-a85c-6523d54dd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:20.824500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaa9e8-9db3-46ba-a85c-6523d54dd286 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.824786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaa9e8-9db3-46ba-a85c-6523d54dd286 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.825071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaa9e8-9db3-46ba-a85c-6523d54dd286 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.826293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaa9e8-9db3-46ba-a85c-6523d54dd286 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:20.827872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaa9e8-9db3-46ba-a85c-6523d54dd286 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:20.829854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 190/399] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:20 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:20.836737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:20.943154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872823e1-01d4-43e8-b685-c1f8912c0103 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:20.983515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592ee4b-0066-4cdf-863c-5d6a2af4812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:20.984530 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ee4b-0066-4cdf-863c-5d6a2af4812a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:20.984823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ee4b-0066-4cdf-863c-5d6a2af4812a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:20.985102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592ee4b-0066-4cdf-863c-5d6a2af4812a None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:20.986343 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592ee4b-0066-4cdf-863c-5d6a2af4812a None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:20.988537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592ee4b-0066-4cdf-863c-5d6a2af4812a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:20.990291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 210/400] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:20 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:20.996243 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaa9e8-9db3-46ba-a85c-6523d54dd286 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:21.108267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaa9e8-9db3-46ba-a85c-6523d54dd286 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:21.147463 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d3af4-ffd5-4140-802b-b389301c5f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:21.148384 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d3af4-ffd5-4140-802b-b389301c5f7c None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:21.148671 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d3af4-ffd5-4140-802b-b389301c5f7c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:21.148948 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d3af4-ffd5-4140-802b-b389301c5f7c None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af/groups/d4bd990c9ec54595890b2014dbe63931/roles/7f13f524fe7d4fd4a929550d9f95b314` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:21.151113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d3af4-ffd5-4140-802b-b389301c5f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=11cfce196d9849c1a4cc1837312570af, group_id=d4bd990c9ec54595890b2014dbe63931, role_id=7f13f524fe7d4fd4a929550d9f95b314)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:21.152625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d3af4-ffd5-4140-802b-b389301c5f7c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:21.183495 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 191/401] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:42:20 2022] PUT /identity/v3/projects/11cfce196d9849c1a4cc1837312570af/groups/d4bd990c9ec54595890b2014dbe63931/roles/7f13f524fe7d4fd4a929550d9f95b314 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:21.596898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fff5c-84eb-44a0-9876-b36fb381e786 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:21.597452 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fff5c-84eb-44a0-9876-b36fb381e786 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:21.597737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fff5c-84eb-44a0-9876-b36fb381e786 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:21.599291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 211/402] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:21.604886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13aa5f-1886-44a9-800d-8e790805ff9d None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:21.605180 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13aa5f-1886-44a9-800d-8e790805ff9d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:21.605450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13aa5f-1886-44a9-800d-8e790805ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:21.623647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-af13aa5f-1886-44a9-800d-8e790805ff9d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:21.624887 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-af13aa5f-1886-44a9-800d-8e790805ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:21.656763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d77449-aabd-4d44-9806-381ab6a1cd52 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:21.657096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d77449-aabd-4d44-9806-381ab6a1cd52 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:21.657317 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d77449-aabd-4d44-9806-381ab6a1cd52 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:21.659118 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 212/403] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:21.664631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742634-1e03-4a72-bb92-2452fd7b5f4f None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:21.664925 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742634-1e03-4a72-bb92-2452fd7b5f4f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:21.665219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742634-1e03-4a72-bb92-2452fd7b5f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:21.687867 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-7a742634-1e03-4a72-bb92-2452fd7b5f4f None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:21.689072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-7a742634-1e03-4a72-bb92-2452fd7b5f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:21.722589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 192/404] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:21.750005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13aa5f-1886-44a9-800d-8e790805ff9d None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:21.778581 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 213/405] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:21.817135 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742634-1e03-4a72-bb92-2452fd7b5f4f None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:21.863461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13aa5f-1886-44a9-800d-8e790805ff9d None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:21.907143 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36a3d4-2b17-4a11-a725-09c0462f8394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:21.907998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36a3d4-2b17-4a11-a725-09c0462f8394 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:21.908286 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36a3d4-2b17-4a11-a725-09c0462f8394 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:21.908730 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36a3d4-2b17-4a11-a725-09c0462f8394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:21.931463 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36a3d4-2b17-4a11-a725-09c0462f8394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ca36a3d4-2b17-4a11-a725-09c0462f8394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:21.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:21.944995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:21.947454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:21.955098 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 193/406] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:21.957850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36a3d4-2b17-4a11-a725-09c0462f8394 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:22.004975 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742634-1e03-4a72-bb92-2452fd7b5f4f None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:22.048444 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69c3d5-a72b-4914-82b0-a2269ac3fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:22.054545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69c3d5-a72b-4914-82b0-a2269ac3fdd9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:22.055108 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69c3d5-a72b-4914-82b0-a2269ac3fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:22.055894 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69c3d5-a72b-4914-82b0-a2269ac3fdd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:22.088591 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69c3d5-a72b-4914-82b0-a2269ac3fdd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-9c69c3d5-a72b-4914-82b0-a2269ac3fdd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:22.106528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:22.107658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:22.108641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:22.112329 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 214/407] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:22.118909 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69c3d5-a72b-4914-82b0-a2269ac3fdd9 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:22.156342 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36a3d4-2b17-4a11-a725-09c0462f8394 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:22.200483 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:22.201171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:22.201456 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:22.201730 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:22.202500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:22.202814 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:22.204233 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:22.214229 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 194/408] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:22.219848 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:22.251704 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69c3d5-a72b-4914-82b0-a2269ac3fdd9 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:22.295225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:22.295939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:22.296233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:22.296515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:22.297284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:22.297599 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:22.299090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:22.317388 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 215/409] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:22.323954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:22.343573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0831ed9-a223-478a-b90e-52bf8723f7dd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:22.384990 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fb67d-ef1e-4cea-9815-37bb7e840382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:22.385803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fb67d-ef1e-4cea-9815-37bb7e840382 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:22.386089 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fb67d-ef1e-4cea-9815-37bb7e840382 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:22.386368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fb67d-ef1e-4cea-9815-37bb7e840382 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:22.389184 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fb67d-ef1e-4cea-9815-37bb7e840382 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:22.390637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fb67d-ef1e-4cea-9815-37bb7e840382 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:22.392376 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 195/410] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:22 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:22.399124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fb67d-ef1e-4cea-9815-37bb7e840382 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:22.515425 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f55901-403e-49f4-bc32-06f73b64d49c None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:22.589303 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b5f75-9eef-41ef-abff-27894e919213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:22.590186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b5f75-9eef-41ef-abff-27894e919213 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:22.590470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b5f75-9eef-41ef-abff-27894e919213 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:22.590749 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b5f75-9eef-41ef-abff-27894e919213 None admin] PATH_INFO: `/v3/groups/d50fecc2a8204974a337b9c1f469ff3b` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:22.592882 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b5f75-9eef-41ef-abff-27894e919213 None admin] RBAC: Authorizing `identity:get_group(group_id=d50fecc2a8204974a337b9c1f469ff3b)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:22.594344 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b5f75-9eef-41ef-abff-27894e919213 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:22.599152 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fb67d-ef1e-4cea-9815-37bb7e840382 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:22.600136 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 216/411] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:22 2022] GET /identity/v3/groups/d50fecc2a8204974a337b9c1f469ff3b => generated 229 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:22.603532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b5f75-9eef-41ef-abff-27894e919213 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:22.661491 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454fa4b-88ab-4098-b2e6-de11a1a350ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:22.662278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454fa4b-88ab-4098-b2e6-de11a1a350ac None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:22.662558 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454fa4b-88ab-4098-b2e6-de11a1a350ac None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:22.662829 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454fa4b-88ab-4098-b2e6-de11a1a350ac None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:22.664682 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454fa4b-88ab-4098-b2e6-de11a1a350ac None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:22.666125 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454fa4b-88ab-4098-b2e6-de11a1a350ac None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:22.668033 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 196/412] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:22 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:22.687161 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454fa4b-88ab-4098-b2e6-de11a1a350ac None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:22.833823 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454fa4b-88ab-4098-b2e6-de11a1a350ac None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:22.849997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b5f75-9eef-41ef-abff-27894e919213 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:22.885303 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d63ee-2db3-4dd5-b0a1-b7e3badc2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:22.886192 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d63ee-2db3-4dd5-b0a1-b7e3badc2ae0 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:22.886474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d63ee-2db3-4dd5-b0a1-b7e3badc2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:22.886750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d63ee-2db3-4dd5-b0a1-b7e3badc2ae0 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af/groups/d4bd990c9ec54595890b2014dbe63931/roles/c0ef3a26cb124115962df9d8c742f9f1` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:22.891288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d63ee-2db3-4dd5-b0a1-b7e3badc2ae0 None admin] RBAC: Authorizing `identity:create_grant(project_id=11cfce196d9849c1a4cc1837312570af, group_id=d4bd990c9ec54595890b2014dbe63931, role_id=c0ef3a26cb124115962df9d8c742f9f1)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:22.892786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d63ee-2db3-4dd5-b0a1-b7e3badc2ae0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:22.910765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a0435-e80f-4334-af7b-bcbc81c24be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:22.911740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a0435-e80f-4334-af7b-bcbc81c24be8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:22.912105 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a0435-e80f-4334-af7b-bcbc81c24be8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:22.914907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a0435-e80f-4334-af7b-bcbc81c24be8 None admin] PATH_INFO: `/v3/projects/cc880447f6bd497e832e82cd644c7320` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:22.919013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 197/413] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:42:22 2022] PUT /identity/v3/projects/11cfce196d9849c1a4cc1837312570af/groups/d4bd990c9ec54595890b2014dbe63931/roles/c0ef3a26cb124115962df9d8c742f9f1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:22.920266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a0435-e80f-4334-af7b-bcbc81c24be8 None admin] RBAC: Authorizing `identity:get_project(project_id=cc880447f6bd497e832e82cd644c7320)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:22.921801 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a0435-e80f-4334-af7b-bcbc81c24be8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:22.923895 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 217/414] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:22 2022] GET /identity/v3/projects/cc880447f6bd497e832e82cd644c7320 => generated 344 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:22.929945 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d63ee-2db3-4dd5-b0a1-b7e3badc2ae0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:23.117236 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d63ee-2db3-4dd5-b0a1-b7e3badc2ae0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:23.162574 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef173f-4389-4da1-bdf4-8a00aea6a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:23.164314 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef173f-4389-4da1-bdf4-8a00aea6a92f None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.164849 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef173f-4389-4da1-bdf4-8a00aea6a92f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.165356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef173f-4389-4da1-bdf4-8a00aea6a92f None admin] PATH_INFO: `/v3/projects/cc880447f6bd497e832e82cd644c7320/groups/d50fecc2a8204974a337b9c1f469ff3b/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:23.167575 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef173f-4389-4da1-bdf4-8a00aea6a92f None admin] RBAC: Authorizing `identity:create_grant(project_id=cc880447f6bd497e832e82cd644c7320, group_id=d50fecc2a8204974a337b9c1f469ff3b, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:23.174347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef173f-4389-4da1-bdf4-8a00aea6a92f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:23.197854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 198/415] 10.222.0.32 () {58 vars in 1442 bytes} [Mon May 9 15:42:22 2022] PUT /identity/v3/projects/cc880447f6bd497e832e82cd644c7320/groups/d50fecc2a8204974a337b9c1f469ff3b/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:23.270517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad1f0-2aa8-4e5e-b7e2-b28d86c21534 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.270912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad1f0-2aa8-4e5e-b7e2-b28d86c21534 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.271104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ad1f0-2aa8-4e5e-b7e2-b28d86c21534 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:23.272736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 218/416] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:23.278598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3ef3-8b25-463c-8d60-5ba668db8c31 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.279263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3ef3-8b25-463c-8d60-5ba668db8c31 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.279806 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3ef3-8b25-463c-8d60-5ba668db8c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:23.299385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-80bd3ef3-8b25-463c-8d60-5ba668db8c31 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:23.301319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-80bd3ef3-8b25-463c-8d60-5ba668db8c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:23.391814 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 199/417] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:23.416588 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ad1f0-2aa8-4e5e-b7e2-b28d86c21534 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:23.434372 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142fde-dd03-42d2-bc48-a0833a00e93c None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.435028 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142fde-dd03-42d2-bc48-a0833a00e93c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.435314 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142fde-dd03-42d2-bc48-a0833a00e93c None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:23.437298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 200/418] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:23.443159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7199a-e714-4d55-8604-a18cc2f0d7a4 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.443445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7199a-e714-4d55-8604-a18cc2f0d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.443801 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7199a-e714-4d55-8604-a18cc2f0d7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:23.462669 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-28e7199a-e714-4d55-8604-a18cc2f0d7a4 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:23.463952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-28e7199a-e714-4d55-8604-a18cc2f0d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:23.539875 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ad1f0-2aa8-4e5e-b7e2-b28d86c21534 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:23.570506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 201/419] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:23.576339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09368-b27a-4618-b19a-42d39bea0fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:23.577428 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09368-b27a-4618-b19a-42d39bea0fb1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.577946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09368-b27a-4618-b19a-42d39bea0fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.578435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c09368-b27a-4618-b19a-42d39bea0fb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:23.589919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c09368-b27a-4618-b19a-42d39bea0fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-b2c09368-b27a-4618-b19a-42d39bea0fb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:23.599686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:23.601419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:23.602332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:23.605254 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 219/420] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:42:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:23.611784 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7199a-e714-4d55-8604-a18cc2f0d7a4 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:23.614085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09368-b27a-4618-b19a-42d39bea0fb1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:23.734076 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c09368-b27a-4618-b19a-42d39bea0fb1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:23.783379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7199a-e714-4d55-8604-a18cc2f0d7a4 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:23.785552 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:23.786492 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.787001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.787511 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:23.788542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:23.789108 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:23.790734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:23.800640 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 220/421] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:23.808809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:23.855641 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffad027-1758-4dae-b4e0-95d38577f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:23.856562 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffad027-1758-4dae-b4e0-95d38577f00b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.856852 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffad027-1758-4dae-b4e0-95d38577f00b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.857132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffad027-1758-4dae-b4e0-95d38577f00b None admin] PATH_INFO: `/v3/roles/member` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:23.890899 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffad027-1758-4dae-b4e0-95d38577f00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-6ffad027-1758-4dae-b4e0-95d38577f00b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:23.899693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:23.900894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:23.901836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:23.905480 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 202/422] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:23.910948 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffad027-1758-4dae-b4e0-95d38577f00b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:23.954690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece7ea9-0ba2-4de8-86b2-cc631fe2fd80 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:23.995812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227771c-a6f8-4673-9b70-99061118fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:23.996984 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227771c-a6f8-4673-9b70-99061118fb5b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:23.997495 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227771c-a6f8-4673-9b70-99061118fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:23.997992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227771c-a6f8-4673-9b70-99061118fb5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.078949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227771c-a6f8-4673-9b70-99061118fb5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:24.082011 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227771c-a6f8-4673-9b70-99061118fb5b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:24.199898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 221/423] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:24.207084 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227771c-a6f8-4673-9b70-99061118fb5b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:24.209433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffad027-1758-4dae-b4e0-95d38577f00b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:24.304560 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:24.305167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:24.305457 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:24.305722 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.306486 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] RBAC: Adding query filter params (name=member) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:24.306794 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:24.308208 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:24.325396 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227771c-a6f8-4673-9b70-99061118fb5b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:24.326237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 203/424] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:24.332113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:24.363659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf93cf-0db2-484d-bb1f-78865830d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:24.364957 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf93cf-0db2-484d-bb1f-78865830d209 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:24.365468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf93cf-0db2-484d-bb1f-78865830d209 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:24.365968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf93cf-0db2-484d-bb1f-78865830d209 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.367390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf93cf-0db2-484d-bb1f-78865830d209 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:24.369544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf93cf-0db2-484d-bb1f-78865830d209 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:24.371963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 222/425] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:24 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:24.381477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf93cf-0db2-484d-bb1f-78865830d209 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:24.501913 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf93cf-0db2-484d-bb1f-78865830d209 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:24.514786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a12530-bea5-48e3-91ad-09bb4f57e870 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:24.539502 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50159925-0298-41ff-813e-c2208451efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:24.540828 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159925-0298-41ff-813e-c2208451efd9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:24.541322 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159925-0298-41ff-813e-c2208451efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:24.541837 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50159925-0298-41ff-813e-c2208451efd9 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.543250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50159925-0298-41ff-813e-c2208451efd9 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:24.544936 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50159925-0298-41ff-813e-c2208451efd9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:24.547187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 223/426] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:24 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:24.548754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171643d9-3e59-42fe-acc6-78c4ff62a5a8 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:24.549869 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171643d9-3e59-42fe-acc6-78c4ff62a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:24.550374 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171643d9-3e59-42fe-acc6-78c4ff62a5a8 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.551822 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 224/427] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:24.553446 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171643d9-3e59-42fe-acc6-78c4ff62a5a8 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:24.556065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3c99-6a3e-4757-a80b-7e6bdf9fffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:24.556672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3c99-6a3e-4757-a80b-7e6bdf9fffa7 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:24.557229 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3c99-6a3e-4757-a80b-7e6bdf9fffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:24.557519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f3c99-6a3e-4757-a80b-7e6bdf9fffa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.636675 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f3c99-6a3e-4757-a80b-7e6bdf9fffa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:24.639140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f3c99-6a3e-4757-a80b-7e6bdf9fffa7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:24.676536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171643d9-3e59-42fe-acc6-78c4ff62a5a8 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:24.719019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d77d0-fcf6-4152-996a-bac6f70574d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:24.720097 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d77d0-fcf6-4152-996a-bac6f70574d8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:24.720626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d77d0-fcf6-4152-996a-bac6f70574d8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:24.721816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d77d0-fcf6-4152-996a-bac6f70574d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.723021 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d77d0-fcf6-4152-996a-bac6f70574d8 None admin] RBAC: Adding query filter params (group.id=d4bd990c9ec54595890b2014dbe63931, role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=104072102c8e4dddb773192263e064ba) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:24.723560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d77d0-fcf6-4152-996a-bac6f70574d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:24.725236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d77d0-fcf6-4152-996a-bac6f70574d8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:24.732655 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 225/428] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:24 2022] GET /identity/v3/role_assignments?group.id=d4bd990c9ec54595890b2014dbe63931&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:24.734401 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853de97-5b0f-4526-b5f7-5d6d7404fe8d None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:24.734934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853de97-5b0f-4526-b5f7-5d6d7404fe8d None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:24.735435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853de97-5b0f-4526-b5f7-5d6d7404fe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.763201 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 204/429] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:42:24.766349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-7853de97-5b0f-4526-b5f7-5d6d7404fe8d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:24.766686 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3c99-6a3e-4757-a80b-7e6bdf9fffa7 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:24.768115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-7853de97-5b0f-4526-b5f7-5d6d7404fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:24.848897 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 226/430] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:24.876165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f3c99-6a3e-4757-a80b-7e6bdf9fffa7 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:24.897316 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853de97-5b0f-4526-b5f7-5d6d7404fe8d None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:24.915465 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaa8f1-7f66-47c2-8231-89b6282e3ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:24.916650 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaa8f1-7f66-47c2-8231-89b6282e3ec7 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:24.917099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaa8f1-7f66-47c2-8231-89b6282e3ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:24.917539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaa8f1-7f66-47c2-8231-89b6282e3ec7 None admin] PATH_INFO: `/v3/projects/104072102c8e4dddb773192263e064ba` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:24.918996 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaa8f1-7f66-47c2-8231-89b6282e3ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=104072102c8e4dddb773192263e064ba)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:24.920658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaa8f1-7f66-47c2-8231-89b6282e3ec7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:24.923050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 205/431] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:24 2022] GET /identity/v3/projects/104072102c8e4dddb773192263e064ba => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:24.929217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaa8f1-7f66-47c2-8231-89b6282e3ec7 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:25.060325 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853de97-5b0f-4526-b5f7-5d6d7404fe8d None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:25.068298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaa8f1-7f66-47c2-8231-89b6282e3ec7 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:25.113018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10afebe-3061-4788-a4c7-d9ac5cddc548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:25.113823 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afebe-3061-4788-a4c7-d9ac5cddc548 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.114111 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afebe-3061-4788-a4c7-d9ac5cddc548 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.114392 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afebe-3061-4788-a4c7-d9ac5cddc548 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.114750 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cf471-6acb-4935-b1d0-db8d774be7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:25.115722 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10afebe-3061-4788-a4c7-d9ac5cddc548 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:25.116052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cf471-6acb-4935-b1d0-db8d774be7af None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.116529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cf471-6acb-4935-b1d0-db8d774be7af None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.117029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cf471-6acb-4935-b1d0-db8d774be7af None admin] PATH_INFO: `/v3/roles/member` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.117244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10afebe-3061-4788-a4c7-d9ac5cddc548 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:25.119313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 206/432] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:24 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:25.126920 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10afebe-3061-4788-a4c7-d9ac5cddc548 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:25.136949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cf471-6acb-4935-b1d0-db8d774be7af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-796cf471-6acb-4935-b1d0-db8d774be7af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:25.148268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:25.149336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:42:25.150269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:25.153244 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 227/433] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:25.158788 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cf471-6acb-4935-b1d0-db8d774be7af None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:25.258108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10afebe-3061-4788-a4c7-d9ac5cddc548 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:25.292045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cf471-6acb-4935-b1d0-db8d774be7af None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:25.294605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:25.295550 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.296191 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.296711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.297830 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] RBAC: Adding query filter params (group.id=d4bd990c9ec54595890b2014dbe63931, role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=104072102c8e4dddb773192263e064ba) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:25.298371 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:25.300120 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:25.307056 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 207/434] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:25 2022] GET /identity/v3/role_assignments?group.id=d4bd990c9ec54595890b2014dbe63931&scope.project.id=104072102c8e4dddb773192263e064ba&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:25.333264 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:25.333966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.334253 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.334537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.335320 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:25.335637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:25.337149 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:25.347846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 228/435] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:25.353372 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:25.470132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cc20e-d120-4970-a54e-21989f12c44c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:25.509699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a40e56-9c04-417c-8c56-1ce5a2c18ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:25.510758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40e56-9c04-417c-8c56-1ce5a2c18ad3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.511281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40e56-9c04-417c-8c56-1ce5a2c18ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.511797 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40e56-9c04-417c-8c56-1ce5a2c18ad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.590822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a40e56-9c04-417c-8c56-1ce5a2c18ad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:25.592434 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a40e56-9c04-417c-8c56-1ce5a2c18ad3 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:25.700576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 208/436] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:25.706612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:25.775005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a94bbb-d1b4-45ea-bbf8-c25308ea67ad None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.775194 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a94bbb-d1b4-45ea-bbf8-c25308ea67ad None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.775491 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a94bbb-d1b4-45ea-bbf8-c25308ea67ad None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.777187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 209/437] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:25.782426 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daddbb-781b-49bf-a10a-04c1b967663d None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.782720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daddbb-781b-49bf-a10a-04c1b967663d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.783006 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daddbb-781b-49bf-a10a-04c1b967663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.801463 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-e3daddbb-781b-49bf-a10a-04c1b967663d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:25.802677 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-e3daddbb-781b-49bf-a10a-04c1b967663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:25.824745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3660a2-abec-4e23-a965-08823e5ec8f0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:25.863186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdf627-e39b-4455-8520-f0df36458f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:25.864098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf627-e39b-4455-8520-f0df36458f61 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.864379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf627-e39b-4455-8520-f0df36458f61 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.864653 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdf627-e39b-4455-8520-f0df36458f61 None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.865952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf627-e39b-4455-8520-f0df36458f61 None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:25.867443 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdf627-e39b-4455-8520-f0df36458f61 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:25.869197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 229/438] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:25 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:25.870408 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4983-d1d1-4972-8347-ac9198ec5895 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.870698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4983-d1d1-4972-8347-ac9198ec5895 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.870974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4983-d1d1-4972-8347-ac9198ec5895 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.872384 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 230/439] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:25.878522 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e4983-d1d1-4972-8347-ac9198ec5895 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:25.881253 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 210/440] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:25.882406 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861173d3-c912-4883-8ac0-0c7690a1c8ea None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:25.882699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861173d3-c912-4883-8ac0-0c7690a1c8ea None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:25.882981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861173d3-c912-4883-8ac0-0c7690a1c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:25.909184 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-861173d3-c912-4883-8ac0-0c7690a1c8ea None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:25.910617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-861173d3-c912-4883-8ac0-0c7690a1c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:25.988537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 211/441] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:25.989701 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861173d3-c912-4883-8ac0-0c7690a1c8ea None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:25.993828 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e4983-d1d1-4972-8347-ac9198ec5895 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.032717 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf684d5-ed58-45c9-8f72-7463ddc5b28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.033608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf684d5-ed58-45c9-8f72-7463ddc5b28b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.034056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf684d5-ed58-45c9-8f72-7463ddc5b28b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.034441 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf684d5-ed58-45c9-8f72-7463ddc5b28b None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.035609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf684d5-ed58-45c9-8f72-7463ddc5b28b None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.037075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf684d5-ed58-45c9-8f72-7463ddc5b28b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.038703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 231/442] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:25 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:26.039454 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf684d5-ed58-45c9-8f72-7463ddc5b28b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.087436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861173d3-c912-4883-8ac0-0c7690a1c8ea None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.119465 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883953a0-afe2-43c6-91b8-550974de8946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.120291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883953a0-afe2-43c6-91b8-550974de8946 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.120579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883953a0-afe2-43c6-91b8-550974de8946 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.120860 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883953a0-afe2-43c6-91b8-550974de8946 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.131388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883953a0-afe2-43c6-91b8-550974de8946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:26.133247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf684d5-ed58-45c9-8f72-7463ddc5b28b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-883953a0-afe2-43c6-91b8-550974de8946 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:26.139001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:26.140061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 212/443] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:26.141024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883953a0-afe2-43c6-91b8-550974de8946 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.169556 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e97c1b-e03f-4ee5-9aea-f009f459d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.170390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97c1b-e03f-4ee5-9aea-f009f459d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.170721 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97c1b-e03f-4ee5-9aea-f009f459d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.171029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e97c1b-e03f-4ee5-9aea-f009f459d3d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.182125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e97c1b-e03f-4ee5-9aea-f009f459d3d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-33e97c1b-e03f-4ee5-9aea-f009f459d3d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:26.191447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:26.192549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 232/444] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:26.193825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e97c1b-e03f-4ee5-9aea-f009f459d3d5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.242496 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883953a0-afe2-43c6-91b8-550974de8946 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.274864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.275512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.275818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.276099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.276941 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] RBAC: Adding query filter params (group.id=d4bd990c9ec54595890b2014dbe63931, role.id=7f13f524fe7d4fd4a929550d9f95b314, scope.project.id=11cfce196d9849c1a4cc1837312570af) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:26.277261 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.278699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.284564 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 213/445] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/role_assignments?group.id=d4bd990c9ec54595890b2014dbe63931&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=7f13f524fe7d4fd4a929550d9f95b314 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:26.285287 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.305089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e97c1b-e03f-4ee5-9aea-f009f459d3d5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.342837 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.343583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.343908 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.344196 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.344968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:26.345277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.346777 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.362154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 233/446] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:26.363475 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.397039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa00b21-ce8b-4186-9b6b-fbf1f79776ed None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.432847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.433527 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.433812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.434104 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.434944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:26.435255 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.436955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.451005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 214/447] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:26.452860 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.480438 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4238175-5d15-4ea8-a37c-85b597473321 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.523037 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce8ccf-2be5-4a1b-a574-04502d28772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.524229 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8ccf-2be5-4a1b-a574-04502d28772b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.524645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8ccf-2be5-4a1b-a574-04502d28772b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.524935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce8ccf-2be5-4a1b-a574-04502d28772b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.569872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed078-4178-404a-aceb-4a2ab81cabea None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.603110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce8ccf-2be5-4a1b-a574-04502d28772b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.604690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce8ccf-2be5-4a1b-a574-04502d28772b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.609092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b27db-2f65-425e-8ff0-03da863bc378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.609752 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b27db-2f65-425e-8ff0-03da863bc378 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.610035 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b27db-2f65-425e-8ff0-03da863bc378 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.610309 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b27db-2f65-425e-8ff0-03da863bc378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.690866 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b27db-2f65-425e-8ff0-03da863bc378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.692370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b27db-2f65-425e-8ff0-03da863bc378 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.713136 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 234/448] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:42:26.718659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce8ccf-2be5-4a1b-a574-04502d28772b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.792084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 215/449] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:26.797872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b27db-2f65-425e-8ff0-03da863bc378 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.814961 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce8ccf-2be5-4a1b-a574-04502d28772b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.847610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859898d-4cb8-46da-80f5-b8532881a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.848434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859898d-4cb8-46da-80f5-b8532881a99e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.848722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859898d-4cb8-46da-80f5-b8532881a99e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.848998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859898d-4cb8-46da-80f5-b8532881a99e None admin] PATH_INFO: `/v3/projects/cc880447f6bd497e832e82cd644c7320` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.850186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859898d-4cb8-46da-80f5-b8532881a99e None admin] RBAC: Authorizing `identity:get_project(project_id=cc880447f6bd497e832e82cd644c7320)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.851639 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859898d-4cb8-46da-80f5-b8532881a99e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.853363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 235/450] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/projects/cc880447f6bd497e832e82cd644c7320 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:26.858727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859898d-4cb8-46da-80f5-b8532881a99e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.894953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b27db-2f65-425e-8ff0-03da863bc378 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.927416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333b0f-a953-4c92-9462-38d3bec5cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.928301 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333b0f-a953-4c92-9462-38d3bec5cf9e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.928589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333b0f-a953-4c92-9462-38d3bec5cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.928867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333b0f-a953-4c92-9462-38d3bec5cf9e None admin] PATH_INFO: `/v3/projects/11cfce196d9849c1a4cc1837312570af` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.930062 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8333b0f-a953-4c92-9462-38d3bec5cf9e None admin] RBAC: Authorizing `identity:get_project(project_id=11cfce196d9849c1a4cc1837312570af)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.931501 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8333b0f-a953-4c92-9462-38d3bec5cf9e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.933229 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 216/451] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/projects/11cfce196d9849c1a4cc1837312570af => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:26.938969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333b0f-a953-4c92-9462-38d3bec5cf9e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:26.953383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859898d-4cb8-46da-80f5-b8532881a99e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:26.986600 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c2aab-64c4-48ae-9170-7e420c9446e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:26.987846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2aab-64c4-48ae-9170-7e420c9446e1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:26.988133 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2aab-64c4-48ae-9170-7e420c9446e1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:26.988411 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2aab-64c4-48ae-9170-7e420c9446e1 None admin] PATH_INFO: `/v3/groups/d50fecc2a8204974a337b9c1f469ff3b` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:26.989642 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c2aab-64c4-48ae-9170-7e420c9446e1 None admin] RBAC: Authorizing `identity:get_group(group_id=d50fecc2a8204974a337b9c1f469ff3b)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:26.991122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c2aab-64c4-48ae-9170-7e420c9446e1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:26.992796 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 236/452] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/groups/d50fecc2a8204974a337b9c1f469ff3b => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:26.998452 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c2aab-64c4-48ae-9170-7e420c9446e1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:27.035968 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8333b0f-a953-4c92-9462-38d3bec5cf9e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:27.069092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3ee2-2097-4e8b-942b-957f4d238d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:27.069934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3ee2-2097-4e8b-942b-957f4d238d89 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:27.070214 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3ee2-2097-4e8b-942b-957f4d238d89 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:27.070486 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3ee2-2097-4e8b-942b-957f4d238d89 None admin] PATH_INFO: `/v3/groups/d4bd990c9ec54595890b2014dbe63931` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:27.071659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3ee2-2097-4e8b-942b-957f4d238d89 None admin] RBAC: Authorizing `identity:get_group(group_id=d4bd990c9ec54595890b2014dbe63931)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:27.073107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3ee2-2097-4e8b-942b-957f4d238d89 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:27.074709 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 217/453] 10.222.0.32 () {56 vars in 1180 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/groups/d4bd990c9ec54595890b2014dbe63931 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:27.080696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3ee2-2097-4e8b-942b-957f4d238d89 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:27.094687 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c2aab-64c4-48ae-9170-7e420c9446e1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:27.128637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73ba58-fafd-4238-98a9-173a17b900b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:27.129225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ba58-fafd-4238-98a9-173a17b900b0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:27.129512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ba58-fafd-4238-98a9-173a17b900b0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:27.129790 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ba58-fafd-4238-98a9-173a17b900b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:27.130618 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ba58-fafd-4238-98a9-173a17b900b0 None admin] RBAC: Adding query filter params (group.id=d50fecc2a8204974a337b9c1f469ff3b, role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=cc880447f6bd497e832e82cd644c7320) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:27.130931 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ba58-fafd-4238-98a9-173a17b900b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:27.132434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ba58-fafd-4238-98a9-173a17b900b0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:27.138145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 237/454] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:26 2022] GET /identity/v3/role_assignments?group.id=d50fecc2a8204974a337b9c1f469ff3b&scope.project.id=cc880447f6bd497e832e82cd644c7320&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:27.182438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3ee2-2097-4e8b-942b-957f4d238d89 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:27.218715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c325c76-9a28-4330-857e-f94188b033a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:27.219387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c325c76-9a28-4330-857e-f94188b033a4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:27.219670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c325c76-9a28-4330-857e-f94188b033a4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:27.219972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c325c76-9a28-4330-857e-f94188b033a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:27.220819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c325c76-9a28-4330-857e-f94188b033a4 None admin] RBAC: Adding query filter params (group.id=d4bd990c9ec54595890b2014dbe63931, role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=11cfce196d9849c1a4cc1837312570af) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:27.221931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c325c76-9a28-4330-857e-f94188b033a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:27.223589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c325c76-9a28-4330-857e-f94188b033a4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:27.230169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 218/455] 10.222.0.32 () {56 vars in 1376 bytes} [Mon May 9 15:42:27 2022] GET /identity/v3/role_assignments?group.id=d4bd990c9ec54595890b2014dbe63931&scope.project.id=11cfce196d9849c1a4cc1837312570af&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:30.021313 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d878-08bd-4478-b5fd-9e5441a9ab19 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.022359 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d878-08bd-4478-b5fd-9e5441a9ab19 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.022866 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d878-08bd-4478-b5fd-9e5441a9ab19 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.024768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 238/456] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:30.030615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206afa-00a7-4cc0-9927-fe21e69d2bd3 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.031439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206afa-00a7-4cc0-9927-fe21e69d2bd3 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.031969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206afa-00a7-4cc0-9927-fe21e69d2bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.055970 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-01206afa-00a7-4cc0-9927-fe21e69d2bd3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:30.057548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-01206afa-00a7-4cc0-9927-fe21e69d2bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:30.155387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 219/457] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:30.193972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d878-08bd-4478-b5fd-9e5441a9ab19 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:30.208549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c86f0-19b1-4c3a-90e3-1df61d51dc04 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.209196 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c86f0-19b1-4c3a-90e3-1df61d51dc04 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.209733 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c86f0-19b1-4c3a-90e3-1df61d51dc04 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.214069 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 220/458] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:30.218046 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791ba7-bfe8-4cdf-8fa7-94122cae9a2f None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.218580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791ba7-bfe8-4cdf-8fa7-94122cae9a2f None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.219085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a791ba7-bfe8-4cdf-8fa7-94122cae9a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.256350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-1a791ba7-bfe8-4cdf-8fa7-94122cae9a2f None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:30.258642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-1a791ba7-bfe8-4cdf-8fa7-94122cae9a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:30.377897 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 221/459] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:30.382432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d878-08bd-4478-b5fd-9e5441a9ab19 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:30.414340 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791ba7-bfe8-4cdf-8fa7-94122cae9a2f None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:30.432205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:30.433017 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.433302 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.433575 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.451462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:30.452989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:30.490477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:30.491579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:30.492637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:30.492637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:30.492637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:30.492637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:30.493435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 239/460] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:30.499364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:30.559155 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a791ba7-bfe8-4cdf-8fa7-94122cae9a2f None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:30.626830 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:30.628560 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.629051 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.629537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.643963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:30.646408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:30.673210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:30.674851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:30.676085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:30.676085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:30.676085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:30.676085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:30.686547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6d23a-74e7-4b34-b29f-b822fe367f3b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:30.689106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 222/461] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:30.698313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:30.751211 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:30.752280 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.752727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.753178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.754104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:30.755729 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:30.758046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:30.787689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 240/462] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:30.793053 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:30.865935 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8433d4-71d1-4505-9c44-0d045138037a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:30.917468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37af9-5381-4b70-a7f6-0748a51c04b6 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:30.923176 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ef5cc-e625-44bb-9f3c-9be946283d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:30.923927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ef5cc-e625-44bb-9f3c-9be946283d59 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.924219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ef5cc-e625-44bb-9f3c-9be946283d59 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.924502 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ef5cc-e625-44bb-9f3c-9be946283d59 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.925741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ef5cc-e625-44bb-9f3c-9be946283d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:30.926119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ef5cc-e625-44bb-9f3c-9be946283d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:30.927969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ef5cc-e625-44bb-9f3c-9be946283d59 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:30.944077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 223/463] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:30.945738 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b910db-8511-4a39-8557-2d579106612e None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.946250 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b910db-8511-4a39-8557-2d579106612e None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.946544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b910db-8511-4a39-8557-2d579106612e None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.949307 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 224/464] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:30.950363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b910db-8511-4a39-8557-2d579106612e None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:30.961581 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349c857-ecc7-4730-8ab1-ceb17b68229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:30.962269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349c857-ecc7-4730-8ab1-ceb17b68229b None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:30.962556 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349c857-ecc7-4730-8ab1-ceb17b68229b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:30.962837 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349c857-ecc7-4730-8ab1-ceb17b68229b None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:30.963571 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349c857-ecc7-4730-8ab1-ceb17b68229b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:30.965536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349c857-ecc7-4730-8ab1-ceb17b68229b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:31.000030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 241/465] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:42:30 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:42:31.001793 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2f0f-2b5f-4a68-b35c-c1cfb99f0595 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.002667 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2f0f-2b5f-4a68-b35c-c1cfb99f0595 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.002952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee2f0f-2b5f-4a68-b35c-c1cfb99f0595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.043983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-1eee2f0f-2b5f-4a68-b35c-c1cfb99f0595 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:31.047611 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-1eee2f0f-2b5f-4a68-b35c-c1cfb99f0595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:31.104489 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b910db-8511-4a39-8557-2d579106612e None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:31.136882 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 242/466] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:31.138537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ddf53-ad9b-4329-be08-eb239b4fde6f None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.139006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ddf53-ad9b-4329-be08-eb239b4fde6f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.139446 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ddf53-ad9b-4329-be08-eb239b4fde6f None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.141037 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 243/467] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:31.150082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b31a94-b15b-4635-8530-aa091c8b9462 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.150609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b31a94-b15b-4635-8530-aa091c8b9462 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.151077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b31a94-b15b-4635-8530-aa091c8b9462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.174786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e923e-fd2b-42c1-8751-5b12d20b9159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:31.176592 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e923e-fd2b-42c1-8751-5b12d20b9159 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.176879 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e923e-fd2b-42c1-8751-5b12d20b9159 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.177159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e923e-fd2b-42c1-8751-5b12d20b9159 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.177919 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e923e-fd2b-42c1-8751-5b12d20b9159 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:31.179445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e923e-fd2b-42c1-8751-5b12d20b9159 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:31.193281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-63b31a94-b15b-4635-8530-aa091c8b9462 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:31.194871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-63b31a94-b15b-4635-8530-aa091c8b9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:31.210364 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 225/468] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:42:30 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:31.211794 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e923e-fd2b-42c1-8751-5b12d20b9159 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:31.284632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 244/469] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:31.318412 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b31a94-b15b-4635-8530-aa091c8b9462 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:31.363196 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e923e-fd2b-42c1-8751-5b12d20b9159 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:31.411615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:31.413522 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.414080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.414605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.431865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:31.434096 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:31.443688 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b31a94-b15b-4635-8530-aa091c8b9462 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:31.458018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:31.459170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:31.461519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:31.461519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:31.461519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:31.461519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:31.461519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 226/470] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:31.467268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:31.490398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cb392-e10c-4885-9897-0c1df267563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:31.491308 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cb392-e10c-4885-9897-0c1df267563f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.491602 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cb392-e10c-4885-9897-0c1df267563f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.491921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cb392-e10c-4885-9897-0c1df267563f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.503122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cb392-e10c-4885-9897-0c1df267563f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:31.505512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cb392-e10c-4885-9897-0c1df267563f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-ef1cb392-e10c-4885-9897-0c1df267563f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:31.532549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:31.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:31.535972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:31.535972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:31.535972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:31.535972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:31.535972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 245/471] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:31.536283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142779-3751-4450-8510-c24e88b7db14 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.536967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142779-3751-4450-8510-c24e88b7db14 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.536967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142779-3751-4450-8510-c24e88b7db14 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.538591 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 246/472] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:31.540083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142779-3751-4450-8510-c24e88b7db14 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:31.597294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c5451-f890-42b0-8065-d547b68a95d7 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:31.635629 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9d1d-ec45-479a-bd4a-9b02f4e7d477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:31.636701 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9d1d-ec45-479a-bd4a-9b02f4e7d477 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.637146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9d1d-ec45-479a-bd4a-9b02f4e7d477 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.637629 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9d1d-ec45-479a-bd4a-9b02f4e7d477 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.638933 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad9d1d-ec45-479a-bd4a-9b02f4e7d477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:31.639433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad9d1d-ec45-479a-bd4a-9b02f4e7d477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:31.641731 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad9d1d-ec45-479a-bd4a-9b02f4e7d477 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:31.660209 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 227/473] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:31.662398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353f98-ad3a-4346-b130-e2f19bb3ed72 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.663184 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353f98-ad3a-4346-b130-e2f19bb3ed72 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.663981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353f98-ad3a-4346-b130-e2f19bb3ed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.667557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142779-3751-4450-8510-c24e88b7db14 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:31.685707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-cc353f98-ad3a-4346-b130-e2f19bb3ed72 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:31.687067 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-cc353f98-ad3a-4346-b130-e2f19bb3ed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:31.709225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545595-412c-462c-964c-347404625c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:31.710294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545595-412c-462c-964c-347404625c3f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.710791 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545595-412c-462c-964c-347404625c3f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.711285 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545595-412c-462c-964c-347404625c3f None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.712395 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545595-412c-462c-964c-347404625c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:31.712917 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545595-412c-462c-964c-347404625c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:31.714586 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545595-412c-462c-964c-347404625c3f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:31.728197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 247/474] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:31.729474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545595-412c-462c-964c-347404625c3f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:31.758217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 228/475] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:31.759130 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc353f98-ad3a-4346-b130-e2f19bb3ed72 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:31.840006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545595-412c-462c-964c-347404625c3f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:31.871022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc353f98-ad3a-4346-b130-e2f19bb3ed72 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:31.876234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99c724-f0a8-4fac-9584-bd2e7a80ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:31.877448 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c724-f0a8-4fac-9584-bd2e7a80ca82 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.877761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c724-f0a8-4fac-9584-bd2e7a80ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.877761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99c724-f0a8-4fac-9584-bd2e7a80ca82 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.878887 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99c724-f0a8-4fac-9584-bd2e7a80ca82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:31.880432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99c724-f0a8-4fac-9584-bd2e7a80ca82 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:31.908032 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 248/476] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:42:31 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:31.909828 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99c724-f0a8-4fac-9584-bd2e7a80ca82 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:31.917933 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed239b7a-4770-4823-bf86-18231b9682d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:31.920677 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239b7a-4770-4823-bf86-18231b9682d5 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:31.920985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239b7a-4770-4823-bf86-18231b9682d5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:31.922522 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239b7a-4770-4823-bf86-18231b9682d5 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:31.923298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed239b7a-4770-4823-bf86-18231b9682d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:31.926213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed239b7a-4770-4823-bf86-18231b9682d5 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:31.998869 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 229/477] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:42:31 2022] POST /identity/v3/users => generated 249 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:32.061199 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99c724-f0a8-4fac-9584-bd2e7a80ca82 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:32.121685 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:32.122428 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:32.122726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:32.123023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:32.123890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:32.125349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:32.136337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.sql.core [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:42:32.136337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:42:32.136337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [parameters: {'id': 'abd93978242b4480851309af80fffe82', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:42:32.136337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=275842) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application conn.query(q) May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application result.read() May 09 15:42:32.154987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return ref.to_dict() May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:42:32.157527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application next(self.gen) May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application yield resource May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application next(self.gen) May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise self.value May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application session.commit() May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:42:32.161615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self.session.flush() May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application compat.raise_( May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:42:32.164267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:42:32.166616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application conn.query(q) May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application result.read() May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:42:32.168872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [parameters: {'id': 'abd93978242b4480851309af80fffe82', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:32.170977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:42:32.177830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:32.180696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 249/478] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:42:31 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:32.180860 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed239b7a-4770-4823-bf86-18231b9682d5 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:32.281302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed239b7a-4770-4823-bf86-18231b9682d5 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:32.317937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e0ee-b02a-4b6c-ad39-811830b90488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:32.318773 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e0ee-b02a-4b6c-ad39-811830b90488 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:32.319065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e0ee-b02a-4b6c-ad39-811830b90488 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:32.319340 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e0ee-b02a-4b6c-ad39-811830b90488 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:32.333297 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157e0ee-b02a-4b6c-ad39-811830b90488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-d157e0ee-b02a-4b6c-ad39-811830b90488 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:32.341474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:32.344093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:32.348063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 230/479] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:42:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:32.349886 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:32.468082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3152f-ca77-40ae-b2e1-708b018419a7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:32.510484 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9ce4c-f453-4431-b56f-a1b8ae1246ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:32.511176 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ce4c-f453-4431-b56f-a1b8ae1246ef None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:32.511465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ce4c-f453-4431-b56f-a1b8ae1246ef None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:32.511746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ce4c-f453-4431-b56f-a1b8ae1246ef None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:32.512546 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9ce4c-f453-4431-b56f-a1b8ae1246ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:32.512859 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9ce4c-f453-4431-b56f-a1b8ae1246ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:32.514257 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9ce4c-f453-4431-b56f-a1b8ae1246ef None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:32.526905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 250/480] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:33.906097 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d41e-a5a2-48e5-80bf-2f85496de955 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:33.906842 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d41e-a5a2-48e5-80bf-2f85496de955 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:33.906842 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4d41e-a5a2-48e5-80bf-2f85496de955 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:33.909451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 231/481] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:33.915093 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358501-4cf2-436d-a0f2-7445644e69d9 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:33.915624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358501-4cf2-436d-a0f2-7445644e69d9 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:33.915832 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358501-4cf2-436d-a0f2-7445644e69d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:33.937009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-88358501-4cf2-436d-a0f2-7445644e69d9 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:33.938292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-88358501-4cf2-436d-a0f2-7445644e69d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:34.005391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c48b6-322b-44a3-a29e-b67f4d9ce6d5 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.005740 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c48b6-322b-44a3-a29e-b67f4d9ce6d5 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.006098 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c48b6-322b-44a3-a29e-b67f4d9ce6d5 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.011878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 232/482] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:34.025656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b7eab-e085-4f57-a6a6-2c797e236a70 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.025961 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b7eab-e085-4f57-a6a6-2c797e236a70 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.026248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b7eab-e085-4f57-a6a6-2c797e236a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.027617 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 251/483] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:34.067361 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-c94b7eab-e085-4f57-a6a6-2c797e236a70 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:34.068648 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-c94b7eab-e085-4f57-a6a6-2c797e236a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:34.079599 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358501-4cf2-436d-a0f2-7445644e69d9 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:34.200448 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358501-4cf2-436d-a0f2-7445644e69d9 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:34.206011 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 233/484] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:34.236241 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb484e9-49af-439e-b3c2-306c90507b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:34.237054 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb484e9-49af-439e-b3c2-306c90507b2a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.237363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb484e9-49af-439e-b3c2-306c90507b2a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.237609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb484e9-49af-439e-b3c2-306c90507b2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.248008 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb484e9-49af-439e-b3c2-306c90507b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:34.254289 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b7eab-e085-4f57-a6a6-2c797e236a70 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-ceb484e9-49af-439e-b3c2-306c90507b2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:34.256501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:34.258798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:34.259956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 252/485] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:34.266821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb484e9-49af-439e-b3c2-306c90507b2a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:34.377641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb484e9-49af-439e-b3c2-306c90507b2a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:34.413116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:34.413808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.414095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.414377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.415133 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:34.415444 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:34.416867 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:34.426502 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 253/486] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:34.432130 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:34.464714 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b7eab-e085-4f57-a6a6-2c797e236a70 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:34.533148 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632d68d-3c8d-40fd-a699-e04668cafc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:34.534124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d68d-3c8d-40fd-a699-e04668cafc31 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.534336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d68d-3c8d-40fd-a699-e04668cafc31 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.534624 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632d68d-3c8d-40fd-a699-e04668cafc31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.540210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073f863-d09a-4331-b6c7-0f7720098de4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:34.556914 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632d68d-3c8d-40fd-a699-e04668cafc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-d632d68d-3c8d-40fd-a699-e04668cafc31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:34.573061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:34.574146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:34.575142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 234/487] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:34.575963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:34.576588 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.576588 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.576983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.581217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632d68d-3c8d-40fd-a699-e04668cafc31 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:34.588920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:34.590474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:34.608148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:34.610376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:34.613948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:34.613948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:34.613948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:34.613948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:34.613948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 254/488] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:34.619816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:34.714806 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632d68d-3c8d-40fd-a699-e04668cafc31 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:34.746342 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7647de-6078-4822-9c98-95758c9777f7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:34.750490 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0843b-1bb3-4874-848d-3035f5c78d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:34.751173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0843b-1bb3-4874-848d-3035f5c78d5c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.751461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0843b-1bb3-4874-848d-3035f5c78d5c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.751741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0843b-1bb3-4874-848d-3035f5c78d5c None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.753540 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0843b-1bb3-4874-848d-3035f5c78d5c None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:34.753771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0843b-1bb3-4874-848d-3035f5c78d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:34.755144 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0843b-1bb3-4874-848d-3035f5c78d5c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:34.769543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 235/489] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:34.771066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a21d4-16e4-46f9-aaf1-9f83bc85999c None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.771367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a21d4-16e4-46f9-aaf1-9f83bc85999c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.771651 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a21d4-16e4-46f9-aaf1-9f83bc85999c None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.773700 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 236/490] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:34.774564 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a21d4-16e4-46f9-aaf1-9f83bc85999c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:34.786027 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786fc1e-a6d0-4e8a-b4b4-a62d145f8e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:34.787087 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fc1e-a6d0-4e8a-b4b4-a62d145f8e88 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.787384 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fc1e-a6d0-4e8a-b4b4-a62d145f8e88 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.787664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fc1e-a6d0-4e8a-b4b4-a62d145f8e88 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.788770 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786fc1e-a6d0-4e8a-b4b4-a62d145f8e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:34.789490 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786fc1e-a6d0-4e8a-b4b4-a62d145f8e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:34.791051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786fc1e-a6d0-4e8a-b4b4-a62d145f8e88 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:34.807644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 255/491] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:34.809002 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1921c-1621-4ca5-a961-d66d201df408 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.809295 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1921c-1621-4ca5-a961-d66d201df408 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.809576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1921c-1621-4ca5-a961-d66d201df408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.829834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-62f1921c-1621-4ca5-a961-d66d201df408 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:34.832090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-62f1921c-1621-4ca5-a961-d66d201df408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:34.884598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a21d4-16e4-46f9-aaf1-9f83bc85999c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:34.914812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 256/492] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:34.915852 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1921c-1621-4ca5-a961-d66d201df408 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:34.924846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:34.925660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:34.926317 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:34.926604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:34.941272 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:34.943360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:34.968771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:34.971423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:34.973853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:34.973853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:34.973853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:34.973853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:34.973853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 237/493] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:34.973853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.030719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1921c-1621-4ca5-a961-d66d201df408 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.068273 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.069090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.069437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.069817 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.077348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:35.078886 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:35.082761 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f67ca3-d91c-4164-b375-4319f574ccfd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:35.096745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:35.099233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:42:35.101812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:35.103268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 257/494] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:35.109576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.116785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a530cf-aa34-4297-b127-56707c4d5ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.117598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a530cf-aa34-4297-b127-56707c4d5ec8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.117884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a530cf-aa34-4297-b127-56707c4d5ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.118163 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a530cf-aa34-4297-b127-56707c4d5ec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.129499 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a530cf-aa34-4297-b127-56707c4d5ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-71a530cf-aa34-4297-b127-56707c4d5ec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:35.137350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:35.139699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 238/495] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:35.141953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a530cf-aa34-4297-b127-56707c4d5ec8 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.222309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949f83-7180-4738-9cd4-7d996d09a6fb None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.243573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a530cf-aa34-4297-b127-56707c4d5ec8 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.255955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.256659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.256947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.257268 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.257949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:35.258261 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:35.259715 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:35.276182 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 258/496] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:35.276182 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.282435 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8730e0-a880-41ff-981f-e46f1b573c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.283173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8730e0-a880-41ff-981f-e46f1b573c1f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.284631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8730e0-a880-41ff-981f-e46f1b573c1f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.284921 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8730e0-a880-41ff-981f-e46f1b573c1f None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.285774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8730e0-a880-41ff-981f-e46f1b573c1f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:35.286090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8730e0-a880-41ff-981f-e46f1b573c1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:35.287530 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8730e0-a880-41ff-981f-e46f1b573c1f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:35.325163 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 239/497] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:35.326876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebecc4-5aa0-4c49-935c-0b8d2acde1d1 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.327231 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebecc4-5aa0-4c49-935c-0b8d2acde1d1 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.327602 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebecc4-5aa0-4c49-935c-0b8d2acde1d1 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.331817 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 240/498] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:35.331817 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebecc4-5aa0-4c49-935c-0b8d2acde1d1 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.381055 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e072e-f01b-4606-8d70-c31f196873b2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.415710 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.416420 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.416706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.416986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.417741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:35.418053 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:35.419436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:35.427603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 259/499] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:35.428436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.450142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebecc4-5aa0-4c49-935c-0b8d2acde1d1 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.490504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5f22c-bf32-4845-8e88-630da6f57f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.491230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5f22c-bf32-4845-8e88-630da6f57f65 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.491525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5f22c-bf32-4845-8e88-630da6f57f65 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.492100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5f22c-bf32-4845-8e88-630da6f57f65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.499622 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5f22c-bf32-4845-8e88-630da6f57f65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:35.501208 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5f22c-bf32-4845-8e88-630da6f57f65 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-82b5f22c-bf32-4845-8e88-630da6f57f65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:35.519171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:35.520688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:42:35.521735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:35.524096 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 241/500] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:35.525728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabd7b7-ea3b-4eff-bed3-258f505d0dd4 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.526020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabd7b7-ea3b-4eff-bed3-258f505d0dd4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.526303 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabd7b7-ea3b-4eff-bed3-258f505d0dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.538422 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70569ee-5d77-4a10-b2e1-0f2b3f0910d9 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.543687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-2aabd7b7-ea3b-4eff-bed3-258f505d0dd4 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:35.544912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-2aabd7b7-ea3b-4eff-bed3-258f505d0dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:35.573392 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52e9cc-a419-4a0a-bc1e-beeed4a472c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.574049 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52e9cc-a419-4a0a-bc1e-beeed4a472c4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.574336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52e9cc-a419-4a0a-bc1e-beeed4a472c4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.574616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52e9cc-a419-4a0a-bc1e-beeed4a472c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.614126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 242/501] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:35.615360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabd7b7-ea3b-4eff-bed3-258f505d0dd4 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.652126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52e9cc-a419-4a0a-bc1e-beeed4a472c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:35.653602 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52e9cc-a419-4a0a-bc1e-beeed4a472c4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:35.721361 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabd7b7-ea3b-4eff-bed3-258f505d0dd4 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.749100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 260/502] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:35.749872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52e9cc-a419-4a0a-bc1e-beeed4a472c4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.755478 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c26d66-6822-487e-ac36-e4df9601cb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.756309 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c26d66-6822-487e-ac36-e4df9601cb0d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.756595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c26d66-6822-487e-ac36-e4df9601cb0d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.756871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c26d66-6822-487e-ac36-e4df9601cb0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.766818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c26d66-6822-487e-ac36-e4df9601cb0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:35.768938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c26d66-6822-487e-ac36-e4df9601cb0d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-e1c26d66-6822-487e-ac36-e4df9601cb0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:35.785835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:35.787000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:35.788050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:35.788050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:35.788050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:35.788050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:35.788050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 243/503] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:35.788733 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa864b9-fd7e-4655-b828-6ba504daaf2c None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.789023 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa864b9-fd7e-4655-b828-6ba504daaf2c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.789411 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa864b9-fd7e-4655-b828-6ba504daaf2c None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.790926 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 244/504] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:35.791727 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa864b9-fd7e-4655-b828-6ba504daaf2c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.847485 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52e9cc-a419-4a0a-bc1e-beeed4a472c4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.879916 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.880584 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.880867 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.881152 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.881980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:35.882289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:35.883739 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:35.889240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa864b9-fd7e-4655-b828-6ba504daaf2c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:35.919349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 261/505] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:35.920216 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:35.921519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967fe4-ee6f-4031-b1ba-4f7d7dc9de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:35.922316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967fe4-ee6f-4031-b1ba-4f7d7dc9de44 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:35.922600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967fe4-ee6f-4031-b1ba-4f7d7dc9de44 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:35.922872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4967fe4-ee6f-4031-b1ba-4f7d7dc9de44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:35.933407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4967fe4-ee6f-4031-b1ba-4f7d7dc9de44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-c4967fe4-ee6f-4031-b1ba-4f7d7dc9de44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:35.942106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:35.943268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 245/506] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:35.944397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967fe4-ee6f-4031-b1ba-4f7d7dc9de44 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.016342 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a195cef-bfa0-4c67-a331-4c2a6a42d08e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.041684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4967fe4-ee6f-4031-b1ba-4f7d7dc9de44 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.048453 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697891e-378d-4300-8f5f-1db684943616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.049817 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697891e-378d-4300-8f5f-1db684943616 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.050182 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697891e-378d-4300-8f5f-1db684943616 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.050463 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697891e-378d-4300-8f5f-1db684943616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.060187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697891e-378d-4300-8f5f-1db684943616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.061915 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697891e-378d-4300-8f5f-1db684943616 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.074356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.075015 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.075299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.075576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.076339 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:36.076646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.078013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-a697891e-378d-4300-8f5f-1db684943616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:36.079722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:36.080980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:36.081959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:36.081959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:36.081959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:36.081959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:36.085304 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 262/507] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:36.085304 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc7e4-efb4-4f75-8825-1a2b58f4d549 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.085863 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc7e4-efb4-4f75-8825-1a2b58f4d549 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.086143 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cc7e4-efb4-4f75-8825-1a2b58f4d549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.089746 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 246/508] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:36.090759 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.105847 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-158cc7e4-efb4-4f75-8825-1a2b58f4d549 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:36.107050 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-158cc7e4-efb4-4f75-8825-1a2b58f4d549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:36.180426 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 263/509] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:36.181587 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cc7e4-efb4-4f75-8825-1a2b58f4d549 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.194207 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c436d-edce-40b8-a0f3-3309ed8c08ee None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.229090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91752d3-48d6-4ed6-82cc-e64cea60c411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.229742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91752d3-48d6-4ed6-82cc-e64cea60c411 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.230026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91752d3-48d6-4ed6-82cc-e64cea60c411 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.230304 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91752d3-48d6-4ed6-82cc-e64cea60c411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.276715 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cc7e4-efb4-4f75-8825-1a2b58f4d549 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.295403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91752d3-48d6-4ed6-82cc-e64cea60c411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.296874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91752d3-48d6-4ed6-82cc-e64cea60c411 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.309611 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.310275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.310562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.310838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.311582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:36.312168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.313552 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.321374 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 264/510] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:36.322164 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.393763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 247/511] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:36.394607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91752d3-48d6-4ed6-82cc-e64cea60c411 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.418444 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f28ff-36b8-40c5-8830-bd76566339a2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.450734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.451392 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.451675 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.451980 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.452700 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:36.453007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.454390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.465934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 265/512] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:36.466551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.495779 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91752d3-48d6-4ed6-82cc-e64cea60c411 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.528879 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.529605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.529887 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.530165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.537847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.539301 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:36.554487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:36.555687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 248/513] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:36.556812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.566334 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da950a8d-fcc9-4b50-a03a-0248be346b48 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.599708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.600527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.600816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.601088 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.610707 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.612756 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:36.630758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:36.631966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:36.633006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:36.633006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:36.633006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:36.633006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:36.633006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 266/514] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:36.633006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.653863 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1246-2a07-47f3-b68e-8c76a442c581 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.686175 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.687222 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.687513 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.687817 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.698378 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.699852 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:36.717417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:36.718429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:36.719428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:36.719428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:36.719428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:36.719428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:36.719428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 249/515] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:36.719428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.734335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44536e-c00e-49ba-87ea-2a60f0ba8e2e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.767208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.768559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.768845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.769123 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.779052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.780501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:36.798368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:36.799645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:36.800683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:36.800683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:36.800683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:36.800683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:36.800683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 267/516] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:36.800683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.822885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151576f-2b84-4942-99e8-0c190b918a8e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.856187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.856987 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.857280 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.857559 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.864135 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.865594 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:36.879798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:36.880846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 250/517] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:36.881824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.901533 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9fca0-be76-45f6-8f24-e1c5534ba0c4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:36.934145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:36.934809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:36.935090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:36.935367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:36.936232 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:36.936542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:36.938226 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:36.954782 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 268/518] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:36.957035 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:36.978920 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae30f-9c4e-42bc-a653-1efebb29ac5a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.011938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.012603 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.012891 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.013171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.013892 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:37.014198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.015563 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.027703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 251/519] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:37.028532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.053835 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d4cfb-1ed9-4814-b169-26775e8755c0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.087652 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.088347 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.088635 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.088915 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.089634 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:37.089942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.091329 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.102277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 269/520] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:37.103077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.124353 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80863043-6deb-4dca-80cb-b88dff3ea956 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.158996 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.159670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.160049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.160273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.161021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:37.161335 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.162963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.175029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 252/521] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:37.176110 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.218454 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef986fd6-e3c5-46f8-be2f-6195cd435858 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.262013 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.263305 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.263699 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.264083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.264956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:37.265295 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.266724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.285698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 270/522] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:37.286552 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.291579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb38254-1954-48b5-814b-23039f95774c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.326217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f45e35-18cf-43a2-88d7-0ddcb5596bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.326791 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45e35-18cf-43a2-88d7-0ddcb5596bd1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.327078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45e35-18cf-43a2-88d7-0ddcb5596bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.327360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f45e35-18cf-43a2-88d7-0ddcb5596bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.397319 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c3a6-702d-4466-9010-6bb73ca3b712 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.403651 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f45e35-18cf-43a2-88d7-0ddcb5596bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.405335 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f45e35-18cf-43a2-88d7-0ddcb5596bd1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.432883 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa090d71-b069-48a5-8974-12afa2f5b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.433553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa090d71-b069-48a5-8974-12afa2f5b05d None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.433842 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa090d71-b069-48a5-8974-12afa2f5b05d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.434123 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa090d71-b069-48a5-8974-12afa2f5b05d None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.434834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa090d71-b069-48a5-8974-12afa2f5b05d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.436311 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa090d71-b069-48a5-8974-12afa2f5b05d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.459029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 271/523] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:42:37 2022] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:37.460013 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa090d71-b069-48a5-8974-12afa2f5b05d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.530083 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 253/524] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:37.531493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f45e35-18cf-43a2-88d7-0ddcb5596bd1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.582172 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa090d71-b069-48a5-8974-12afa2f5b05d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.617803 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.618629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.618919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.619200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.628005 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.629529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.641816 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f45e35-18cf-43a2-88d7-0ddcb5596bd1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:37.644831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:37.645983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:42:37.647023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:37.652346 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 272/525] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:37.653131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.680146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.680952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.681243 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.681517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.689400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.691475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:37.708744 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:37.709847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 254/526] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:37.711360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.770486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccad6d-7617-44c0-a0da-2ac26aba153b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.803963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.804632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.804921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.805202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.806042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=4baf22712ed548668c853a85e686c4fb) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:37.806358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.807849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.823810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 273/527] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/role_assignments?user.id=4baf22712ed548668c853a85e686c4fb&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:37.824044 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925edad5-784d-4e9c-80fc-9b7d337c5c48 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.824145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.854249 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.855034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.855315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.855604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.868600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:37.870159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:37.892312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:37.894644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:37.897031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:37.897031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:37.897031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:37.897031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:37.897031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 255/528] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:37.897031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:37.959853 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164872f-3e63-413a-8cb6-fa5f7f85c8c1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:37.996664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:37.997764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:37.998281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:37.998778 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:37.999880 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:38.000416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.002658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.012260 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137b5a-6e6c-475d-9842-29ec5f7c0548 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.024843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 274/529] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:38.024843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.053500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.054186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.054480 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.054810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.055719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:38.056155 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.057748 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.077645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 256/530] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:38.078654 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.131710 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c791-d4df-4a9f-b527-570126d46009 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.169131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.169812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.170101 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.170377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.171103 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:38.171411 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.172933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.186933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 275/531] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:38.188112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.189001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f91d9d-534c-45b1-a8bc-a1ad2669de7a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.225148 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f9301-7ef3-40ef-9787-3ac6b496648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.225862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9301-7ef3-40ef-9787-3ac6b496648d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.226147 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9301-7ef3-40ef-9787-3ac6b496648d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.226429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f9301-7ef3-40ef-9787-3ac6b496648d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.297082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ae760-04bc-4b48-9579-a2de56c78a35 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.298064 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f9301-7ef3-40ef-9787-3ac6b496648d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.300477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f9301-7ef3-40ef-9787-3ac6b496648d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.334801 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.335475 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.335758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.336064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.336908 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=8bc210c9b3f94f09b32127dc754a2094) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:38.337222 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.338679 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.344811 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 276/532] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/role_assignments?user.id=8bc210c9b3f94f09b32127dc754a2094&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:38.345882 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.414693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 257/533] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:38.415685 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f9301-7ef3-40ef-9787-3ac6b496648d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.457364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab489d2-87d8-42d1-9f26-ac36d53d9bfe None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.494720 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.495536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.495845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.496125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.504437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.505912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.522670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f9301-7ef3-40ef-9787-3ac6b496648d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:38.523532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:38.525709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:38.528036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 277/534] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:38.535786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.585702 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.586588 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.586878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.587160 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.610002 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.612126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:38.653398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:38.656061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:38.658955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:38.658955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:38.658955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:38.658955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:38.658955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 258/535] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:38.662379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.712419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940590-e4ae-46e8-b86b-4665eb6d943e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.758780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.759461 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.759748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.760052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.762300 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:38.762615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.764108 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.792359 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 278/536] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:38.799602 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.885379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d43ac-a18d-412e-8b75-118f61a827c7 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.908621 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785531f-ea87-468e-a4dc-dc828ff8610a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:38.920925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.921930 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.922461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.922975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.924902 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:38.925458 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.927073 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.943909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 259/537] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:38.945440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:38.957429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:38.957953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:38.958247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:38.958538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:38.959385 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=07df2b10a2c5489faa1c01f5c1739d39) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:38.959703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:38.961197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:38.974326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 279/538] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/role_assignments?user.id=07df2b10a2c5489faa1c01f5c1739d39&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:39.072644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c856-7e6a-432f-a52a-b98788d7d122 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:39.112268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:39.113543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:39.114049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:39.114561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:39.122930 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:39.124821 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:39.141174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:39.142352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:39.143618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:39.143618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:39.143618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:39.143618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:39.143618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:39.143618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:39.143618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:39.143618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:39.146346 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 260/539] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:39.152267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:39.265651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133506c-ce3d-4a3b-8061-78b93188fb69 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:39.300879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563023d-7212-4ad3-88b1-35b86d604dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:39.301564 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563023d-7212-4ad3-88b1-35b86d604dde None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:39.301858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563023d-7212-4ad3-88b1-35b86d604dde None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:39.302143 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563023d-7212-4ad3-88b1-35b86d604dde None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:39.302941 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563023d-7212-4ad3-88b1-35b86d604dde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:39.303257 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563023d-7212-4ad3-88b1-35b86d604dde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:39.304740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563023d-7212-4ad3-88b1-35b86d604dde None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:39.319116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 280/540] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:39.324954 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:39.430282 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef79853-e3b9-499e-a512-1b804af07ed2 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:39.465582 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a62d63-cf5e-464d-b504-e31a25aed957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:39.466251 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a62d63-cf5e-464d-b504-e31a25aed957 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:39.466541 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a62d63-cf5e-464d-b504-e31a25aed957 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:39.466822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a62d63-cf5e-464d-b504-e31a25aed957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:39.467667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a62d63-cf5e-464d-b504-e31a25aed957 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=1516366a4e824577a524f49e0eda8880) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:39.468028 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a62d63-cf5e-464d-b504-e31a25aed957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:39.469525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a62d63-cf5e-464d-b504-e31a25aed957 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:39.476408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 261/541] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:39 2022] GET /identity/v3/role_assignments?user.id=1516366a4e824577a524f49e0eda8880&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:40.243883 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247b68-91e6-4e51-8de6-6b4884244698 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:40.244412 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247b68-91e6-4e51-8de6-6b4884244698 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:40.244538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247b68-91e6-4e51-8de6-6b4884244698 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:40.246079 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 281/542] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:40.252210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9217ff-eb0b-45d5-9a01-736536e8636a None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:40.252680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9217ff-eb0b-45d5-9a01-736536e8636a None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:40.253105 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9217ff-eb0b-45d5-9a01-736536e8636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:40.276787 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-4f9217ff-eb0b-45d5-9a01-736536e8636a None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:40.278018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-4f9217ff-eb0b-45d5-9a01-736536e8636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:40.360533 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 262/543] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:40.396838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247b68-91e6-4e51-8de6-6b4884244698 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:40.520664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247b68-91e6-4e51-8de6-6b4884244698 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:40.573056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50564e7-00f2-4513-8fde-c7d7a64298c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:40.573884 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50564e7-00f2-4513-8fde-c7d7a64298c5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:40.574176 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50564e7-00f2-4513-8fde-c7d7a64298c5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:40.574463 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50564e7-00f2-4513-8fde-c7d7a64298c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:40.591500 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50564e7-00f2-4513-8fde-c7d7a64298c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-b50564e7-00f2-4513-8fde-c7d7a64298c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:40.600335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:40.601364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:40.603360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 282/544] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:40.607362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9217ff-eb0b-45d5-9a01-736536e8636a None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:40.710021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9217ff-eb0b-45d5-9a01-736536e8636a None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:40.750959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25613ed-6760-4e36-abba-937e07e58f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:40.752252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25613ed-6760-4e36-abba-937e07e58f92 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:40.752573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25613ed-6760-4e36-abba-937e07e58f92 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:40.752859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25613ed-6760-4e36-abba-937e07e58f92 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:40.753637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25613ed-6760-4e36-abba-937e07e58f92 None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:40.753946 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25613ed-6760-4e36-abba-937e07e58f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:40.755332 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25613ed-6760-4e36-abba-937e07e58f92 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:40.764065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 263/545] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:40.771228 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50564e7-00f2-4513-8fde-c7d7a64298c5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:40.793713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa475bb-2bd5-4dd1-a978-05af89c1f70d None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:40.794087 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa475bb-2bd5-4dd1-a978-05af89c1f70d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:40.794264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa475bb-2bd5-4dd1-a978-05af89c1f70d None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:40.795919 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 264/546] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:40.801178 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ef5c-fe69-40e9-b6e7-fa60feffc119 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:40.801468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ef5c-fe69-40e9-b6e7-fa60feffc119 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:40.801754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ef5c-fe69-40e9-b6e7-fa60feffc119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:40.820065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-4dc5ef5c-fe69-40e9-b6e7-fa60feffc119 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:40.821450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-4dc5ef5c-fe69-40e9-b6e7-fa60feffc119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:40.903874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 265/547] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:40.945166 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ef5c-fe69-40e9-b6e7-fa60feffc119 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:40.993989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50564e7-00f2-4513-8fde-c7d7a64298c5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.059185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ef5c-fe69-40e9-b6e7-fa60feffc119 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.081951 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2eb9d-6a65-4d53-a0b1-0730e75d54f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.082770 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2eb9d-6a65-4d53-a0b1-0730e75d54f9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.083064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2eb9d-6a65-4d53-a0b1-0730e75d54f9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.083345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2eb9d-6a65-4d53-a0b1-0730e75d54f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.104122 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122a46-5c72-4cac-823a-4753d12f7062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.105340 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122a46-5c72-4cac-823a-4753d12f7062 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.105877 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122a46-5c72-4cac-823a-4753d12f7062 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.106364 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122a46-5c72-4cac-823a-4753d12f7062 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.109865 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2eb9d-6a65-4d53-a0b1-0730e75d54f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:41.111471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2eb9d-6a65-4d53-a0b1-0730e75d54f9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:41.118814 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99122a46-5c72-4cac-823a-4753d12f7062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-99122a46-5c72-4cac-823a-4753d12f7062 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:41.128531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:41.129713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:41.130658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:41.134050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 266/548] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:41.139974 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122a46-5c72-4cac-823a-4753d12f7062 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-4fb2eb9d-6a65-4d53-a0b1-0730e75d54f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:41.146768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:41.147805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:41.148838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:41.148838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:41.148838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:41.148838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:41.151869 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 283/549] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:41.153175 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d958653-d5a7-49c1-b019-8832a51b45ed None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.153471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d958653-d5a7-49c1-b019-8832a51b45ed None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.153758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d958653-d5a7-49c1-b019-8832a51b45ed None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.159736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 284/550] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:41.159736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d958653-d5a7-49c1-b019-8832a51b45ed None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.261501 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122a46-5c72-4cac-823a-4753d12f7062 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.291364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d958653-d5a7-49c1-b019-8832a51b45ed None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.297958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bb438-2269-402c-a762-4059fb3cc12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.298854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bb438-2269-402c-a762-4059fb3cc12d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.299147 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bb438-2269-402c-a762-4059fb3cc12d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.299426 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bb438-2269-402c-a762-4059fb3cc12d None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.300216 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bb438-2269-402c-a762-4059fb3cc12d None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:41.300524 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bb438-2269-402c-a762-4059fb3cc12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:41.301918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bb438-2269-402c-a762-4059fb3cc12d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:41.310806 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 267/551] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:41.312384 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94df3-98a3-4dee-bd8c-2a7640a357b4 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.312599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94df3-98a3-4dee-bd8c-2a7640a357b4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.312829 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94df3-98a3-4dee-bd8c-2a7640a357b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.330753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-a8a94df3-98a3-4dee-bd8c-2a7640a357b4 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:41.331390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.332109 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-a8a94df3-98a3-4dee-bd8c-2a7640a357b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:41.332580 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.333095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.333605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.334544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:41.335068 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:41.336714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:41.355211 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 285/552] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:41.356493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.401854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 268/553] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:41.402723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a94df3-98a3-4dee-bd8c-2a7640a357b4 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.461065 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85059a-2525-4678-b91c-9be233a400e3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.496851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.498071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.498578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.499071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.510582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:41.512397 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:41.527707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a94df3-98a3-4dee-bd8c-2a7640a357b4 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:41.536205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:41.537220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:41.538202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:41.538202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:41.538202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:41.538202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:41.541348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 286/554] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:41.542631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.565255 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.566064 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.566352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.566627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.574364 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:41.575821 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:41.590573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:41.591683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:42:41.593278 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:41.596997 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 269/555] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:41.597871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.677791 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee744de-3ab4-4e25-b4a0-0074571f7cbc None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.703107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823cf5a-4e25-4b68-a742-86f5c9e973f9 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.726946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e95ea8-4662-42f5-b6b6-bfcab5f774dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.728769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95ea8-4662-42f5-b6b6-bfcab5f774dc None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.729311 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95ea8-4662-42f5-b6b6-bfcab5f774dc None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.729938 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95ea8-4662-42f5-b6b6-bfcab5f774dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.738154 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.738826 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.739115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.739381 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.740157 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:41.740462 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:41.741828 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:41.744846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e95ea8-4662-42f5-b6b6-bfcab5f774dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:41.754503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 270/556] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:41.755321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-76e95ea8-4662-42f5-b6b6-bfcab5f774dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:41.755823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:41.756836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:41.757774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:41.761762 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 287/557] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:41.763236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e95ea8-4662-42f5-b6b6-bfcab5f774dc None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.878235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028462d8-e018-415b-b31e-3ef8e201746c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.884836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e95ea8-4662-42f5-b6b6-bfcab5f774dc None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:41.914877 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.915566 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.915883 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.916169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.917024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:41.917342 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:41.918777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:41.921932 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cd989-c442-433c-816d-c16c99deac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:41.922941 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd989-c442-433c-816d-c16c99deac10 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.924049 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd989-c442-433c-816d-c16c99deac10 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.924609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cd989-c442-433c-816d-c16c99deac10 None admin] PATH_INFO: `/v3/users/glance` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.932478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd989-c442-433c-816d-c16c99deac10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:41.934155 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cd989-c442-433c-816d-c16c99deac10 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:41.936526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 271/558] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:41.937639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-fb5cd989-c442-433c-816d-c16c99deac10 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:41.954542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:41.955797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:42:41.956845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:41.963392 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 288/559] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:41.964984 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f7e2c-1129-4896-91b6-bcb4f22f699c None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:41.965464 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f7e2c-1129-4896-91b6-bcb4f22f699c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:41.965896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f7e2c-1129-4896-91b6-bcb4f22f699c None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:41.967604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 289/560] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:41.968477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f7e2c-1129-4896-91b6-bcb4f22f699c None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.042208 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647697c-e8e1-433f-a343-e86d3bc6b689 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.072821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f7e2c-1129-4896-91b6-bcb4f22f699c None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.075621 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.076314 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.076600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.076876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.077625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:42.077933 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:42.079295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:42.087287 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 272/561] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:42.088114 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.106820 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8442b-f081-4587-8f04-78b9d4e3a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.107474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8442b-f081-4587-8f04-78b9d4e3a671 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.107790 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8442b-f081-4587-8f04-78b9d4e3a671 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.108075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8442b-f081-4587-8f04-78b9d4e3a671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.175531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8442b-f081-4587-8f04-78b9d4e3a671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:42.177079 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8442b-f081-4587-8f04-78b9d4e3a671 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:42.190347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ebbd4-e0b1-4384-87aa-5905556bf199 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.222352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ee9aa-723a-42aa-812d-1316f19a6718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.223023 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee9aa-723a-42aa-812d-1316f19a6718 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.223306 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee9aa-723a-42aa-812d-1316f19a6718 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.223582 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ee9aa-723a-42aa-812d-1316f19a6718 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.224455 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ee9aa-723a-42aa-812d-1316f19a6718 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:42.224764 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ee9aa-723a-42aa-812d-1316f19a6718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:42.226200 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ee9aa-723a-42aa-812d-1316f19a6718 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:42.243450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 273/562] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:42.244657 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e35d-da44-49e1-a644-d307e641ee7c None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.244948 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e35d-da44-49e1-a644-d307e641ee7c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.245227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e35d-da44-49e1-a644-d307e641ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.265929 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-be98e35d-da44-49e1-a644-d307e641ee7c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:42.267138 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-be98e35d-da44-49e1-a644-d307e641ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:42.278854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 290/563] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:42.280235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f8cb-0874-4b35-be02-8c2618f587b1 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.280532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f8cb-0874-4b35-be02-8c2618f587b1 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.280817 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f8cb-0874-4b35-be02-8c2618f587b1 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.282383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 291/564] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:42.283698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f8cb-0874-4b35-be02-8c2618f587b1 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.334639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 274/565] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:42.335469 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98e35d-da44-49e1-a644-d307e641ee7c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.381828 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f8cb-0874-4b35-be02-8c2618f587b1 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.413888 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.414672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.414956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.415232 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.425451 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:42.426849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:42.430979 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98e35d-da44-49e1-a644-d307e641ee7c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:42.443896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:42.444871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:42.445838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:42.445838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:42.445838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:42.445838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:42.448096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 292/566] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:42.448798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.463911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc030-be91-4b87-8ba6-ec89b9bdee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.464714 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc030-be91-4b87-8ba6-ec89b9bdee6d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.465005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc030-be91-4b87-8ba6-ec89b9bdee6d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.465284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc030-be91-4b87-8ba6-ec89b9bdee6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.475824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc030-be91-4b87-8ba6-ec89b9bdee6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:42.477351 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc030-be91-4b87-8ba6-ec89b9bdee6d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-28efc030-be91-4b87-8ba6-ec89b9bdee6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:42.494571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:42.495668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:42.496763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:42.496763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:42.496763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:42.496763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:42.496763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 275/567] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:42.497483 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4b1f-f2a1-4cd6-bc45-f220c54a78ae None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.497610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4b1f-f2a1-4cd6-bc45-f220c54a78ae None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.497830 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4b1f-f2a1-4cd6-bc45-f220c54a78ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.513922 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-555c4b1f-f2a1-4cd6-bc45-f220c54a78ae None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:42.515111 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-555c4b1f-f2a1-4cd6-bc45-f220c54a78ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:42.547715 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec7270-806a-4095-a835-fbc73b6ba734 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.579251 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 276/568] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:42.580398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c4b1f-f2a1-4cd6-bc45-f220c54a78ae None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.581287 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.582086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.582420 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.582643 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.596638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:42.598107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:42.616247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:42.617505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:42.618902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:42.618902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:42.618902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:42.618902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:42.618902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 293/569] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:42.618902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.682772 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c4b1f-f2a1-4cd6-bc45-f220c54a78ae None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.715978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f585-7b24-442f-9217-da171ba9f4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.716788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f585-7b24-442f-9217-da171ba9f4fc None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.717079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f585-7b24-442f-9217-da171ba9f4fc None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.717359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f585-7b24-442f-9217-da171ba9f4fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.718044 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288cdb-bc1e-40eb-9b2e-942ea6348369 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.728156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75f585-7b24-442f-9217-da171ba9f4fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-2b75f585-7b24-442f-9217-da171ba9f4fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:42.737313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:42.738637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 277/570] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:42.739684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f585-7b24-442f-9217-da171ba9f4fc None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.755421 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.756136 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.756429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.756703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.757422 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:42.757730 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:42.759113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:42.770904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 294/571] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:42.771716 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.841121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f585-7b24-442f-9217-da171ba9f4fc None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.866287 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44429e4d-8848-4199-aa64-c3d4aa71d9d9 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:42.873523 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.874184 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.874472 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.874758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.875487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:42.875819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:42.877389 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:42.888853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 278/572] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:42.889651 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.899137 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f05402-48a8-4c63-9ca2-3c93eeeab6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:42.899981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f05402-48a8-4c63-9ca2-3c93eeeab6d0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:42.900267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f05402-48a8-4c63-9ca2-3c93eeeab6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:42.900544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f05402-48a8-4c63-9ca2-3c93eeeab6d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:42.910963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f05402-48a8-4c63-9ca2-3c93eeeab6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-19f05402-48a8-4c63-9ca2-3c93eeeab6d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:42.918693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:42.919780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:42.920810 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 295/573] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:42.921576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f05402-48a8-4c63-9ca2-3c93eeeab6d0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:42.992836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5db28-0f65-4cb4-a120-2ca9e5328001 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.016019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f05402-48a8-4c63-9ca2-3c93eeeab6d0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.025993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.026658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.026943 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.027222 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.027976 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:43.028285 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.029639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.041400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 279/574] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:43.042193 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.049530 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.050217 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.050499 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.050775 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.051526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:43.051871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.053255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.061145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 296/575] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:43.062189 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.137721 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770bfb6-677a-44ac-802e-068043e68878 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.162429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaff31-a90a-48bb-868a-13c7b9b3178c None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.171146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.171976 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.172264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.172547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.182375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.183818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.195641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.196465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.196743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.197013 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:43.197439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:43.198663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 280/576] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:43.200045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.207424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.208909 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:43.223547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:43.224981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 297/577] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:43.226375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.308433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dace156-a76c-44c5-80dd-67f392f44eb1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.322835 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445796-ca45-48eb-adb5-cd155c626a73 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.341137 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.341805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.342144 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.342425 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.343174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:43.343483 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.344874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.353594 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 281/578] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:43.354381 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.354961 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.355756 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.356059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.356330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.363787 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.365231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:43.379345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:43.380534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:43.381529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 298/579] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:43.383556 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.451873 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fc21a-cf8e-46c3-893b-960f6a4d167b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.478012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35811b1a-5b58-450a-959d-5f282fdc5e6b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.483688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.484520 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.484807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.485087 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.496725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.498190 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.511746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.512439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.512740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.513008 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.513924 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:43.514238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:43.515363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:43.516569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:43.517853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:43.517853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:43.517853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:43.517853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:43.518142 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.519911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 282/580] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:43.520935 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.534470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 299/581] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:43.535228 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.618743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56b96-171c-47f0-b1ed-05e208396f0c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.632696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cebfad-6aa8-418a-9303-c4d105fbf60c None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.651208 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.651903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.652195 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.652477 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.653275 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:43.653590 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.655044 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.664857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.665646 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.665929 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.666203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.666750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 283/582] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:43.667547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.676759 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.678235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:43.698691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:43.699818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:43.701474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:43.701474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:43.701474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:43.701474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:43.701474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 300/583] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:43.701474 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.764080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc00c6-5dcc-4981-af17-85036087f566 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.795381 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e2bc6-e821-43c0-a923-2809d5989878 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.796854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.797526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.797815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.798097 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.799493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:43.799830 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.801263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.812729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 284/584] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:43.813539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.829171 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.830056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.830520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.830801 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.831525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:43.831860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.833241 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.844066 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 301/585] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:43.844878 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.914909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1759ae-17f6-46ac-ad35-cc295b8ebea1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.946236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e4728-1e1d-4554-bb1e-90f42da583c2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:43.947592 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.948414 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.948696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.948970 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.959090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.960561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:43.977446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:43.978498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:43.980012 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:43.980012 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:43.980012 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:43.980012 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:43.980012 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 285/586] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:43.980355 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ab60-9757-4877-b67c-5146b96ae4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:43.980459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:43.980551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ab60-9757-4877-b67c-5146b96ae4a3 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:43.980551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ab60-9757-4877-b67c-5146b96ae4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:43.980551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ab60-9757-4877-b67c-5146b96ae4a3 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/4baf22712ed548668c853a85e686c4fb/roles/a0d927cd47694ddd9d6e391569dce904` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:43.995716 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ab60-9757-4877-b67c-5146b96ae4a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=4baf22712ed548668c853a85e686c4fb, role_id=a0d927cd47694ddd9d6e391569dce904)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:43.997195 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601ab60-9757-4877-b67c-5146b96ae4a3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.009892 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 302/587] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:42:43 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/4baf22712ed548668c853a85e686c4fb/roles/a0d927cd47694ddd9d6e391569dce904 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:44.010697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ab60-9757-4877-b67c-5146b96ae4a3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.089170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f613d-c0db-4061-bf5c-44303731de1e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.126970 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.127657 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.127974 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.128281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.129019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:44.129328 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.130710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.132387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ab60-9757-4877-b67c-5146b96ae4a3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.144544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 286/588] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:44.145446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.178727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.179684 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.179684 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.180019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.180850 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=58e0d217715c43a2bcdf6b4e581146dd) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:44.183948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.183948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.194114 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 303/589] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/role_assignments?user.id=58e0d217715c43a2bcdf6b4e581146dd&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:44.194114 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.286556 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeaf11-4d79-40fc-8b38-fb133fa3c482 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.316092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190ce1f-d6c5-4b22-9e7d-210f28119cea None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.326766 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.328382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.328919 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.329445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.339200 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.341144 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.355691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.356437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.356731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.357017 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.357825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:44.358139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.359611 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:44.360750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:44.362512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:42:44.363572 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:44.366547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 287/590] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:44.367673 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.374117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 304/591] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:44.375158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.476732 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d0c7e-c988-47e2-bc43-c71a7eb30f02 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.479975 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4055b-c3d4-43c5-9457-8f1266220184 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.514654 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.516314 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.516511 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.517133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.517316 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.517910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.517910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.518512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.518778 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:44.519095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.520777 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.527229 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.529012 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.539931 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 305/592] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:44.540890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:44.547453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:44.549440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:42:44.550485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:44.552709 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 288/593] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:44.553778 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.644283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9d4c3-374c-4892-846e-9b584e1a7f33 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.661394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c256d09-e720-472a-bf29-2ac8b5757890 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.679285 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.680126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.680413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.680700 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.688206 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.690372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.701394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.702552 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.703108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.703599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:44.705237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:44.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:44.707220 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 306/594] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:44.708297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.718880 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.721890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:44.742579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:44.743659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:44.745049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:44.745049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:44.745049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:44.745049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:44.747149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 289/595] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:44.748430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.813330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238d331-6f19-45ba-84fa-c43fcf81066e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.848531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.849221 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.849534 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.849794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.850643 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:44.850959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.852524 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.860808 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91ba20-1d52-43f1-90d1-f085a72e97bf None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:44.871336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 307/596] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:44.872394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.900729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:44.901835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:44.902368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:44.902924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:44.903982 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:44.904535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:44.906233 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:44.919489 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 290/597] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:44.920731 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:44.976018 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ae736-3f9b-40de-bcd3-f62b34be1a61 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.010798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.011335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.011689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.011939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.012677 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:45.012991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.014371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.026843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 308/598] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:45.027758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:45.031220 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819782e1-116c-4729-ae1c-02eb18f0cef7 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.068448 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.069771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.070286 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.070783 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.083714 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.085662 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:45.104655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:45.105691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:45.106713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:45.106713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:45.106713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:45.106713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:45.108767 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 291/599] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:45.109784 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:45.130690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82b0e5-01a3-44c9-aa64-ce269dcbe974 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.165960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cad0c-e10c-413f-8439-3b6a590e2039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.166860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cad0c-e10c-413f-8439-3b6a590e2039 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.167151 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cad0c-e10c-413f-8439-3b6a590e2039 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.167451 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cad0c-e10c-413f-8439-3b6a590e2039 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/8bc210c9b3f94f09b32127dc754a2094/roles/a0d927cd47694ddd9d6e391569dce904` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.190968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cad0c-e10c-413f-8439-3b6a590e2039 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=8bc210c9b3f94f09b32127dc754a2094, role_id=a0d927cd47694ddd9d6e391569dce904)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.192507 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cad0c-e10c-413f-8439-3b6a590e2039 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.208786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 309/600] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:42:45 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/8bc210c9b3f94f09b32127dc754a2094/roles/a0d927cd47694ddd9d6e391569dce904 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:45.209530 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cad0c-e10c-413f-8439-3b6a590e2039 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:45.232975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b53de-b6a9-4731-89c3-2f27e616fe00 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.274158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.275366 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.275911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.276404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.284599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.286636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:45.307382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:45.308471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:45.309475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:45.309475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:45.309475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:45.309475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:45.309475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:45.309475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:45.309475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:45.309475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:45.312403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 292/601] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:45.319901 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:45.343189 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cad0c-e10c-413f-8439-3b6a590e2039 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.415166 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.415902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.416172 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.416510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.417264 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:45.419119 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.420606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.440579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 310/602] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:45.446276 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:45.500880 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092532d0-b646-4f0e-92a4-9ce8d4c7a806 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.544172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.544896 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.545038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.545317 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.546121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:45.546453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.547897 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.560908 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 293/603] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:45.570513 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:45.591256 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc4f60-b50d-4315-9e77-2232e2d3f8ff None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.627615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.628869 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.629380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.629875 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.637107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.638845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:45.657724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:45.658858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:45.659905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:45.659905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:45.659905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:45.659905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:45.659905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:45.659905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:45.659905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:45.659905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:45.668477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 311/604] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:45.675085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:45.735262 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc302f5e-7e65-4a24-afd8-c0537fb6cf1b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.771494 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b16e90-7595-4078-8ad2-3c083764dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.772432 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b16e90-7595-4078-8ad2-3c083764dbfd None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.772720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b16e90-7595-4078-8ad2-3c083764dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.773007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b16e90-7595-4078-8ad2-3c083764dbfd None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/07df2b10a2c5489faa1c01f5c1739d39/roles/a0d927cd47694ddd9d6e391569dce904` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.788291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b16e90-7595-4078-8ad2-3c083764dbfd None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=07df2b10a2c5489faa1c01f5c1739d39, role_id=a0d927cd47694ddd9d6e391569dce904)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.789676 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4af4-6944-4268-ae7f-b2ba5f7197a7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:45.789831 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b16e90-7595-4078-8ad2-3c083764dbfd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.820120 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 294/605] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:42:45 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/07df2b10a2c5489faa1c01f5c1739d39/roles/a0d927cd47694ddd9d6e391569dce904 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:45.831814 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca59d96-4806-44f2-9bc3-4c3a715f84ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:45.832907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59d96-4806-44f2-9bc3-4c3a715f84ba None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:45.833418 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59d96-4806-44f2-9bc3-4c3a715f84ba None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:45.833925 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59d96-4806-44f2-9bc3-4c3a715f84ba None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:45.834999 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59d96-4806-44f2-9bc3-4c3a715f84ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:45.835522 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59d96-4806-44f2-9bc3-4c3a715f84ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:45.837213 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59d96-4806-44f2-9bc3-4c3a715f84ba None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:45.851817 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 312/606] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:45.860044 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b16e90-7595-4078-8ad2-3c083764dbfd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:45.980301 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b16e90-7595-4078-8ad2-3c083764dbfd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:46.029437 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81f2cb-0db8-4b9f-b792-9ad3c2071acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:46.030356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81f2cb-0db8-4b9f-b792-9ad3c2071acd None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:46.030644 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81f2cb-0db8-4b9f-b792-9ad3c2071acd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:46.030925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81f2cb-0db8-4b9f-b792-9ad3c2071acd None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/1516366a4e824577a524f49e0eda8880/roles/a0d927cd47694ddd9d6e391569dce904` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:46.048241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81f2cb-0db8-4b9f-b792-9ad3c2071acd None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=1516366a4e824577a524f49e0eda8880, role_id=a0d927cd47694ddd9d6e391569dce904)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:46.049999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81f2cb-0db8-4b9f-b792-9ad3c2071acd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:46.071607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 295/607] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:42:45 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/1516366a4e824577a524f49e0eda8880/roles/a0d927cd47694ddd9d6e391569dce904 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:46.497718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792723-98d2-4e50-a73f-d30be3f79f31 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:46.498295 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792723-98d2-4e50-a73f-d30be3f79f31 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:46.498737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792723-98d2-4e50-a73f-d30be3f79f31 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:46.500335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 313/608] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:46.506103 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84aefb-83de-4abb-9d90-720d7abd64f5 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:46.507029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84aefb-83de-4abb-9d90-720d7abd64f5 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:46.507314 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84aefb-83de-4abb-9d90-720d7abd64f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:46.526143 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-dd84aefb-83de-4abb-9d90-720d7abd64f5 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:46.527707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-dd84aefb-83de-4abb-9d90-720d7abd64f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:46.600631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 296/609] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:46.625182 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69792723-98d2-4e50-a73f-d30be3f79f31 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:46.766163 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69792723-98d2-4e50-a73f-d30be3f79f31 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:46.821031 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6413e2-420d-416c-a4dc-052da3b925ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:46.821840 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6413e2-420d-416c-a4dc-052da3b925ce None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:46.822131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6413e2-420d-416c-a4dc-052da3b925ce None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:46.822407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6413e2-420d-416c-a4dc-052da3b925ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:46.833940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6413e2-420d-416c-a4dc-052da3b925ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-7b6413e2-420d-416c-a4dc-052da3b925ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:46.842247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:46.843331 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:46.844292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 314/610] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:46.851625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84aefb-83de-4abb-9d90-720d7abd64f5 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:46.977289 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84aefb-83de-4abb-9d90-720d7abd64f5 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:46.978263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cc03-2e4c-4be7-a714-72de48c63de1 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:46.979302 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cc03-2e4c-4be7-a714-72de48c63de1 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:46.979679 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cc03-2e4c-4be7-a714-72de48c63de1 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:46.983877 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 315/611] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:46.989197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d6d63-5a34-4293-8300-abd1773b0883 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:46.989603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d6d63-5a34-4293-8300-abd1773b0883 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:46.989982 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d6d63-5a34-4293-8300-abd1773b0883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:47.020902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-ac6d6d63-5a34-4293-8300-abd1773b0883 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:47.022029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-ac6d6d63-5a34-4293-8300-abd1773b0883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:47.025396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:47.026075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:47.026356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:47.026629 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:47.027386 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:47.027688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:47.029077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:47.043941 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 297/612] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:47.050169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:47.127006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 316/613] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:47.162059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d6d63-5a34-4293-8300-abd1773b0883 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:47.244288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3350de-bd90-41f0-91a4-c019363fd272 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:47.285421 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:47.286202 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:47.286494 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:47.286774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:47.297795 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:47.299233 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:47.317319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:47.318388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:47.319474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:47.319474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:47.319474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:47.319474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:47.319474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 298/614] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:47.324261 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:47.372072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d6d63-5a34-4293-8300-abd1773b0883 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:47.450602 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda1cb2-86b0-43a7-82f5-44e4abc9eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:47.451481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda1cb2-86b0-43a7-82f5-44e4abc9eab9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:47.451599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f5e90-77bb-4322-a15e-0cca984fec7f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:47.451806 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda1cb2-86b0-43a7-82f5-44e4abc9eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:47.452090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda1cb2-86b0-43a7-82f5-44e4abc9eab9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:47.477902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda1cb2-86b0-43a7-82f5-44e4abc9eab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-5cda1cb2-86b0-43a7-82f5-44e4abc9eab9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:47.485890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:47.486940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:47.487904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 317/615] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:47.493566 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:47.494255 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:47.494543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:47.494824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:47.495565 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:47.495905 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:47.496712 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda1cb2-86b0-43a7-82f5-44e4abc9eab9 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:47.497388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:47.511523 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 299/616] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:47.517841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:47.634014 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b043405-92e0-4b19-b450-8b4509a73797 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:47.675167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:47.676014 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:47.676304 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:47.676586 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] PATH_INFO: `/v3/users/glance` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:47.684951 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:47.686816 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:47.703944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:47.706958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:47.709428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 300/617] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:47.712412 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:47.746030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda1cb2-86b0-43a7-82f5-44e4abc9eab9 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:47.825993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:47.826377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5fc12-2f28-4fe2-ac22-ef2833784177 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:47.826678 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:47.826961 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:47.827232 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:47.828057 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:47.828365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:47.829821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:47.850603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 318/618] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:47.851909 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:47.866039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:47.866737 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:47.867025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:47.867306 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:47.868201 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:47.868516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:47.869964 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:47.894404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 301/619] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:42:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:47.900448 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.018002 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215984-b594-4aa4-b0bb-f2fc56193846 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.056217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630feea7-c059-4715-bdcf-3d6ae95d7a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.057217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630feea7-c059-4715-bdcf-3d6ae95d7a9a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.057647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630feea7-c059-4715-bdcf-3d6ae95d7a9a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.057934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630feea7-c059-4715-bdcf-3d6ae95d7a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.062181 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa23a1-c560-464c-834d-6934e3bd7b7b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.106577 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7f6fa-f49a-423e-a85f-7598c0c79ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.107754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7f6fa-f49a-423e-a85f-7598c0c79ab0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.108326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7f6fa-f49a-423e-a85f-7598c0c79ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.108822 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7f6fa-f49a-423e-a85f-7598c0c79ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.120278 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7f6fa-f49a-423e-a85f-7598c0c79ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:48.122036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7f6fa-f49a-423e-a85f-7598c0c79ab0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-1dd7f6fa-f49a-423e-a85f-7598c0c79ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:48.140367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:48.141404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:48.142934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:48.142934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:48.142934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:48.142934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:48.143361 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630feea7-c059-4715-bdcf-3d6ae95d7a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:48.144777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630feea7-c059-4715-bdcf-3d6ae95d7a9a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:48.151638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 319/620] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:48.151638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55b02-7269-4478-87ff-07c5cabfbc30 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.151638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55b02-7269-4478-87ff-07c5cabfbc30 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.151638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a55b02-7269-4478-87ff-07c5cabfbc30 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.151638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 320/621] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:48.160349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a55b02-7269-4478-87ff-07c5cabfbc30 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.283334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 302/622] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:48.283334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd482d-91f8-4bea-bec2-1eee7e0e4f07 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.283334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd482d-91f8-4bea-bec2-1eee7e0e4f07 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.283334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd482d-91f8-4bea-bec2-1eee7e0e4f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.293792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a55b02-7269-4478-87ff-07c5cabfbc30 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.304704 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-63cd482d-91f8-4bea-bec2-1eee7e0e4f07 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:48.306883 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-63cd482d-91f8-4bea-bec2-1eee7e0e4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:48.337813 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.339077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.339898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.340699 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.341812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:48.342655 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:48.344846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:48.360764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 321/623] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:48.362033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.391786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 303/624] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:48.391786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd482d-91f8-4bea-bec2-1eee7e0e4f07 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.507961 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd482d-91f8-4bea-bec2-1eee7e0e4f07 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.514071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdd1e-525e-4617-ac2e-adf14062fcd4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.545321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.546755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.547257 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.547805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] PATH_INFO: `/v3/users/swift` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.553488 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.554386 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.554746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.555106 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.557326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:48.559017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:48.567230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:48.568753 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:48.575981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:48.577031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:42:48.578084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:48.584981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 304/625] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:48.586070 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:48.587905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:48.589051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:48.590058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:48.590058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:48.590058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:48.590058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:48.594893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 322/626] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:48.596502 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.694388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e710a6-beb7-41d5-a87b-16fe9fe69d5a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.701139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76455ccd-8357-4425-8c6f-0fc1e68c8e73 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.730730 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68d934-37f7-4b8d-8316-7024df06cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.731568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68d934-37f7-4b8d-8316-7024df06cf4b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.731893 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68d934-37f7-4b8d-8316-7024df06cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.732170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68d934-37f7-4b8d-8316-7024df06cf4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.742150 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152c7b-f175-472d-a2a0-c41530f59c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.742911 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152c7b-f175-472d-a2a0-c41530f59c36 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.743203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152c7b-f175-472d-a2a0-c41530f59c36 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.743483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152c7b-f175-472d-a2a0-c41530f59c36 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.744427 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152c7b-f175-472d-a2a0-c41530f59c36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:48.744742 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152c7b-f175-472d-a2a0-c41530f59c36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:48.745213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68d934-37f7-4b8d-8316-7024df06cf4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:48.746257 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152c7b-f175-472d-a2a0-c41530f59c36 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-8b68d934-37f7-4b8d-8316-7024df06cf4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:48.754156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:48.755442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:48.756461 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:48.760205 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 305/627] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:48.762391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68d934-37f7-4b8d-8316-7024df06cf4b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.770203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 323/628] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:42:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:48.771731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de94668-933b-4c89-b9a4-108db1ae297a None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.772126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de94668-933b-4c89-b9a4-108db1ae297a None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.772479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de94668-933b-4c89-b9a4-108db1ae297a None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.777734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 324/629] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:48.777734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de94668-933b-4c89-b9a4-108db1ae297a None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.865454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68d934-37f7-4b8d-8316-7024df06cf4b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.877949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de94668-933b-4c89-b9a4-108db1ae297a None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:48.900116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.901109 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.901605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.902093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.903008 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:48.903509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:48.905252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:48.910903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8752cb-aa75-4c95-9891-4aef99f95b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:48.911574 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8752cb-aa75-4c95-9891-4aef99f95b2c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.911888 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8752cb-aa75-4c95-9891-4aef99f95b2c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.912171 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8752cb-aa75-4c95-9891-4aef99f95b2c None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.912914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8752cb-aa75-4c95-9891-4aef99f95b2c None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:48.913221 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8752cb-aa75-4c95-9891-4aef99f95b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:48.914576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8752cb-aa75-4c95-9891-4aef99f95b2c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:48.919029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 306/630] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:48.920289 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:48.927820 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 325/631] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:48.929092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885f99-d250-40d3-8692-439c026ee9bd None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:48.929382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885f99-d250-40d3-8692-439c026ee9bd None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:48.929659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28885f99-d250-40d3-8692-439c026ee9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:48.946086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-28885f99-d250-40d3-8692-439c026ee9bd None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:48.947257 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-28885f99-d250-40d3-8692-439c026ee9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:49.010204 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 326/632] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:49.011086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28885f99-d250-40d3-8692-439c026ee9bd None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.020320 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285ca62-e8c4-416b-9c00-b264330cf71c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.054086 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e4c72-a5e3-46ec-8207-7cad4cc4f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.054887 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e4c72-a5e3-46ec-8207-7cad4cc4f3b8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.055174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e4c72-a5e3-46ec-8207-7cad4cc4f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.055452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e4c72-a5e3-46ec-8207-7cad4cc4f3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.066180 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e4c72-a5e3-46ec-8207-7cad4cc4f3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.067615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e4c72-a5e3-46ec-8207-7cad4cc4f3b8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-778e4c72-a5e3-46ec-8207-7cad4cc4f3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:49.085327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:49.086535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:49.087525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:49.087525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:49.087525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:49.087525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:49.087525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 307/633] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:49.088142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb9ab-4446-4a7c-8872-98cfa121b831 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.088433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb9ab-4446-4a7c-8872-98cfa121b831 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.088715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bb9ab-4446-4a7c-8872-98cfa121b831 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.089976 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 308/634] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:49.090675 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb9ab-4446-4a7c-8872-98cfa121b831 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.122019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28885f99-d250-40d3-8692-439c026ee9bd None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.154343 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.155133 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.155413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.155688 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.162988 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.164499 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:49.178769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:49.179933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:49.180953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 327/635] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:49.181506 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.194918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bb9ab-4446-4a7c-8872-98cfa121b831 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.228875 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.229672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.229990 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.230271 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.240731 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.242182 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:49.260019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:49.261237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:49.262272 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:49.262272 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:49.262272 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:49.262272 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:49.264066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 309/636] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:49.264748 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.278909 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f7a3b-739c-4bdd-901d-b2371662c2ac None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.311028 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448eb92e-8526-4742-83fd-a74ae07b78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.312109 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb92e-8526-4742-83fd-a74ae07b78cb None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.312398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb92e-8526-4742-83fd-a74ae07b78cb None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.312675 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb92e-8526-4742-83fd-a74ae07b78cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.323431 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448eb92e-8526-4742-83fd-a74ae07b78cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-448eb92e-8526-4742-83fd-a74ae07b78cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:49.332059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:49.333233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:49.334191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 328/637] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:49.334947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f127a-1646-4241-9bf4-500ef202b9c9 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.334947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f127a-1646-4241-9bf4-500ef202b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.335146 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f127a-1646-4241-9bf4-500ef202b9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.352350 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-024f127a-1646-4241-9bf4-500ef202b9c9 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:49.353547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-024f127a-1646-4241-9bf4-500ef202b9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:49.361862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f2ff-c730-4478-a153-9d9980722651 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.395321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.396014 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.396298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.396574 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.397293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:49.397599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.398958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.414372 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 310/638] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:49.414372 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.418865 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 329/639] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:49.419704 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f127a-1646-4241-9bf4-500ef202b9c9 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.508778 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab463206-fe24-4228-bd42-4cd891b78300 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.515580 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f127a-1646-4241-9bf4-500ef202b9c9 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.540208 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.540867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.541155 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.542458 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.542458 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:49.542682 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.543934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.547872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.549325 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.549615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.549898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.550624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:49.550939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.552354 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.556193 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 311/640] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:49.556819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.568914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 330/641] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:49.568914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.659854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab1b53-9c21-4133-b2ca-f815e62c6aef None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.664180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35c081-5cf4-4d6c-97ec-4b6b21510672 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.693352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.694021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.694314 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.694594 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.695346 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:49.695651 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.697006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.697124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.697794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.698076 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.698353 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.705235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.705413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 312/642] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:49.705959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.706429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:49.720697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:49.722998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 331/643] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:49.724095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.802903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73209-19be-4d05-bb45-43b70fc6bd5e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.818426 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5edb02-e876-4792-af52-ba3cd9ba8bee None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.835350 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8637f-eb5d-456f-bb0f-d4f07c6ce223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.836182 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8637f-eb5d-456f-bb0f-d4f07c6ce223 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.836469 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8637f-eb5d-456f-bb0f-d4f07c6ce223 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.836751 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8637f-eb5d-456f-bb0f-d4f07c6ce223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.847158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8637f-eb5d-456f-bb0f-d4f07c6ce223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:49.850511 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:49.851157 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:49.851439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:49.851713 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:49.852568 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=4baf22712ed548668c853a85e686c4fb) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:49.852878 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:49.854302 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-6fe8637f-eb5d-456f-bb0f-d4f07c6ce223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:49.854824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:49.856022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:49.857186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 313/644] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:49.858256 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8637f-eb5d-456f-bb0f-d4f07c6ce223 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.875650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 332/645] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/role_assignments?user.id=4baf22712ed548668c853a85e686c4fb&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:49.877012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:49.966086 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8637f-eb5d-456f-bb0f-d4f07c6ce223 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:49.987334 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687314e-40cb-451f-85c8-e50d31491ba9 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.005116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.005939 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.006225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.006502 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.014822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.016374 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.024045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.024865 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.025158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.025434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:50.034113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:50.035246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:50.036379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 314/646] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:50.037050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.042168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.043685 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:50.062056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:50.063107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:50.065378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:50.065378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:50.065378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:50.065378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:50.065378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 333/647] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:50.065378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.152860 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c45da5-1ee2-46a9-9083-5d955469f2f1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.169099 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4ca33-1a2d-45b9-8314-2e42b09a51b5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.196534 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.197209 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.197499 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.197779 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.198579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:50.198900 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.200373 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.206772 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.207446 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.207735 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.208052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.208792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:50.209097 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.210462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.218027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 315/648] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:50.218027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.221975 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 334/649] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:50.227036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.320026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5390d-84c8-4f89-8399-a97fba213ea8 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.331603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21095070-3ccf-43bf-867e-f5adbe4a2b50 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.354795 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.355478 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.355791 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.356069 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.356915 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:50.357229 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.358662 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.366082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.366754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.367036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.367312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.368052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:50.368360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.369729 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.383413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 316/650] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:50.383413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.383678 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 335/651] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:50.383785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.486290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded6807-cc30-4027-a375-b4786498f987 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.487855 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0b97-98dc-4155-89b7-98fe005a9ac7 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.521404 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.521905 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdd581-e167-46f2-ba22-e2119cdf5b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.522449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.522795 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdd581-e167-46f2-ba22-e2119cdf5b57 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.522924 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.523078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdd581-e167-46f2-ba22-e2119cdf5b57 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.523353 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdd581-e167-46f2-ba22-e2119cdf5b57 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/58e0d217715c43a2bcdf6b4e581146dd/roles/a0d927cd47694ddd9d6e391569dce904` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.523464 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.533800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.535288 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.538980 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdd581-e167-46f2-ba22-e2119cdf5b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=58e0d217715c43a2bcdf6b4e581146dd, role_id=a0d927cd47694ddd9d6e391569dce904)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.540561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdd581-e167-46f2-ba22-e2119cdf5b57 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:50.553856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:50.554945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:50.556113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:50.556113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:50.556113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:50.556113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:50.556385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 317/652] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:42:50 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/58e0d217715c43a2bcdf6b4e581146dd/roles/a0d927cd47694ddd9d6e391569dce904 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:42:50.556385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdd581-e167-46f2-ba22-e2119cdf5b57 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.561175 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 336/653] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:50.562845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.671244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdd581-e167-46f2-ba22-e2119cdf5b57 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.680528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e73806-b9f9-4440-aefa-850753fa13e0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.711737 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bb01d-86a9-4f8b-b509-0e0cd82a1cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.712444 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bb01d-86a9-4f8b-b509-0e0cd82a1cdb None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.712731 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bb01d-86a9-4f8b-b509-0e0cd82a1cdb None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.713010 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bb01d-86a9-4f8b-b509-0e0cd82a1cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.722380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.723597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.724166 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.724739 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.733247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.735243 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:50.753470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:50.754619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:42:50.755686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:50.758107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 337/654] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:50.759101 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.791064 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bb01d-86a9-4f8b-b509-0e0cd82a1cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.792596 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bb01d-86a9-4f8b-b509-0e0cd82a1cdb None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.871104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5bfcd-8d0f-4d0d-86f6-d504b88e1998 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:50.897028 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 318/655] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:50.898194 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bb01d-86a9-4f8b-b509-0e0cd82a1cdb None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:50.915208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:50.915935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:50.916225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:50.916512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:50.917238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:50.917548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:50.918953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:50.938540 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 338/656] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:50.940493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.004096 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bb01d-86a9-4f8b-b509-0e0cd82a1cdb None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.040189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.040964 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.041323 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.041684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.042604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:51.042989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.044534 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.046884 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf61e-1aa0-42da-8e48-a85872034fd8 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.068013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 319/657] 10.222.0.32 () {56 vars in 1137 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:51.069010 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.084606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.085743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.086225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.086712 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.099549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.101417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:51.120630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:51.121714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:51.122723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:51.122723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:51.122723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:51.122723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:51.125058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 339/658] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:51.126169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.179127 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b6f9-079e-4280-8519-09edd4e75565 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.217130 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.217909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.218199 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.218480 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.226843 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.228325 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.239968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4e36-479f-4fe5-95e9-5b789b64aef1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:51.244252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:51.245310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:51.246369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 320/659] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:51.247045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.281192 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3bc20-65cb-4ffc-aaf9-51591245a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.282140 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3bc20-65cb-4ffc-aaf9-51591245a38a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.282646 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3bc20-65cb-4ffc-aaf9-51591245a38a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.283104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3bc20-65cb-4ffc-aaf9-51591245a38a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.361239 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d6431-6880-4d1f-aa68-6c619c367a55 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.374481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3bc20-65cb-4ffc-aaf9-51591245a38a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.377418 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3bc20-65cb-4ffc-aaf9-51591245a38a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.397404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.398232 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.398621 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.399001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.399965 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:51.400326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.401799 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.414894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 321/660] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:51.416008 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.499898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 340/661] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:51.500894 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3bc20-65cb-4ffc-aaf9-51591245a38a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.540737 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827f77d-d167-47d3-b016-e542ff52c4d3 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.576221 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.577611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.578078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.578517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.579885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:51.580459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.582069 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.601009 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 322/662] 10.222.0.32 () {56 vars in 1139 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:51.602138 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.606364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3bc20-65cb-4ffc-aaf9-51591245a38a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.643994 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.644564 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.644851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.645128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.652217 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.653667 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:51.669186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:51.670194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 341/663] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:51.671210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.710393 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca6629-823e-457c-b47a-9ebbe485a8bd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.746782 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.747918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.748438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.748950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.760732 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.762527 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:51.781324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:51.782506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:51.783609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:51.783609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:51.783609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:51.783609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:51.784372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37847520-ea15-4ce2-b479-20179a902925 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.785975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 323/664] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:51.787135 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:51.825457 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25c2b6-eb72-4661-91d0-d02bb9daad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.826154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c2b6-eb72-4661-91d0-d02bb9daad46 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.826439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c2b6-eb72-4661-91d0-d02bb9daad46 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.826717 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c2b6-eb72-4661-91d0-d02bb9daad46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.894253 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13fc4a-3a2a-4943-ac52-839b65529cfa None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:51.901384 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25c2b6-eb72-4661-91d0-d02bb9daad46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.902971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25c2b6-eb72-4661-91d0-d02bb9daad46 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.930875 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:51.931989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:51.932560 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:51.933068 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:51.934096 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:51.934622 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:51.936323 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:51.949329 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 324/665] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:51.950529 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.008876 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 342/666] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:52.009751 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25c2b6-eb72-4661-91d0-d02bb9daad46 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.081126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42df3-3096-496d-92d4-0072983ae2d5 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.116762 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.117438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.117782 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.118063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.118840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:52.119153 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.120559 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.123733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25c2b6-eb72-4661-91d0-d02bb9daad46 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.138768 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 325/667] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:52.139695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.165064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.166062 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.166631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.166915 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.167949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=8bc210c9b3f94f09b32127dc754a2094) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:52.168583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.172978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.187919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 343/668] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/role_assignments?user.id=8bc210c9b3f94f09b32127dc754a2094&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:52.189615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.289983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c3b0e-9c4d-4dd5-8841-6682911178e7 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.328936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0167866-ff09-4612-8fd8-396b442c10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.330709 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0167866-ff09-4612-8fd8-396b442c10dd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.330867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0167866-ff09-4612-8fd8-396b442c10dd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.331036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0167866-ff09-4612-8fd8-396b442c10dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.342643 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0167866-ff09-4612-8fd8-396b442c10dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.344345 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0167866-ff09-4612-8fd8-396b442c10dd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a0167866-ff09-4612-8fd8-396b442c10dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:52.370074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:52.371126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:52.372172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:52.372172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:52.372172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:52.372172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:52.372172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 326/669] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:52.372172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b984d-d0a1-4b4f-ab1a-a468315e9c17 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.372172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b984d-d0a1-4b4f-ab1a-a468315e9c17 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.372172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b984d-d0a1-4b4f-ab1a-a468315e9c17 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.373770 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 327/670] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:52.374294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a0595-8c3f-42e8-b39c-9220fb76b982 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.374526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b984d-d0a1-4b4f-ab1a-a468315e9c17 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.419200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d6c4-ae74-4534-b5a0-f1bd8e00cdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.420483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d6c4-ae74-4534-b5a0-f1bd8e00cdfd None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.420992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d6c4-ae74-4534-b5a0-f1bd8e00cdfd None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.421471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d6c4-ae74-4534-b5a0-f1bd8e00cdfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.431488 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d6c4-ae74-4534-b5a0-f1bd8e00cdfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.433054 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d6c4-ae74-4534-b5a0-f1bd8e00cdfd None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-0fe5d6c4-ae74-4534-b5a0-f1bd8e00cdfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:52.448818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:52.450042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:52.451424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:52.451424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:52.451424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:52.451424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:52.451424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:52.451424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:52.451424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:52.451424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:52.454844 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 344/671] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:52.456959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb7a9-53c6-4f83-a923-6fdac043e019 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.457259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb7a9-53c6-4f83-a923-6fdac043e019 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.457567 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bb7a9-53c6-4f83-a923-6fdac043e019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.476557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-237bb7a9-53c6-4f83-a923-6fdac043e019 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:52.477541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-237bb7a9-53c6-4f83-a923-6fdac043e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:52.508520 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b984d-d0a1-4b4f-ab1a-a468315e9c17 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.559603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 345/672] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:52.560615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bb7a9-53c6-4f83-a923-6fdac043e019 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.566853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.569539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.570087 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.570375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.573197 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:52.573792 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.576628 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.596062 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 328/673] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:52.597651 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.692164 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bb7a9-53c6-4f83-a923-6fdac043e019 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.728258 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.728509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaac8a9-64d4-4292-a0cb-f1d72f6848db None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.729652 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.730171 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.730661 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.731715 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:52.732416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.734096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.753726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 346/674] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:52.754976 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.768883 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.769714 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.770000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.770277 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.786368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.788591 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:52.817609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:52.818711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:52.819728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:52.819728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:52.819728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:52.819728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:52.819728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 329/675] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:52.820087 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.895290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8fc4-4518-4fdc-9987-5b2ac474d213 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.933577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec0bd0-6552-4c49-9165-711158ab613b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:52.938942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.939750 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.940066 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.940343 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.947435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.948942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:52.964039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:52.965082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:52.966082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 347/676] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:52.966632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:52.976665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:52.977420 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:52.977709 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:52.978782 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:52.979645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=07df2b10a2c5489faa1c01f5c1739d39) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:52.979983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:52.981422 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:52.990742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 330/677] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/role_assignments?user.id=07df2b10a2c5489faa1c01f5c1739d39&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:52.991390 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:53.086880 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff54e63-fefa-4ec7-9953-21f58abc5ecd None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:53.110102 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4f834-39be-4815-9582-410fa84b87f3 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:53.125492 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646dddd-6aec-4074-bf56-6e29972ae78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:53.126970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646dddd-6aec-4074-bf56-6e29972ae78a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:53.127299 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646dddd-6aec-4074-bf56-6e29972ae78a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:53.127525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646dddd-6aec-4074-bf56-6e29972ae78a None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:53.128659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646dddd-6aec-4074-bf56-6e29972ae78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:53.129006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646dddd-6aec-4074-bf56-6e29972ae78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:53.130908 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646dddd-6aec-4074-bf56-6e29972ae78a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:53.147888 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 348/678] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:53.149030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db656-a896-43af-b517-cb02f763b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:53.149193 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77e73-259e-4062-be43-27f077940e1c None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:53.149436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77e73-259e-4062-be43-27f077940e1c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:53.149704 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db656-a896-43af-b517-cb02f763b309 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:53.149821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77e73-259e-4062-be43-27f077940e1c None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:53.150000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db656-a896-43af-b517-cb02f763b309 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:53.150281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db656-a896-43af-b517-cb02f763b309 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:53.151238 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 349/679] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:53.152851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77e73-259e-4062-be43-27f077940e1c None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:53.155352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db656-a896-43af-b517-cb02f763b309 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:53.155740 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db656-a896-43af-b517-cb02f763b309 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:53.159817 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db656-a896-43af-b517-cb02f763b309 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:53.179934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 331/680] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:53.181617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa997f-2050-40ed-b669-9774a616cf74 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:53.182154 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa997f-2050-40ed-b669-9774a616cf74 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:53.182607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa997f-2050-40ed-b669-9774a616cf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:53.210390 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-1cfa997f-2050-40ed-b669-9774a616cf74 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:53.211585 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-1cfa997f-2050-40ed-b669-9774a616cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:53.306966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77e73-259e-4062-be43-27f077940e1c None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:53.311883 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 332/681] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:53.312907 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa997f-2050-40ed-b669-9774a616cf74 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:53.358779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef060189-712c-4392-a3b1-ba33c8d14f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:53.360120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef060189-712c-4392-a3b1-ba33c8d14f34 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:53.361269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef060189-712c-4392-a3b1-ba33c8d14f34 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:53.362151 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef060189-712c-4392-a3b1-ba33c8d14f34 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:53.363530 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef060189-712c-4392-a3b1-ba33c8d14f34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:53.367074 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef060189-712c-4392-a3b1-ba33c8d14f34 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:53.398992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 350/682] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:42:53 2022] POST /identity/v3/users => generated 254 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:53.400372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef060189-712c-4392-a3b1-ba33c8d14f34 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:53.444413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa997f-2050-40ed-b669-9774a616cf74 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:53.498082 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:53.500141 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:53.500427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:53.500701 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:53.503436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=1516366a4e824577a524f49e0eda8880) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:53.505753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:53.508955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:53.521879 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 333/683] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:53 2022] GET /identity/v3/role_assignments?user.id=1516366a4e824577a524f49e0eda8880&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:53.548779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef060189-712c-4392-a3b1-ba33c8d14f34 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:53.602352 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732fce8-add3-49e6-a2bc-0b9b765b918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:53.603191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732fce8-add3-49e6-a2bc-0b9b765b918e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:53.603477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732fce8-add3-49e6-a2bc-0b9b765b918e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:53.603756 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732fce8-add3-49e6-a2bc-0b9b765b918e None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:53.620533 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732fce8-add3-49e6-a2bc-0b9b765b918e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-3732fce8-add3-49e6-a2bc-0b9b765b918e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:53.630745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:53.631935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:53.632972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 351/684] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:53.640337 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:53.786456 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d482cb-8e13-45d0-82eb-53d5b1504560 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:53.827640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:53.828726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:53.829990 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:53.830573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:53.831523 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:53.832026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:53.833579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:53.842610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 334/685] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:53.848487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732fce8-add3-49e6-a2bc-0b9b765b918e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:53.963637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732fce8-add3-49e6-a2bc-0b9b765b918e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:54.010409 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:54.011567 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:54.012091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:54.012563 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:54.036371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:54.038272 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:54.067417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:54.068561 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:54.069585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:54.069585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:54.069585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:54.069585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:54.071336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 352/686] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:54.077129 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:54.207385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2bb1-a173-4413-9e01-bf2ab249de2f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:54.251970 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:54.252914 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:54.253351 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:54.253808 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:54.254691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:54.255161 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:54.256714 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:54.278924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 335/687] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:54.285120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:54.427736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d8bf-35b2-4a0e-bfe9-c36ecb6842cc None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:54.474453 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:54.475321 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:54.475617 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:54.475946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:54.483818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:54.485287 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:54.500410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:54.501834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:54.503116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 353/688] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:54.510244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:54.649513 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072ee2d-1d1c-4873-bcb9-53fe030521b4 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:54.688715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4f192-3406-4298-b0e0-75af7f88aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:54.689415 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f192-3406-4298-b0e0-75af7f88aa09 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:54.689703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f192-3406-4298-b0e0-75af7f88aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:54.689984 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4f192-3406-4298-b0e0-75af7f88aa09 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:54.690839 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f192-3406-4298-b0e0-75af7f88aa09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:54.691151 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f192-3406-4298-b0e0-75af7f88aa09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:54.692636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4f192-3406-4298-b0e0-75af7f88aa09 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:54.711419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 336/689] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:42:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:54.716898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:54.867462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108c38-ce6f-47c0-91c6-7b27c51d7bb6 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:54.905475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c7f6-b1aa-4019-91ee-a747c0369dd1 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:54.905832 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c7f6-b1aa-4019-91ee-a747c0369dd1 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:54.906045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c7f6-b1aa-4019-91ee-a747c0369dd1 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:54.908347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 337/690] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:54.916602 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f629e9d-0c4f-4983-8df2-7be1ac80e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:54.917507 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629e9d-0c4f-4983-8df2-7be1ac80e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:54.917989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629e9d-0c4f-4983-8df2-7be1ac80e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:54.918485 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f629e9d-0c4f-4983-8df2-7be1ac80e2e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:54.923938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46377-16a5-47f9-8981-543183a7fa85 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:54.924242 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46377-16a5-47f9-8981-543183a7fa85 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:54.924527 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46377-16a5-47f9-8981-543183a7fa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:54.956034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-9cf46377-16a5-47f9-8981-543183a7fa85 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:54.957255 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-9cf46377-16a5-47f9-8981-543183a7fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:55.043399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f629e9d-0c4f-4983-8df2-7be1ac80e2e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:55.044915 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f629e9d-0c4f-4983-8df2-7be1ac80e2e2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:55.049228 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 338/691] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:55.093225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf46377-16a5-47f9-8981-543183a7fa85 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:55.152483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 354/692] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:55.158612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f629e9d-0c4f-4983-8df2-7be1ac80e2e2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:55.270455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f629e9d-0c4f-4983-8df2-7be1ac80e2e2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:55.308986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:55.310081 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.310554 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.310992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.327520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:55.330796 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:55.333664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf46377-16a5-47f9-8981-543183a7fa85 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:55.367728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:55.368819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:55.369836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:55.369836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:55.369836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:55.369836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:55.369836 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 355/693] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:55.374829 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:55.404284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56d61a-2438-4afd-8fd0-efbfdcfce664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:55.405469 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56d61a-2438-4afd-8fd0-efbfdcfce664 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.406034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56d61a-2438-4afd-8fd0-efbfdcfce664 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.406567 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56d61a-2438-4afd-8fd0-efbfdcfce664 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.426028 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56d61a-2438-4afd-8fd0-efbfdcfce664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ce56d61a-2438-4afd-8fd0-efbfdcfce664 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:55.434805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:55.435864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:55.437185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:55.449215 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 339/694] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:55.452771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56d61a-2438-4afd-8fd0-efbfdcfce664 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:55.556525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56d61a-2438-4afd-8fd0-efbfdcfce664 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:55.583615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0e18-1e88-4c60-9548-b87d655665b7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:55.594264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916edea-69f3-4be5-913e-3db33f8c2784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:55.596042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916edea-69f3-4be5-913e-3db33f8c2784 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.596645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916edea-69f3-4be5-913e-3db33f8c2784 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.597119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916edea-69f3-4be5-913e-3db33f8c2784 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.598104 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916edea-69f3-4be5-913e-3db33f8c2784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:55.598622 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916edea-69f3-4be5-913e-3db33f8c2784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:55.600259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916edea-69f3-4be5-913e-3db33f8c2784 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:55.609390 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 340/695] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:55.611391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8ac5-c6b1-4ef8-a776-c08dad046253 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.611884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8ac5-c6b1-4ef8-a776-c08dad046253 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.612332 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8ac5-c6b1-4ef8-a776-c08dad046253 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.614002 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 341/696] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:55.615913 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d8ac5-c6b1-4ef8-a776-c08dad046253 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:55.627877 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c1897-971a-44d1-bce2-3c4130a4b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:55.629275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c1897-971a-44d1-bce2-3c4130a4b0b2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.629662 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c1897-971a-44d1-bce2-3c4130a4b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.630074 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c1897-971a-44d1-bce2-3c4130a4b0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.631319 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c1897-971a-44d1-bce2-3c4130a4b0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:55.631748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c1897-971a-44d1-bce2-3c4130a4b0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:55.634039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c1897-971a-44d1-bce2-3c4130a4b0b2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:55.649384 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 356/697] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:42:55.651456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3c8f-d877-4572-91e9-6854161eaa56 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.652167 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3c8f-d877-4572-91e9-6854161eaa56 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.652557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3c8f-d877-4572-91e9-6854161eaa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.674096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-2c3b3c8f-d877-4572-91e9-6854161eaa56 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:55.676676 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-2c3b3c8f-d877-4572-91e9-6854161eaa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:55.745122 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d8ac5-c6b1-4ef8-a776-c08dad046253 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:55.766339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 357/698] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:55.767905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b3c8f-d877-4572-91e9-6854161eaa56 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:55.783263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:55.784548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.784995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.785451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.799333 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:55.801237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:55.822503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:55.823712 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:55.824785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:55.824785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:55.824785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:55.824785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:55.827200 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 342/699] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:55.828404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:55.902413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b3c8f-d877-4572-91e9-6854161eaa56 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:55.940759 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49f921-9ce9-46df-a2b8-11c607c08352 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:55.946433 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:55.947239 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.947522 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.947819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.956578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:55.958705 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:55.977669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:55.978719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:55.979723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 358/700] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:55.980751 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:55.981414 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:55.982479 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:55.982994 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:55.983543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:55.984586 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:55.986525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:56.002313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:56.003548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:42:56.004548 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:56.007554 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 343/701] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:42:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:56.008580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:56.094351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf927-69c0-48cc-b8d1-f4b8fb3c4202 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:56.130073 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:56.131193 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.131698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.132241 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.133197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:56.133745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:56.135399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:56.139213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff57a-7cfa-4747-b154-9ca5cf8a713b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:56.149230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 359/702] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:56.150456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:56.183271 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:56.184398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.184981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.185492 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.186809 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:56.187375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:56.190187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:56.205288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 344/703] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:56.206625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:56.274183 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308b1e-12a4-43a9-a008-1c7426737836 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:56.313468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:56.314614 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006c63-5859-4f90-a5fe-e6bfa73fcd3e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:56.314744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.315144 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.315661 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.317114 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:56.317646 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:56.320302 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:56.326453 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 360/704] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:42:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:56.327385 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:56.354589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:56.355822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.356358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.356869 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.365180 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:56.367018 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:56.383510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:56.384838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:42:56.386115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:56.387838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 345/705] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:42:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:56.392065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:56.429798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34cf5-8b99-4a1d-862d-613ed0b60f22 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:56.464768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc9a1d-ff2c-4243-b58e-4f75d1382395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:56.465434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc9a1d-ff2c-4243-b58e-4f75d1382395 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.465720 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc9a1d-ff2c-4243-b58e-4f75d1382395 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.465997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc9a1d-ff2c-4243-b58e-4f75d1382395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.466830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc9a1d-ff2c-4243-b58e-4f75d1382395 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=58e0d217715c43a2bcdf6b4e581146dd) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:56.467143 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc9a1d-ff2c-4243-b58e-4f75d1382395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:56.468636 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc9a1d-ff2c-4243-b58e-4f75d1382395 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:56.476075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 361/706] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:56 2022] GET /identity/v3/role_assignments?user.id=58e0d217715c43a2bcdf6b4e581146dd&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:56.477614 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f160-31ef-41ee-9528-f66925e11e5e None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.477908 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f160-31ef-41ee-9528-f66925e11e5e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.478189 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f160-31ef-41ee-9528-f66925e11e5e None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.479977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 362/707] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:56.480809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f160-31ef-41ee-9528-f66925e11e5e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:56.513134 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baada6-f965-461e-aff6-2d0c669fa0ad None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:56.569813 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d70383-9e94-4e27-a84d-15c4e10c901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:56.572008 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d70383-9e94-4e27-a84d-15c4e10c901d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.572556 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d70383-9e94-4e27-a84d-15c4e10c901d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.573034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d70383-9e94-4e27-a84d-15c4e10c901d None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.574019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d70383-9e94-4e27-a84d-15c4e10c901d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:56.574554 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d70383-9e94-4e27-a84d-15c4e10c901d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:56.577123 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d70383-9e94-4e27-a84d-15c4e10c901d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:56.586890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 346/708] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:42:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:56.588814 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bcfae-d488-4863-8c07-a9d7e5c4744c None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.589358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bcfae-d488-4863-8c07-a9d7e5c4744c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.589863 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bcfae-d488-4863-8c07-a9d7e5c4744c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.611958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-f34bcfae-d488-4863-8c07-a9d7e5c4744c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:56.614341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-f34bcfae-d488-4863-8c07-a9d7e5c4744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:56.652596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f160-31ef-41ee-9528-f66925e11e5e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:56.711694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:56.712425 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.712711 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.712986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.713846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:56.714155 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:56.715632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:56.735797 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 347/709] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:56.738053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c6a3-87eb-41de-a66e-e4aa206b98f5 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.738425 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c6a3-87eb-41de-a66e-e4aa206b98f5 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.738822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3c6a3-87eb-41de-a66e-e4aa206b98f5 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.740569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 348/710] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:56.742022 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 363/711] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:42:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:56.746562 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc64c3-dedf-46f3-a08b-ab82d6b82807 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.748241 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:56.749182 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc64c3-dedf-46f3-a08b-ab82d6b82807 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.749470 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc64c3-dedf-46f3-a08b-ab82d6b82807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.771343 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-acbc64c3-dedf-46f3-a08b-ab82d6b82807 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:56.772650 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-acbc64c3-dedf-46f3-a08b-ab82d6b82807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:56.860460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 349/712] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:42:56.861809 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc64c3-dedf-46f3-a08b-ab82d6b82807 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:56.883470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a8265-6d68-47dd-9f4b-bbaa367778da None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:56.929801 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce96b4-2f4f-41f7-b01e-3b1ac820b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:56.931541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce96b4-2f4f-41f7-b01e-3b1ac820b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:56.932113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce96b4-2f4f-41f7-b01e-3b1ac820b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:56.933665 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce96b4-2f4f-41f7-b01e-3b1ac820b5c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:56.973327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc64c3-dedf-46f3-a08b-ab82d6b82807 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.005002 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce96b4-2f4f-41f7-b01e-3b1ac820b5c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.006870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce96b4-2f4f-41f7-b01e-3b1ac820b5c7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.020511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67223f7f-7353-498e-adec-338d60749180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.021988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67223f7f-7353-498e-adec-338d60749180 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.022741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67223f7f-7353-498e-adec-338d60749180 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.023186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67223f7f-7353-498e-adec-338d60749180 None admin] PATH_INFO: `/v3/services/network` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.024067 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67223f7f-7353-498e-adec-338d60749180 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.025604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67223f7f-7353-498e-adec-338d60749180 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-67223f7f-7353-498e-adec-338d60749180 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:57.038165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:57.039546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:42:57.040723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:57.043009 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 350/713] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:56 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:57.043989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67223f7f-7353-498e-adec-338d60749180 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.117221 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 364/714] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:57.118686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce96b4-2f4f-41f7-b01e-3b1ac820b5c7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.157643 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67223f7f-7353-498e-adec-338d60749180 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.195609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480949a7-de65-40fd-bd88-ebd123f20a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.196634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480949a7-de65-40fd-bd88-ebd123f20a1b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.197019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480949a7-de65-40fd-bd88-ebd123f20a1b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.197400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480949a7-de65-40fd-bd88-ebd123f20a1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.209029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480949a7-de65-40fd-bd88-ebd123f20a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-480949a7-de65-40fd-bd88-ebd123f20a1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:57.217054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:57.218259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:42:57.219187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:57.223947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce96b4-2f4f-41f7-b01e-3b1ac820b5c7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.224172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 351/715] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:57.224936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480949a7-de65-40fd-bd88-ebd123f20a1b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.260389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.261122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.261419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.261795 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.262520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] RBAC: Adding query filter params (name=network) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:57.262929 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.264424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.269401 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 365/716] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:57.270224 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.332003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480949a7-de65-40fd-bd88-ebd123f20a1b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.367090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.367939 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.368227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.368506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.374742 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829e3c3-ca92-4c19-8848-8f1b35a22b05 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.380482 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.381967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:57.400283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:57.402452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:57.404625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:57.404625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:57.404625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:57.404625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:57.404625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 352/717] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:57.404625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.412979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.413579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.413875 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.414159 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.414920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:57.415234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.416694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.430365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 366/718] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:57.431227 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.505911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea031a9a-954c-4133-9517-8daf3d0c267e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.537075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06ffc6-1109-49e4-9377-8dbe296f89e2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.541716 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.542398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.542685 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.542965 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.543692 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] RBAC: Adding query filter params (type=network) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:57.544032 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.545414 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.559926 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 353/719] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:57.560973 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.574664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.575423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.575717 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.576040 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.576852 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:57.577167 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.578875 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.592697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 367/720] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:57.599523 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.706559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668310a-394f-4829-90ba-c93ecd37d213 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.764805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a8de-2717-40b7-be61-60d92d9c5dec None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.776103 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.776941 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.777225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.777507 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.789796 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.791315 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:57.821277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:57.822372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:57.823367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 368/721] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:57.832394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.836430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.837261 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.837550 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.837834 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:57.856754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:57.858219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:57.876367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:57.879027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:57.881298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:57.881298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:57.881298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:57.881298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:57.881298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 354/722] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:57.884935 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:57.958833 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bc848-5a45-4efa-886a-335afa38a851 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:57.998106 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:57.998783 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:57.999071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:57.999352 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:58.000257 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:58.000574 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:58.003217 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:58.018068 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 369/723] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:58.024436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:58.052833 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1e57-bcc1-4851-9f75-42f93d3fa06c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:58.100129 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:58.100806 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:58.101095 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:58.101371 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:58.102102 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:58.102410 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:58.103802 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:58.118316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 355/724] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:58.123272 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:58.234769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ef641-758f-4cbd-9243-63584dd52f99 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:58.280137 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:58.281091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:58.281531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:58.281977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:58.283487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=8bc210c9b3f94f09b32127dc754a2094) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:58.284137 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:58.286777 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:58.292993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 370/725] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:58 2022] GET /identity/v3/role_assignments?user.id=8bc210c9b3f94f09b32127dc754a2094&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:58.321293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177b74c-c019-461e-96c9-d836bd058982 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:58.366298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:58.367433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:58.367964 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:58.368393 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:58.377248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:58.378925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:42:58.401623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:58.403037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:42:58.404359 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:58.406894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 356/726] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:42:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:42:58.412388 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:58.550107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc47de2-4337-4506-8a72-d8335e09d3a4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:58.589799 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:58.590777 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:58.591218 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:58.591646 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:58.592666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:58.593148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:58.595395 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:58.617409 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 371/727] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:42:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:58.622533 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:58.732896 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4f909-2e41-40b2-990c-70dab5209a42 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:58.775273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334359-841d-4bb2-8993-ff9559530c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:58.775974 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334359-841d-4bb2-8993-ff9559530c24 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:58.776234 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334359-841d-4bb2-8993-ff9559530c24 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:58.776500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334359-841d-4bb2-8993-ff9559530c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:58.850100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334359-841d-4bb2-8993-ff9559530c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:58.851480 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e334359-841d-4bb2-8993-ff9559530c24 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:58.952166 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 357/728] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:42:58.958284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:59.064828 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9b5b4-1da0-46aa-ad03-15f3ae4e9754 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:59.117158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad923d-4c6d-45a7-8dfe-12493a82c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:59.118281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad923d-4c6d-45a7-8dfe-12493a82c09d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.118710 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad923d-4c6d-45a7-8dfe-12493a82c09d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.119126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad923d-4c6d-45a7-8dfe-12493a82c09d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.144954 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad923d-4c6d-45a7-8dfe-12493a82c09d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:59.147155 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad923d-4c6d-45a7-8dfe-12493a82c09d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-7cad923d-4c6d-45a7-8dfe-12493a82c09d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:42:59.192145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:59.193200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:59.194209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:42:59.194209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:42:59.194209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:42:59.194209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:59.194457 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 372/729] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:59.201323 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334359-841d-4bb2-8993-ff9559530c24 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:59.288123 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da240a7-b729-4005-8954-163d381ff995 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.288796 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da240a7-b729-4005-8954-163d381ff995 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.289001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da240a7-b729-4005-8954-163d381ff995 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.291139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 373/730] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:42:59.297014 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78a19-6808-4460-9232-952706dfa151 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.297322 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78a19-6808-4460-9232-952706dfa151 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.297559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78a19-6808-4460-9232-952706dfa151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.315054 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334359-841d-4bb2-8993-ff9559530c24 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:59.319152 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-ded78a19-6808-4460-9232-952706dfa151 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:59.320371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-ded78a19-6808-4460-9232-952706dfa151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:59.349957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a80420-51f5-4d99-b6c7-dab4a0dd87eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:59.350693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80420-51f5-4d99-b6c7-dab4a0dd87eb None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.350978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80420-51f5-4d99-b6c7-dab4a0dd87eb None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.351262 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80420-51f5-4d99-b6c7-dab4a0dd87eb None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.352072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a80420-51f5-4d99-b6c7-dab4a0dd87eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:59.352386 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a80420-51f5-4d99-b6c7-dab4a0dd87eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:59.353759 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a80420-51f5-4d99-b6c7-dab4a0dd87eb None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:59.366983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 358/731] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:59.368559 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b52f-282a-4390-81cd-63bb7292f236 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.368781 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b52f-282a-4390-81cd-63bb7292f236 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.369060 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b52f-282a-4390-81cd-63bb7292f236 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.374472 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 359/732] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:42:59.375286 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916b52f-282a-4390-81cd-63bb7292f236 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:59.400767 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 374/733] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:59.402191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687c4b-5f1a-470a-85d2-e19dd011ba0d None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.402484 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687c4b-5f1a-470a-85d2-e19dd011ba0d None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.402919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687c4b-5f1a-470a-85d2-e19dd011ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.420794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-43687c4b-5f1a-470a-85d2-e19dd011ba0d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:42:59.421984 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-43687c4b-5f1a-470a-85d2-e19dd011ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:42:59.497373 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 375/734] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:42:59.499275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43687c4b-5f1a-470a-85d2-e19dd011ba0d None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:59.552658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916b52f-282a-4390-81cd-63bb7292f236 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:59.594156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:59.595188 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.595468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.595720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.603890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:59.605902 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:59.623739 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43687c4b-5f1a-470a-85d2-e19dd011ba0d None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:42:59.624065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:59.626918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 360/735] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:42:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:59.629273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:59.665802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c814f-da47-42c6-b3ff-b62fbce0231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:59.666871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c814f-da47-42c6-b3ff-b62fbce0231a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.667159 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c814f-da47-42c6-b3ff-b62fbce0231a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.667481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c814f-da47-42c6-b3ff-b62fbce0231a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.680424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c814f-da47-42c6-b3ff-b62fbce0231a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-f38c814f-da47-42c6-b3ff-b62fbce0231a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:42:59.692045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:42:59.694102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 376/736] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:42:59.695744 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c814f-da47-42c6-b3ff-b62fbce0231a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:59.749531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047592e-b42b-410e-bb9d-689fb83e3336 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:59.786078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d89c2b-a96c-4c1e-8d6d-a4a3521b0a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:59.786882 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d89c2b-a96c-4c1e-8d6d-a4a3521b0a65 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.787065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d89c2b-a96c-4c1e-8d6d-a4a3521b0a65 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.787292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d89c2b-a96c-4c1e-8d6d-a4a3521b0a65 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.788058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d89c2b-a96c-4c1e-8d6d-a4a3521b0a65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:59.789510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d89c2b-a96c-4c1e-8d6d-a4a3521b0a65 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:59.810677 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 361/737] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:42:59 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:42:59.812824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d89c2b-a96c-4c1e-8d6d-a4a3521b0a65 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:42:59.816046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c814f-da47-42c6-b3ff-b62fbce0231a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:42:59.901200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:42:59.901808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:42:59.902193 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:42:59.902477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:42:59.903332 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:42:59.903645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:42:59.906476 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:42:59.938051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 377/738] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:42:59.945189 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:00.024857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d89c2b-a96c-4c1e-8d6d-a4a3521b0a65 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:00.088960 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:00.089815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.090028 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.090273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.091048 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:00.091360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:00.092791 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:00.106050 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 362/739] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:00.112132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:00.118186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a67c-531e-4518-98a6-ca092137e724 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:00.167173 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:00.168294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.169121 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.169696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.170844 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=6226dd06a9d84bd0ac02077d29f9c7a2) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:00.171520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:00.174075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:00.182494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 378/740] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:42:59 2022] GET /identity/v3/role_assignments?user.id=6226dd06a9d84bd0ac02077d29f9c7a2&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:00.243028 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6944c-edcd-4549-a408-a2a311c82c3a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:00.282282 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f359a6-c621-4250-b364-dda1c5484eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:00.283163 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f359a6-c621-4250-b364-dda1c5484eda None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.283456 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f359a6-c621-4250-b364-dda1c5484eda None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.283735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f359a6-c621-4250-b364-dda1c5484eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.296109 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f359a6-c621-4250-b364-dda1c5484eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:00.297634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f359a6-c621-4250-b364-dda1c5484eda None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-30f359a6-c621-4250-b364-dda1c5484eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:00.317302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:00.318354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:00.319360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:00.319360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:00.319360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:00.319360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:00.319360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 363/741] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:00.324253 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:00.444924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b80c73-d75b-4481-84ff-de59ffb332b4 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.445297 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b80c73-d75b-4481-84ff-de59ffb332b4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.445501 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b80c73-d75b-4481-84ff-de59ffb332b4 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.447876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 364/742] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:00.452737 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba084b9-0787-468e-93b5-aaf6c6004b67 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.453028 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba084b9-0787-468e-93b5-aaf6c6004b67 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.453310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba084b9-0787-468e-93b5-aaf6c6004b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.472709 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-eba084b9-0787-468e-93b5-aaf6c6004b67 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:00.473915 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-eba084b9-0787-468e-93b5-aaf6c6004b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:00.475002 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fbea4-a215-4e93-9ce3-f4bd561f8050 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:00.510517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:00.511587 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.512120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.512638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.513597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:00.514124 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:00.515779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:00.529603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 379/743] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:00.536072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:00.551901 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 365/744] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:43:00.569562 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba084b9-0787-468e-93b5-aaf6c6004b67 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:00.643647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efb8dd-f0a9-44c5-8346-7d6f18e1b341 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:00.671221 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba084b9-0787-468e-93b5-aaf6c6004b67 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:00.679913 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:00.681180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.681713 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.682214 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.691860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:00.693760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:00.711326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:00.712455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:43:00.713504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:00.714113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08411984-4b64-4242-ae9e-b2e370d61de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:00.714113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411984-4b64-4242-ae9e-b2e370d61de0 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.714113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411984-4b64-4242-ae9e-b2e370d61de0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.714113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411984-4b64-4242-ae9e-b2e370d61de0 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.714403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08411984-4b64-4242-ae9e-b2e370d61de0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:00.715537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08411984-4b64-4242-ae9e-b2e370d61de0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:00.717033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 380/745] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:00.723628 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:00.744000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 366/746] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:43:00 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:43:00.848362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ba223-3059-472b-9194-c0ba93ba97f6 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:00.888624 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306b1a-5cb5-4993-86fa-d5efd7d47680 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.889203 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306b1a-5cb5-4993-86fa-d5efd7d47680 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.889203 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306b1a-5cb5-4993-86fa-d5efd7d47680 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.890603 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 367/747] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:00.893978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:00.894898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.895353 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.895837 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.896952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:00.897091 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed6c3-92fe-4e4c-82fd-fa908d6161ed None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:00.897252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed6c3-92fe-4e4c-82fd-fa908d6161ed None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:00.897543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed6c3-92fe-4e4c-82fd-fa908d6161ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:00.897872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:00.899808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:00.918967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-b03ed6c3-92fe-4e4c-82fd-fa908d6161ed None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:00.920021 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 381/748] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:43:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:00.920273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-b03ed6c3-92fe-4e4c-82fd-fa908d6161ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:00.925722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:01.044138 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 368/749] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:01.068690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ed6c3-92fe-4e4c-82fd-fa908d6161ed None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:01.083312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a405cb-f847-440e-99b4-a7135fdf9ec7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:01.266141 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a54228-a783-4bc7-800c-ac9b00ddb80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:01.267384 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54228-a783-4bc7-800c-ac9b00ddb80a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:01.267670 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54228-a783-4bc7-800c-ac9b00ddb80a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:01.267973 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a54228-a783-4bc7-800c-ac9b00ddb80a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:01.324702 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ed6c3-92fe-4e4c-82fd-fa908d6161ed None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:01.378132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325eed7-a9aa-4522-a2b8-c91bbf13e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:01.378950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325eed7-a9aa-4522-a2b8-c91bbf13e214 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:01.379292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325eed7-a9aa-4522-a2b8-c91bbf13e214 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:01.379576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325eed7-a9aa-4522-a2b8-c91bbf13e214 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:01.399936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325eed7-a9aa-4522-a2b8-c91bbf13e214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-9325eed7-a9aa-4522-a2b8-c91bbf13e214 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:01.409066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:01.410185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:01.412063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 369/750] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:01.416643 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325eed7-a9aa-4522-a2b8-c91bbf13e214 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:01.435197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a54228-a783-4bc7-800c-ac9b00ddb80a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:01.437695 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a54228-a783-4bc7-800c-ac9b00ddb80a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:01.595213 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 382/751] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:43:01.600732 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a54228-a783-4bc7-800c-ac9b00ddb80a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:01.626249 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325eed7-a9aa-4522-a2b8-c91bbf13e214 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:01.712766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a54228-a783-4bc7-800c-ac9b00ddb80a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:01.717421 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:01.718108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:01.718391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:01.718669 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:01.719468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:01.719854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:01.721236 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:01.746039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 370/752] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:01.752771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:01.755239 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:01.756335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:01.756627 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:01.756913 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:01.769336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:01.771321 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:01.791362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:01.793650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:01.794870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:01.794870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:01.794870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:01.794870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:01.794870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 383/753] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:01.800819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:01.905159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c3f78-d570-421d-8aa7-27c716e76482 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:01.946604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:01.947406 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:01.947692 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:01.948001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:01.973697 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:01.975160 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:02.009055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:02.012532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:02.017758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:02.017758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:02.017758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:02.017758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:02.017758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 371/754] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:02.017758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:02.055468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92096d55-4090-47b3-b082-915140ef2155 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:02.135735 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:02.136440 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:02.136728 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:02.137008 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:02.137739 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:02.138053 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:02.143800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.154067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 384/755] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:02.162408 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:02.197238 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899753-665e-4a25-ac41-1898a7449052 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:02.285680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:02.286357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:02.286639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:02.286915 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:02.287647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:02.288082 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:02.289467 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.310181 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 372/756] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:02.312611 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd5e1d-6d06-4fd0-a493-caae5db585ef None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:02.320506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:02.368515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:02.369345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:02.369674 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:02.369959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:02.378345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:02.386555 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:02.406755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:02.408553 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:02.410855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 385/757] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:02.414514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:02.425167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17722b-1978-4b5f-8020-1f2f126ae547 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:02.460561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:02.461411 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:02.461693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:02.461968 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:02.470109 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:02.471623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:02.487436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:02.489988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:02.492630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 373/758] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:43:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:02.504797 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:02.564243 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff0590-b629-44ff-9b1b-365edabdc72b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:02.614178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:02.614867 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:02.615153 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:02.615433 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:02.616278 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:02.616585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:02.618036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.644052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 386/759] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:02.650130 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:02.700617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291a9cc-6aaf-4605-a740-2a40419b5e62 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:02.745161 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:02.745871 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:02.746161 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:02.746443 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:02.747633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:02.748010 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:02.749516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.784149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 374/760] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:43:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:02.789723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:02.822663 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8852-2515-4839-8b8b-57394d658a72 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:02.867496 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803236-07fb-4164-bada-db08566548b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:02.868200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803236-07fb-4164-bada-db08566548b8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:02.868491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803236-07fb-4164-bada-db08566548b8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:02.868773 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803236-07fb-4164-bada-db08566548b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:02.869640 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17803236-07fb-4164-bada-db08566548b8 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=58e0d217715c43a2bcdf6b4e581146dd) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:02.869956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17803236-07fb-4164-bada-db08566548b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:02.871459 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17803236-07fb-4164-bada-db08566548b8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.878586 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 387/761] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:02 2022] GET /identity/v3/role_assignments?user.id=58e0d217715c43a2bcdf6b4e581146dd&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:02.919116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52a48-5dff-4f52-ae5b-21576074d2fc None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:02.959544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82c73f-a110-4c33-b7dc-410cb439e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:02.960389 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c73f-a110-4c33-b7dc-410cb439e4ae None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:02.960680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c73f-a110-4c33-b7dc-410cb439e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:02.960963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c73f-a110-4c33-b7dc-410cb439e4ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:02.973513 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82c73f-a110-4c33-b7dc-410cb439e4ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:02.974991 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82c73f-a110-4c33-b7dc-410cb439e4ae None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-db82c73f-a110-4c33-b7dc-410cb439e4ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:02.993956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:02.995038 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:02.996077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:02.996077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:02.996077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:02.996077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:02.996077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 375/762] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:03.001080 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803236-07fb-4164-bada-db08566548b8 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.018582 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a371b-0921-4e61-a666-6adc26aa6b87 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.018915 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a371b-0921-4e61-a666-6adc26aa6b87 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.019154 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a371b-0921-4e61-a666-6adc26aa6b87 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.020728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 376/763] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:03.026460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd5f9a-0155-430e-b219-e40286a59294 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.026757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd5f9a-0155-430e-b219-e40286a59294 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.027067 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd5f9a-0155-430e-b219-e40286a59294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.045242 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-0fbd5f9a-0155-430e-b219-e40286a59294 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:03.046460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-0fbd5f9a-0155-430e-b219-e40286a59294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:03.129413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 377/764] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:03.129815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7f6a-898a-470a-9f20-66d36424fc07 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.130115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7f6a-898a-470a-9f20-66d36424fc07 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.130397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7f6a-898a-470a-9f20-66d36424fc07 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.139786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 378/765] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:03.142157 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea963a-30bd-4400-ba9d-d400d6e36a2c None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.142792 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea963a-30bd-4400-ba9d-d400d6e36a2c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.143304 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea963a-30bd-4400-ba9d-d400d6e36a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.201778 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803236-07fb-4164-bada-db08566548b8 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:03.242912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:03.243569 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.243899 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.244182 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.244970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:03.245285 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:03.246701 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:03.261448 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 388/766] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:03.262352 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.295635 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-2cea963a-30bd-4400-ba9d-d400d6e36a2c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:03.296893 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-2cea963a-30bd-4400-ba9d-d400d6e36a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:03.376507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 379/767] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:03.377631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea963a-30bd-4400-ba9d-d400d6e36a2c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.381893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf01096-1871-4e89-b967-b06a9e0f3169 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:03.418819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aebca-f491-4872-9275-2b95768801cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:03.419637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aebca-f491-4872-9275-2b95768801cb None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.419967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aebca-f491-4872-9275-2b95768801cb None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.420248 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aebca-f491-4872-9275-2b95768801cb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.420911 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aebca-f491-4872-9275-2b95768801cb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:03.422299 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aebca-f491-4872-9275-2b95768801cb None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-b88aebca-f491-4872-9275-2b95768801cb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:03.436294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:03.437659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:03.439282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 389/768] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:43:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:03.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05dde-8e2a-4e20-9a4a-270d980aa2dc None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05dde-8e2a-4e20-9a4a-270d980aa2dc None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.441551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05dde-8e2a-4e20-9a4a-270d980aa2dc None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.443905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 390/769] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:03.445259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d05dde-8e2a-4e20-9a4a-270d980aa2dc None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.495363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea963a-30bd-4400-ba9d-d400d6e36a2c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:03.534851 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28309416-2914-4b59-94a0-2e3e08caf3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:03.536049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309416-2914-4b59-94a0-2e3e08caf3ec None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.536339 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309416-2914-4b59-94a0-2e3e08caf3ec None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.536908 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28309416-2914-4b59-94a0-2e3e08caf3ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.544340 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28309416-2914-4b59-94a0-2e3e08caf3ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:03.545776 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28309416-2914-4b59-94a0-2e3e08caf3ec None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:03.558707 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d05dde-8e2a-4e20-9a4a-270d980aa2dc None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-28309416-2914-4b59-94a0-2e3e08caf3ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:03.559503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:03.560694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:03.562043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 380/770] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:03.562577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f223-9254-47b7-a2ff-63bf805b0311 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.562660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f223-9254-47b7-a2ff-63bf805b0311 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.563693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098f223-9254-47b7-a2ff-63bf805b0311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.581115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-9098f223-9254-47b7-a2ff-63bf805b0311 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:03.582288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-9098f223-9254-47b7-a2ff-63bf805b0311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:03.600224 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264eac8-00ea-447c-924c-6dde85894130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:03.601028 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264eac8-00ea-447c-924c-6dde85894130 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.601311 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264eac8-00ea-447c-924c-6dde85894130 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.601588 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264eac8-00ea-447c-924c-6dde85894130 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.611971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264eac8-00ea-447c-924c-6dde85894130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-4264eac8-00ea-447c-924c-6dde85894130 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:03.619726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:03.620993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 391/771] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:03.622377 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264eac8-00ea-447c-924c-6dde85894130 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.653863 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 381/772] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:03.655147 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f223-9254-47b7-a2ff-63bf805b0311 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.728205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264eac8-00ea-447c-924c-6dde85894130 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:03.762225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098f223-9254-47b7-a2ff-63bf805b0311 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:03.762730 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:03.763659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.763978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.764315 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.765037 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:03.765349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:03.767513 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:03.777364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 392/773] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:43:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:03.777364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.799374 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:03.800190 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.800545 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.800889 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.801824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:03.802212 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:03.803706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:03.821945 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 382/774] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:03.822978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.883096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb2f82-28c5-484e-b493-a01a6906aaae None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:03.917080 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df262d-e177-409f-8c14-794e56863567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:03.917768 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df262d-e177-409f-8c14-794e56863567 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.918052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df262d-e177-409f-8c14-794e56863567 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.918328 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df262d-e177-409f-8c14-794e56863567 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.919051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df262d-e177-409f-8c14-794e56863567 None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:03.919369 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df262d-e177-409f-8c14-794e56863567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:03.920756 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df262d-e177-409f-8c14-794e56863567 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:03.928625 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 393/775] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:03.933893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df262d-e177-409f-8c14-794e56863567 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:03.934175 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1e75e-8f44-4fda-98a1-5a9428869868 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:03.968235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:03.969037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:03.969432 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:03.970759 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] PATH_INFO: `/v3/services/network` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:03.970866 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:03.972246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:03.983983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:03.986430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:03.987375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 383/776] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:03 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:03.988699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.038470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df262d-e177-409f-8c14-794e56863567 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.071696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.072403 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.072691 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.072969 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.073742 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:04.074055 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.075424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.087432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 394/777] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:43:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:04.087907 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949150-918b-4ec2-a280-45dd987c8e7e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.088199 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.123333 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790e15-50b9-4c78-8a6d-7193cde20c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.124299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790e15-50b9-4c78-8a6d-7193cde20c71 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.124588 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790e15-50b9-4c78-8a6d-7193cde20c71 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.125043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6790e15-50b9-4c78-8a6d-7193cde20c71 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/8bc210c9b3f94f09b32127dc754a2094/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.128526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790e15-50b9-4c78-8a6d-7193cde20c71 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=8bc210c9b3f94f09b32127dc754a2094, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.130016 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6790e15-50b9-4c78-8a6d-7193cde20c71 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.145270 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 384/778] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:43:03 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/8bc210c9b3f94f09b32127dc754a2094/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:43:04.146459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790e15-50b9-4c78-8a6d-7193cde20c71 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.226041 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a882b8-5a53-4915-af00-f5fe43f737ce None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.274407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.275754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.276077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.276666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.288122 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6790e15-50b9-4c78-8a6d-7193cde20c71 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.297789 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.299210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:04.324473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:04.325562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:04.326565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:04.326565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:04.326565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:04.326565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:04.326565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 395/779] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:04.326887 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.334938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.335638 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.335951 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.336233 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.336963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] RBAC: Adding query filter params (name=network) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:04.337274 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.338671 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.344311 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 385/780] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:04.345942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.463254 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb4114-8f23-4287-a63a-7313ad8a53a1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.467294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cbd17-1e6b-4e75-bea2-7ec435736928 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.505858 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.506639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.506760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.506948 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.507208 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.507397 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.507737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.507979 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:04.508089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.508293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.508879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] RBAC: Adding query filter params (interface=public, service_id=7fb466cda6564132842b2d207409208a, region_id=RegionOne) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:04.509199 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.509663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.510558 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.523589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 386/782] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:04.523792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 396/782] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/endpoints?service_id=7fb466cda6564132842b2d207409208a&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:04.525086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.529802 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.632494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca334c-7b69-453c-bdff-3c1743cd8d4c None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.653672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd4dbd-2750-4b0a-8d9d-cdbbde3d3c0e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.669118 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cade70-9d73-4a23-8e72-257c000f678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.669890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cade70-9d73-4a23-8e72-257c000f678e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.670246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cade70-9d73-4a23-8e72-257c000f678e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.670597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cade70-9d73-4a23-8e72-257c000f678e None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.671355 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cade70-9d73-4a23-8e72-257c000f678e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.673525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cade70-9d73-4a23-8e72-257c000f678e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.683918 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 397/783] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:04.684985 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cade70-9d73-4a23-8e72-257c000f678e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.693293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.693985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.694317 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.695587 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.696366 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] RBAC: Adding query filter params (type=network) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:04.696676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.698122 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.705170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 387/784] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:04.711656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.835466 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28368e59-5186-4428-b7d9-99e42dcc4990 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:04.874329 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:04.875011 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:04.875293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:04.876089 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:04.876911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] RBAC: Adding query filter params (interface=public, service_id=dbb6dce9430042d593bd80b169410dac, region_id=RegionOne) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:04.877202 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:04.879618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:04.888689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 388/785] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/endpoints?service_id=dbb6dce9430042d593bd80b169410dac&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:04.894665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:04.956562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cade70-9d73-4a23-8e72-257c000f678e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:05.010271 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:05.011688 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.012011 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:05.012290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:05.014021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434b922-50f0-4169-8a82-bf6412daf208 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:05.023358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:05.024893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:05.045760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:05.048394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:05.049462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 398/786] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:05.055026 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:05.057710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd6322-868e-48ad-becc-d86d75967d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:05.058494 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd6322-868e-48ad-becc-d86d75967d45 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.058877 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd6322-868e-48ad-becc-d86d75967d45 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:05.059268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd6322-868e-48ad-becc-d86d75967d45 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:05.060098 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd6322-868e-48ad-becc-d86d75967d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:05.061812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd6322-868e-48ad-becc-d86d75967d45 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:05.067672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 389/787] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:43:04 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:05.199736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a67d27-405d-4d40-bf57-587f4fc40f89 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:05.245703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5a019-ca12-4d06-965f-5e5f8cf107b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:05.246399 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5a019-ca12-4d06-965f-5e5f8cf107b8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.246689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5a019-ca12-4d06-965f-5e5f8cf107b8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:05.246970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5a019-ca12-4d06-965f-5e5f8cf107b8 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:05.247960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5a019-ca12-4d06-965f-5e5f8cf107b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:05.248269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5a019-ca12-4d06-965f-5e5f8cf107b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:05.249733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5a019-ca12-4d06-965f-5e5f8cf107b8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:05.271418 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 399/788] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:43:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:05.276775 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd6322-868e-48ad-becc-d86d75967d45 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:05.383217 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c39b-2b84-46b0-8113-dd2e0da0f3b0 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.383606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c39b-2b84-46b0-8113-dd2e0da0f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:05.384017 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c39b-2b84-46b0-8113-dd2e0da0f3b0 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:05.385349 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd6322-868e-48ad-becc-d86d75967d45 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:05.386603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 400/789] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:05.394795 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5846-dd4f-4ccd-9854-53ea1e90f3ef None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.395411 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5846-dd4f-4ccd-9854-53ea1e90f3ef None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:05.396368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5846-dd4f-4ccd-9854-53ea1e90f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:05.418666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-648a5846-dd4f-4ccd-9854-53ea1e90f3ef None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:05.420290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-648a5846-dd4f-4ccd-9854-53ea1e90f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:05.435305 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:05.436834 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.437374 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:05.437892 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:05.449634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:05.453016 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:05.484646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:05.486230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:05.487245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:05.487245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:05.487245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:05.487245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:05.487245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 390/790] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:05.492192 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:05.540072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 401/791] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:05.575333 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a5846-dd4f-4ccd-9854-53ea1e90f3ef None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:05.666456 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d687a-7e13-4897-b5b8-d45ffa26b6b8 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:05.689429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a5846-dd4f-4ccd-9854-53ea1e90f3ef None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:05.732856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaf418-a940-450f-abe9-f1bac4822643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:05.735613 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaf418-a940-450f-abe9-f1bac4822643 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.735613 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaf418-a940-450f-abe9-f1bac4822643 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:05.735613 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaf418-a940-450f-abe9-f1bac4822643 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:05.746273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:05.747664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.748947 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:05.749610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:05.751749 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:05.752986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:05.756636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:05.759864 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddaf418-a940-450f-abe9-f1bac4822643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-8ddaf418-a940-450f-abe9-f1bac4822643 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:05.768501 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:05.769743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:05.770681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:05.786326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 391/792] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:05.787898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 402/793] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:05.788989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:05.791558 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaf418-a940-450f-abe9-f1bac4822643 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:05.951212 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25170df4-20b6-48d6-9281-751e310e52b2 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:05.972209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaf418-a940-450f-abe9-f1bac4822643 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:05.998804 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:05.999544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:05.999858 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.000137 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.001591 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:06.001910 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:06.003292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:06.027499 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 392/794] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:06.034506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:06.047189 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:06.049192 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.049481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.049757 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.064770 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:06.066248 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:06.093610 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:06.095447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:06.097100 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 403/795] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:06.100959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:06.201875 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f86f6-fbe0-401d-b613-fd326ffa8401 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:06.223664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16922-e81c-413c-af6f-40e7466f34ae None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:06.263055 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:06.264177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.265283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.265963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.268363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:06.269813 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:06.272021 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:06.277129 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:06.278212 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.278732 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.279238 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.297019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 404/796] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:06.304326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:06.305026 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:06.305777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:06.344078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:06.345884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:06.346903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:06.346903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:06.346903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:06.346903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:06.355941 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 393/797] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:06.361866 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:06.414242 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb171-f489-4eaf-a978-282dafee65a3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:06.461966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360757-27db-4a2f-8d6e-2a0b46818770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:06.463212 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360757-27db-4a2f-8d6e-2a0b46818770 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.463713 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360757-27db-4a2f-8d6e-2a0b46818770 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.464256 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360757-27db-4a2f-8d6e-2a0b46818770 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/6226dd06a9d84bd0ac02077d29f9c7a2/roles/a0d927cd47694ddd9d6e391569dce904` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.495523 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba360757-27db-4a2f-8d6e-2a0b46818770 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=6226dd06a9d84bd0ac02077d29f9c7a2, role_id=a0d927cd47694ddd9d6e391569dce904)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:06.497064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba360757-27db-4a2f-8d6e-2a0b46818770 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:06.518505 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2bb80-4f55-4ae4-b0e8-f597032a49ac None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:06.540752 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 405/798] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:43:06 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/6226dd06a9d84bd0ac02077d29f9c7a2/roles/a0d927cd47694ddd9d6e391569dce904 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:43:06.575715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744784f-55ad-47f9-b75e-02090ac32821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:06.576447 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744784f-55ad-47f9-b75e-02090ac32821 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.576740 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744784f-55ad-47f9-b75e-02090ac32821 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.577026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744784f-55ad-47f9-b75e-02090ac32821 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.577790 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744784f-55ad-47f9-b75e-02090ac32821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:06.578109 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744784f-55ad-47f9-b75e-02090ac32821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:06.579622 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744784f-55ad-47f9-b75e-02090ac32821 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:06.593365 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 394/799] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:06.599528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360757-27db-4a2f-8d6e-2a0b46818770 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:06.736396 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360757-27db-4a2f-8d6e-2a0b46818770 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:06.760195 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada3e56-86ff-47fa-9839-f153d036961f None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.760536 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada3e56-86ff-47fa-9839-f153d036961f None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.760988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada3e56-86ff-47fa-9839-f153d036961f None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.763472 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 395/800] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:06.770804 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920fdd-cd6d-4d38-b97a-01b593acc491 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.771132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920fdd-cd6d-4d38-b97a-01b593acc491 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.771373 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920fdd-cd6d-4d38-b97a-01b593acc491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.779511 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:06.780551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.780849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.781134 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.790731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:06.792320 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:06.793899 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-db920fdd-cd6d-4d38-b97a-01b593acc491 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:06.795101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-db920fdd-cd6d-4d38-b97a-01b593acc491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:06.811235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:06.814225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:06.815597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 406/801] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:06.819565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:06.881896 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 396/802] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:06.906287 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db920fdd-cd6d-4d38-b97a-01b593acc491 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:06.941930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf4e45-2c15-4f27-942a-450156a480f3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:06.985489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:06.986178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:06.986516 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:06.986735 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:06.987587 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:06.987931 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:06.989380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:07.028825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 407/803] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:43:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:07.034918 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:07.068562 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db920fdd-cd6d-4d38-b97a-01b593acc491 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:07.108312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560dd25-a1a5-40cf-9317-1b2b50f56ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:07.109190 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560dd25-a1a5-40cf-9317-1b2b50f56ed5 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.109479 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560dd25-a1a5-40cf-9317-1b2b50f56ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.109754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560dd25-a1a5-40cf-9317-1b2b50f56ed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.121930 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560dd25-a1a5-40cf-9317-1b2b50f56ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a560dd25-a1a5-40cf-9317-1b2b50f56ed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:07.131605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:07.132711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:07.133663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 397/804] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:07.141185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560dd25-a1a5-40cf-9317-1b2b50f56ed5 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:07.241065 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36668c3f-5c0a-4362-a6d7-dadb39505cd1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:07.260993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560dd25-a1a5-40cf-9317-1b2b50f56ed5 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:07.299718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:07.300960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.301433 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.301959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.302376 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:07.303129 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.307796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.307796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.307796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:07.307796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:07.307796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:07.316440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 398/805] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:07.323803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:07.324319 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:07.326234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:07.353482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:07.354737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:07.356007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:07.356007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:07.356007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:07.356007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:07.357734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 408/806] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:07.364907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:07.503189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d6b5-6bb5-45d9-864f-54421e9d346d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:07.559733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164370f9-aa7f-408f-8642-73cad4d242d1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:07.570667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:07.571484 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.571790 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.572081 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.590134 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:07.591598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:07.617637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:07.618736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:07.619729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:07.619729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:07.619729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:07.619729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:07.619729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 399/807] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:07.624703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:07.637219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a3ed2-fa91-4bbe-945a-187bb4769687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:07.637907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3ed2-fa91-4bbe-945a-187bb4769687 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.638196 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3ed2-fa91-4bbe-945a-187bb4769687 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.638476 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a3ed2-fa91-4bbe-945a-187bb4769687 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.639209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a3ed2-fa91-4bbe-945a-187bb4769687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:07.639520 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a3ed2-fa91-4bbe-945a-187bb4769687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:07.640935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a3ed2-fa91-4bbe-945a-187bb4769687 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:07.661472 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 409/808] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:07.662826 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd592-e0a0-439b-8e50-df555f1ddd40 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.667541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd592-e0a0-439b-8e50-df555f1ddd40 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.667894 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dd592-e0a0-439b-8e50-df555f1ddd40 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.673087 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 410/809] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:07.673087 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dd592-e0a0-439b-8e50-df555f1ddd40 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:07.780220 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874afb34-5977-4e54-b4d4-8241a8834dac None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:07.783210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dd592-e0a0-439b-8e50-df555f1ddd40 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:07.821966 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c19196-bce1-4dac-8faf-a20eec830b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:07.822188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:07.822771 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.823061 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.823342 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.823820 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19196-bce1-4dac-8faf-a20eec830b13 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.824324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19196-bce1-4dac-8faf-a20eec830b13 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.824817 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19196-bce1-4dac-8faf-a20eec830b13 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.825762 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c19196-bce1-4dac-8faf-a20eec830b13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:07.826273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c19196-bce1-4dac-8faf-a20eec830b13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:07.827854 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c19196-bce1-4dac-8faf-a20eec830b13 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:07.831176 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:07.832719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:07.845618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 400/810] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:07.847241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e396-6d65-46a4-a1b4-178ae50a848a None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:07.847743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e396-6d65-46a4-a1b4-178ae50a848a None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:07.848282 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3e396-6d65-46a4-a1b4-178ae50a848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:07.849644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:07.850604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:07.851598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 411/811] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:07.852195 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:07.876987 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-0af3e396-6d65-46a4-a1b4-178ae50a848a None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:07.878371 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-0af3e396-6d65-46a4-a1b4-178ae50a848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:07.955833 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 401/812] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:07.955833 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e396-6d65-46a4-a1b4-178ae50a848a None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:07.967629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea765217-6736-4bc1-8c38-5e4f41c072c0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.004212 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b40dd6-3b7c-4b0d-aebd-a4e238252e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.005319 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40dd6-3b7c-4b0d-aebd-a4e238252e4f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.005605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40dd6-3b7c-4b0d-aebd-a4e238252e4f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.005888 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b40dd6-3b7c-4b0d-aebd-a4e238252e4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.014017 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40dd6-3b7c-4b0d-aebd-a4e238252e4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.015510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b40dd6-3b7c-4b0d-aebd-a4e238252e4f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-45b40dd6-3b7c-4b0d-aebd-a4e238252e4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:08.032231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:08.033382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:08.034450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:08.036850 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 412/813] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:43:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:08.038365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed32fd-6b8f-48ce-ab75-994f2126d75f None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.038653 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed32fd-6b8f-48ce-ab75-994f2126d75f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.038928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed32fd-6b8f-48ce-ab75-994f2126d75f None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.040368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 413/814] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:08.043472 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed32fd-6b8f-48ce-ab75-994f2126d75f None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.056301 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3e396-6d65-46a4-a1b4-178ae50a848a None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.090484 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.091171 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.091513 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.091698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.092508 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:08.092818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.094753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.106598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 402/815] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:08.107337 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.150509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed32fd-6b8f-48ce-ab75-994f2126d75f None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.185296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f18d6-834c-4e9d-97af-d3e5d8850820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.186116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f18d6-834c-4e9d-97af-d3e5d8850820 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.186663 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f18d6-834c-4e9d-97af-d3e5d8850820 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.186942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f18d6-834c-4e9d-97af-d3e5d8850820 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.187600 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f18d6-834c-4e9d-97af-d3e5d8850820 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.189039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f18d6-834c-4e9d-97af-d3e5d8850820 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-309f18d6-834c-4e9d-97af-d3e5d8850820 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:08.201210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:08.202246 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:08.203191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 414/816] 10.222.0.32 () {56 vars in 1129 bytes} [Mon May 9 15:43:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:08.205371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be1cd9-c101-4e48-b957-85ef079fac24 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.205371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be1cd9-c101-4e48-b957-85ef079fac24 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.205371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be1cd9-c101-4e48-b957-85ef079fac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.222381 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-10be1cd9-c101-4e48-b957-85ef079fac24 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:08.223568 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-10be1cd9-c101-4e48-b957-85ef079fac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:08.233287 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09e5ea-c9dc-413b-adc7-14bd3028bd05 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.267325 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.268029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.268312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.268582 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.269417 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:08.269726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.271141 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.292937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 403/817] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:43:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:08.292937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.300082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 415/818] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:08.301193 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be1cd9-c101-4e48-b957-85ef079fac24 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.397926 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9421018-86b9-4301-b17c-0567f2cb7236 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.406252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be1cd9-c101-4e48-b957-85ef079fac24 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.442073 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d0b4-9940-4780-8e69-151403833c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.443096 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d0b4-9940-4780-8e69-151403833c05 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.443460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d0b4-9940-4780-8e69-151403833c05 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.443832 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d0b4-9940-4780-8e69-151403833c05 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/58e0d217715c43a2bcdf6b4e581146dd/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.445912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0d0b4-9940-4780-8e69-151403833c05 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=58e0d217715c43a2bcdf6b4e581146dd, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.447356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0d0b4-9940-4780-8e69-151403833c05 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.447659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.448363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.448657 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.448934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.449693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:08.449955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.451322 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.456796 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 416/819] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:43:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:08.457887 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.465889 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 404/820] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:43:08 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/58e0d217715c43a2bcdf6b4e581146dd/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:43:08.466952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d0b4-9940-4780-8e69-151403833c05 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.603881 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d0b4-9940-4780-8e69-151403833c05 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.621435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bc168-53e0-4812-8b0a-17990dcd26fb None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.636953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.637832 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.638211 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.638543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] PATH_INFO: `/v3/services/network` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.639219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.640708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:08.653861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:08.655057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:43:08.656024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:08.661798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 405/821] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:08 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:08.662446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.669237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c61c58-a984-4504-ab2e-7c6bdae39075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.670318 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61c58-a984-4504-ab2e-7c6bdae39075 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.670898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61c58-a984-4504-ab2e-7c6bdae39075 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.671398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61c58-a984-4504-ab2e-7c6bdae39075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.767988 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c61c58-a984-4504-ab2e-7c6bdae39075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.771090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c61c58-a984-4504-ab2e-7c6bdae39075 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.800936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ef639-e065-4f0f-9679-58ab6c93e304 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:08.847435 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:08.848219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:08.848539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:08.849289 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:08.850016 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:08.850333 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:08.852049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:08.863363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 406/822] 10.222.0.32 () {56 vars in 1124 bytes} [Mon May 9 15:43:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:08.863363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.895672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 417/823] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:43:08.896939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c61c58-a984-4504-ab2e-7c6bdae39075 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:08.996502 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e70f90-b7ad-4271-b63d-717420a8ac05 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.030693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c61c58-a984-4504-ab2e-7c6bdae39075 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.038909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.039853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.040390 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.040873 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.041795 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] RBAC: Adding query filter params (name=network) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:09.042334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:09.043934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:09.050209 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 407/824] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:09.051319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.080761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409a4fb-14d1-4600-92b0-87c99c00c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.081458 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a4fb-14d1-4600-92b0-87c99c00c249 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.081743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a4fb-14d1-4600-92b0-87c99c00c249 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.082018 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a4fb-14d1-4600-92b0-87c99c00c249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.082760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409a4fb-14d1-4600-92b0-87c99c00c249 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:09.084173 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409a4fb-14d1-4600-92b0-87c99c00c249 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:09.112517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 418/825] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:43:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:09.113547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409a4fb-14d1-4600-92b0-87c99c00c249 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.167293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4082216-bb65-42fc-afba-11e38615b895 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.223307 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8331440-21aa-48e4-a838-a7a2cbf8bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.224259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331440-21aa-48e4-a838-a7a2cbf8bafb None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.224546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331440-21aa-48e4-a838-a7a2cbf8bafb None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.224822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331440-21aa-48e4-a838-a7a2cbf8bafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.237445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8331440-21aa-48e4-a838-a7a2cbf8bafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:09.239165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8331440-21aa-48e4-a838-a7a2cbf8bafb None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:09.255696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409a4fb-14d1-4600-92b0-87c99c00c249 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-c8331440-21aa-48e4-a838-a7a2cbf8bafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:09.263368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:09.264504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:09.265537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:09.265537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:09.265537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:09.265537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:09.266576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 408/826] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:09.271178 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900752-673d-45ef-a593-be2d83f4b54c None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.271178 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900752-673d-45ef-a593-be2d83f4b54c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.271178 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900752-673d-45ef-a593-be2d83f4b54c None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.271178 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 409/827] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:09.273475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900752-673d-45ef-a593-be2d83f4b54c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.300315 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b7ebe-1f25-4147-9b4f-c6a8db4b64f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.301011 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b7ebe-1f25-4147-9b4f-c6a8db4b64f4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.301297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b7ebe-1f25-4147-9b4f-c6a8db4b64f4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.301578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b7ebe-1f25-4147-9b4f-c6a8db4b64f4 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.302325 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b7ebe-1f25-4147-9b4f-c6a8db4b64f4 None admin] RBAC: Adding query filter params (type=network) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:09.302635 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b7ebe-1f25-4147-9b4f-c6a8db4b64f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:09.304102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b7ebe-1f25-4147-9b4f-c6a8db4b64f4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:09.309665 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 419/828] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:09.310978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d0ce-c244-4bfc-8558-7554beb800e9 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.311518 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d0ce-c244-4bfc-8558-7554beb800e9 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.311834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258d0ce-c244-4bfc-8558-7554beb800e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.328930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-1258d0ce-c244-4bfc-8558-7554beb800e9 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:09.330245 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-1258d0ce-c244-4bfc-8558-7554beb800e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:09.402909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900752-673d-45ef-a593-be2d83f4b54c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.410732 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 420/829] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:09.411606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d0ce-c244-4bfc-8558-7554beb800e9 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.450646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.451723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.452296 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.452640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.453442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:09.454399 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:09.459821 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:09.468828 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 410/830] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:09.470393 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.541420 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258d0ce-c244-4bfc-8558-7554beb800e9 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.576429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1d13-62e5-44f6-92eb-467dfdcc87a6 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.589891 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf350cb-ad2c-4811-9889-2c0868cb92e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.590791 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf350cb-ad2c-4811-9889-2c0868cb92e1 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.591375 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf350cb-ad2c-4811-9889-2c0868cb92e1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.592224 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf350cb-ad2c-4811-9889-2c0868cb92e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.593419 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf350cb-ad2c-4811-9889-2c0868cb92e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:09.595825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf350cb-ad2c-4811-9889-2c0868cb92e1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:09.613893 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225812-3562-4e01-9d7a-1bb687e6d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.614906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225812-3562-4e01-9d7a-1bb687e6d646 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.615293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225812-3562-4e01-9d7a-1bb687e6d646 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.615717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3225812-3562-4e01-9d7a-1bb687e6d646 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.620020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 421/831] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:43:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:09.621242 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf350cb-ad2c-4811-9889-2c0868cb92e1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.628650 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3225812-3562-4e01-9d7a-1bb687e6d646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-c3225812-3562-4e01-9d7a-1bb687e6d646 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:09.637276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:09.638634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:43:09.639844 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:09.642578 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 411/832] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:43:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:09.657030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225812-3562-4e01-9d7a-1bb687e6d646 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.769449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf350cb-ad2c-4811-9889-2c0868cb92e1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.811248 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.813005 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.813764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.814261 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.823132 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:09.825065 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:09.843979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:09.845340 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:09.846390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:09.846390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:09.846390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:09.846390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:09.846390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:09.846390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:09.846390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:09.846390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:09.849408 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 422/833] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:09.855509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.906482 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3225812-3562-4e01-9d7a-1bb687e6d646 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:09.960347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:09.961650 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:09.962623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:09.963145 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:09.964504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:09.965193 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:09.967095 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:09.979329 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 412/834] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:43:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:09.985794 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:09.989417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8471bd6-f42b-4d5b-bc79-f432348206d5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:10.030537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:10.031212 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.031499 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.032529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.034046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:10.034170 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:10.035533 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:10.051087 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 423/835] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:10.061637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:10.105440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb731cc-8a52-4796-bd53-42a99c8ca184 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:10.143823 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:10.145176 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.145693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.146157 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.157900 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:10.159352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:10.185885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:10.187547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:10.188620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:10.188620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:10.188620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:10.188620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:10.192102 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 413/836] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:10.192982 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:10.201731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8daa54-1dfd-4bbe-8c23-41914f9e3c39 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:10.240497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:10.241075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.241360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.241632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.242459 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=8bc210c9b3f94f09b32127dc754a2094) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:10.242770 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:10.244244 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:10.258538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 424/837] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:10 2022] GET /identity/v3/role_assignments?user.id=8bc210c9b3f94f09b32127dc754a2094&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:10.308126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fa683-2132-44af-b5af-521d9a32fd6f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:10.349601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:10.350701 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.351204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.351696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.352703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:10.353259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:10.354876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:10.369750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 414/838] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:10.374997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:10.486791 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a939986-ae3f-4a36-aa2e-3f45000c6dd4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:10.521815 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:10.522578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.522863 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.523137 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.533109 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:10.534606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:10.550259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:10.551363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:10.552497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 425/839] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:43:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:10.557466 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:10.659678 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0ef07-4e88-4aed-b382-f324be90c3f1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:10.703027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc3af3-7ac6-426d-ba85-c2ed37c7c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:10.704297 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc3af3-7ac6-426d-ba85-c2ed37c7c380 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.704584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc3af3-7ac6-426d-ba85-c2ed37c7c380 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.704869 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc3af3-7ac6-426d-ba85-c2ed37c7c380 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.705754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc3af3-7ac6-426d-ba85-c2ed37c7c380 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:10.706065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc3af3-7ac6-426d-ba85-c2ed37c7c380 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:10.707531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc3af3-7ac6-426d-ba85-c2ed37c7c380 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:10.726986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 415/840] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:43:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:10.732986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:10.850802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaa163-543e-48e4-ab17-5645e2578447 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:10.892720 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742793-446a-4c53-b8fb-8a119a602db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:10.895976 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91e2e-7e36-4346-a5c3-49e2751073bc None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.896185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742793-446a-4c53-b8fb-8a119a602db8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.896292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91e2e-7e36-4346-a5c3-49e2751073bc None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.896478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742793-446a-4c53-b8fb-8a119a602db8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.896657 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd91e2e-7e36-4346-a5c3-49e2751073bc None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.896758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742793-446a-4c53-b8fb-8a119a602db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.898643 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 416/841] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:10.904119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016bdf-4699-4c6b-885e-064c47178edd None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:10.904415 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016bdf-4699-4c6b-885e-064c47178edd None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:10.904698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb016bdf-4699-4c6b-885e-064c47178edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:10.924496 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-cb016bdf-4699-4c6b-885e-064c47178edd None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:10.925694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-cb016bdf-4699-4c6b-885e-064c47178edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:10.970674 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8742793-446a-4c53-b8fb-8a119a602db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:10.972294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8742793-446a-4c53-b8fb-8a119a602db8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:11.023181 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 417/842] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:11.052235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016bdf-4699-4c6b-885e-064c47178edd None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.079191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 426/843] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:43:11.085147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742793-446a-4c53-b8fb-8a119a602db8 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.174438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb016bdf-4699-4c6b-885e-064c47178edd None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:11.191048 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742793-446a-4c53-b8fb-8a119a602db8 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:11.214354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46742abd-748f-4b67-88bf-f489e6f3afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:11.215158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742abd-748f-4b67-88bf-f489e6f3afb3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.215449 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742abd-748f-4b67-88bf-f489e6f3afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.215733 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742abd-748f-4b67-88bf-f489e6f3afb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.229259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:11.229762 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.230048 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.230329 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.231639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46742abd-748f-4b67-88bf-f489e6f3afb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-46742abd-748f-4b67-88bf-f489e6f3afb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:11.239683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:11.240841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:11.241789 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 418/844] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:11.246947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:11.248614 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:11.248954 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46742abd-748f-4b67-88bf-f489e6f3afb3 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:11.273104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:11.276545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:11.280517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:11.280517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:11.280517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:11.280517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:11.280517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 427/845] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:11.281874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.383886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46742abd-748f-4b67-88bf-f489e6f3afb3 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:11.410979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda196-5fcb-4497-82e2-661a700ea8e2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:11.427127 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:11.427735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.428053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.428336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.429113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:11.429428 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:11.431416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:11.443822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 419/846] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:11.449299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.460109 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:11.460879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.461242 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.461598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.462409 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:11.462816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:11.464849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:11.482870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 428/847] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:11.484376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.592088 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe68cc-5736-412c-9c8a-79b94b404458 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:11.596410 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af75c2f-0fde-4be0-8f0e-d0824c57e26c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:11.632065 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:11.632657 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.633043 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.633397 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.642542 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:11.644198 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:11.648390 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:11.649687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.650173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.650666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:11.661115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:11.662177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:11.663188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:11.663188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:11.663188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:11.663188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:11.663188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:11.663188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:11.663188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:11.663188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:11.667708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 429/848] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:11.668496 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:11.669255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.670436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:11.698515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:11.699680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:11.700981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:11.700981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:11.700981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:11.700981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:11.706138 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 420/849] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:11.707268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.811086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf6357-df11-485f-82d4-d63963e7cb5c None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:11.833931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8a03f-240c-4764-b5a0-338b0d74943c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:11.856887 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b278f-7c67-4823-913b-5fb4859576b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:11.857726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b278f-7c67-4823-913b-5fb4859576b1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.858020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b278f-7c67-4823-913b-5fb4859576b1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.858304 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b278f-7c67-4823-913b-5fb4859576b1 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.859469 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b278f-7c67-4823-913b-5fb4859576b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:11.860991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b278f-7c67-4823-913b-5fb4859576b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:11.863104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b278f-7c67-4823-913b-5fb4859576b1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:11.870339 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224a4c5-74d3-482c-99df-02a48db625d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:11.871019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224a4c5-74d3-482c-99df-02a48db625d4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.871305 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224a4c5-74d3-482c-99df-02a48db625d4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.871584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224a4c5-74d3-482c-99df-02a48db625d4 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.872394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224a4c5-74d3-482c-99df-02a48db625d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:11.872658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224a4c5-74d3-482c-99df-02a48db625d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:11.874022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224a4c5-74d3-482c-99df-02a48db625d4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:11.875579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 430/850] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:11.877092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38f07-1268-4e45-8186-a3cf4c93e76f None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.877391 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38f07-1268-4e45-8186-a3cf4c93e76f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.877676 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad38f07-1268-4e45-8186-a3cf4c93e76f None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.879059 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 431/851] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:11.883716 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38f07-1268-4e45-8186-a3cf4c93e76f None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.887904 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 421/852] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:11.888684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794d12-15ce-48d1-b19b-96f46adab4e9 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:11.888978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794d12-15ce-48d1-b19b-96f46adab4e9 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:11.889260 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794d12-15ce-48d1-b19b-96f46adab4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:11.912900 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-73794d12-15ce-48d1-b19b-96f46adab4e9 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:11.914092 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-73794d12-15ce-48d1-b19b-96f46adab4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:11.984941 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 422/853] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:11.985945 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794d12-15ce-48d1-b19b-96f46adab4e9 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:11.997743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad38f07-1268-4e45-8186-a3cf4c93e76f None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:12.031969 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:12.032639 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.033421 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.033701 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.034616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=6226dd06a9d84bd0ac02077d29f9c7a2) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:12.034859 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:12.036359 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:12.042622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 432/854] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/role_assignments?user.id=6226dd06a9d84bd0ac02077d29f9c7a2&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:12.046198 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:12.118950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794d12-15ce-48d1-b19b-96f46adab4e9 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:12.169452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:12.170538 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.170972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.171389 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.182334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:12.184210 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:12.197881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fbe94-d47a-40d6-a07f-9fc44dfb1d29 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:12.205612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:12.206741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:43:12.207932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:12.214245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 423/855] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:12.214892 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:12.247730 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:12.248901 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.249400 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.249884 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.251660 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:12.253233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:12.267289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:12.268510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:12.269435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:12.277210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 433/856] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:12.278358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:12.329481 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9567c4-7236-4ab0-9915-c7f5681c4f3d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:12.382067 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:12.382755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.383043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.383322 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.384492 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:12.384607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:12.385957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:12.394254 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f341b2-a541-48b1-b821-99682360c23e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:12.404960 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 424/857] 10.222.0.32 () {56 vars in 1135 bytes} [Mon May 9 15:43:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:12.413515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:12.434757 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:12.436491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.437279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.438264 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.439310 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:12.440153 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:12.442226 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:12.448809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 434/858] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:12.455131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:12.540274 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c614a-5a85-4edf-bdd1-5fe69c04ea82 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:12.560199 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841db4a-b4db-4db8-b940-aca89b7bdff0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:12.584549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dd0c0-0e2e-461b-85f8-a42844b18c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:12.585338 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dd0c0-0e2e-461b-85f8-a42844b18c36 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.585635 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dd0c0-0e2e-461b-85f8-a42844b18c36 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.586244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dd0c0-0e2e-461b-85f8-a42844b18c36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.597795 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:12.598722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.599160 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.599588 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.600490 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:12.600966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:12.602545 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:12.612080 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 435/859] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:12.665069 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dd0c0-0e2e-461b-85f8-a42844b18c36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:12.666566 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dd0c0-0e2e-461b-85f8-a42844b18c36 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:12.783911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 425/860] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:43:12.789861 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:12.900265 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec0a3a-414a-4cba-afa4-11c450f7961b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:12.905288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ba0f-428c-425f-9e27-fcf696c1d1eb None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.905581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ba0f-428c-425f-9e27-fcf696c1d1eb None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.905864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012ba0f-428c-425f-9e27-fcf696c1d1eb None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.908001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 426/861] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:12.913310 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee88d85-20f4-4d3c-a8ef-77d716b2ac76 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.913600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee88d85-20f4-4d3c-a8ef-77d716b2ac76 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.913886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee88d85-20f4-4d3c-a8ef-77d716b2ac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.935529 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-9ee88d85-20f4-4d3c-a8ef-77d716b2ac76 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:12.937618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-9ee88d85-20f4-4d3c-a8ef-77d716b2ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:12.942581 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:12.943394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:12.943680 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:12.943989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:12.957128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:12.959055 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:12.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:12.981930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:12.982939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:12.982939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:12.982939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:12.982939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:12.982939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 436/862] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:12.988802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:13.019794 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 427/863] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:13.041928 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee88d85-20f4-4d3c-a8ef-77d716b2ac76 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:13.105084 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e28b6-a125-4138-9fed-4ab7d10997a8 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:13.147397 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:13.148405 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:13.148710 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:13.148997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:13.149731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:13.150046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:13.151496 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:13.165243 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee88d85-20f4-4d3c-a8ef-77d716b2ac76 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:13.171077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 437/864] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:13.174792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:13.215269 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:13.216967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:13.217264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:13.217543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:13.218208 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:13.220782 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:13.238099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:13.239419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:13.240400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 428/865] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:43:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:13.245925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:13.298164 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28603fb6-17f0-403f-b03c-221e71cbe08f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:13.341821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:13.342716 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:13.343374 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:13.343724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:13.352240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:13.354257 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:13.379999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720b00-d73e-4bf9-b4f9-f0a5db95df36 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:13.380351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:13.381578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:13.382928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:13.382928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:13.382928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:13.382928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:13.382928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:13.382928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:13.382928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:13.382928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:13.387412 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 438/866] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:13.390874 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:13.428089 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:13.429927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:13.430459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:13.430958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:13.431925 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:13.432455 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:13.434473 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:13.442622 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 429/867] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:13.448967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:13.499735 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bdfe4-b97d-4ee5-a860-a574ad94e136 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:13.536685 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:13.537423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:13.537708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:13.537984 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:13.539127 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:13.539439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:13.541115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:13.563946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 439/868] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:13.565942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:13.581550 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23bc4-346c-4a2b-9cf0-b742c7918ef2 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:13.616176 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8984f8-da34-43d4-acd8-024046795338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:13.616846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8984f8-da34-43d4-acd8-024046795338 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:13.617170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8984f8-da34-43d4-acd8-024046795338 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:13.617443 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8984f8-da34-43d4-acd8-024046795338 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:13.618152 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8984f8-da34-43d4-acd8-024046795338 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:13.618456 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8984f8-da34-43d4-acd8-024046795338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:13.619912 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8984f8-da34-43d4-acd8-024046795338 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:13.627827 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 430/869] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:13.696181 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04411a2-499a-4c24-89ef-8e9062b2889d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:13.735361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674755-63c8-4b02-ab36-7786285a74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:13.736381 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674755-63c8-4b02-ab36-7786285a74da None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:13.740012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674755-63c8-4b02-ab36-7786285a74da None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:13.740012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674755-63c8-4b02-ab36-7786285a74da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:13.740012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674755-63c8-4b02-ab36-7786285a74da None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=58e0d217715c43a2bcdf6b4e581146dd) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:13.740012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674755-63c8-4b02-ab36-7786285a74da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:13.740012 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674755-63c8-4b02-ab36-7786285a74da None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:13.747439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 440/870] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:13 2022] GET /identity/v3/role_assignments?user.id=58e0d217715c43a2bcdf6b4e581146dd&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:14.527870 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33e94-a69e-4eb6-8ce2-5b87e96b3b22 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:14.528436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33e94-a69e-4eb6-8ce2-5b87e96b3b22 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:14.528436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d33e94-a69e-4eb6-8ce2-5b87e96b3b22 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:14.530066 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 431/871] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:14.536555 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b69b0b-c401-476e-8c8f-caa1dc425363 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:14.536984 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b69b0b-c401-476e-8c8f-caa1dc425363 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:14.537167 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b69b0b-c401-476e-8c8f-caa1dc425363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:14.555360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-a5b69b0b-c401-476e-8c8f-caa1dc425363 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:14.556625 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-a5b69b0b-c401-476e-8c8f-caa1dc425363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:14.629946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 441/872] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:14.653493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d33e94-a69e-4eb6-8ce2-5b87e96b3b22 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:14.758501 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d33e94-a69e-4eb6-8ce2-5b87e96b3b22 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:14.791984 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d72d-5309-45e5-bfcf-1c997c07e047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:14.792745 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d72d-5309-45e5-bfcf-1c997c07e047 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:14.793033 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d72d-5309-45e5-bfcf-1c997c07e047 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:14.793313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d72d-5309-45e5-bfcf-1c997c07e047 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:14.805873 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135d72d-5309-45e5-bfcf-1c997c07e047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-6135d72d-5309-45e5-bfcf-1c997c07e047 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:14.815519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:14.816742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:14.817717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 432/873] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:43:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:14.823382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b69b0b-c401-476e-8c8f-caa1dc425363 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:14.928341 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b69b0b-c401-476e-8c8f-caa1dc425363 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:14.965878 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a821bc5-838f-49cd-a2b2-cf642d0a0225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:14.966975 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821bc5-838f-49cd-a2b2-cf642d0a0225 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:14.967487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821bc5-838f-49cd-a2b2-cf642d0a0225 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:14.968011 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821bc5-838f-49cd-a2b2-cf642d0a0225 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:14.969576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a821bc5-838f-49cd-a2b2-cf642d0a0225 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:14.970113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a821bc5-838f-49cd-a2b2-cf642d0a0225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:14.971698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a821bc5-838f-49cd-a2b2-cf642d0a0225 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:14.981366 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 442/874] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:43:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:14.991811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d72d-5309-45e5-bfcf-1c997c07e047 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:15.005333 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4771f6-007d-45f2-a4b4-af82146f4775 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:15.005631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4771f6-007d-45f2-a4b4-af82146f4775 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:15.005914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4771f6-007d-45f2-a4b4-af82146f4775 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:15.007525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 443/875] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:15.012376 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2a4d-df52-404d-96b2-04c9d1b94fbf None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:15.012671 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2a4d-df52-404d-96b2-04c9d1b94fbf None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:15.012960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd2a4d-df52-404d-96b2-04c9d1b94fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:15.031070 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-ddfd2a4d-df52-404d-96b2-04c9d1b94fbf None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:15.033322 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-ddfd2a4d-df52-404d-96b2-04c9d1b94fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:15.103290 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d72d-5309-45e5-bfcf-1c997c07e047 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:15.104698 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 444/876] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:15.128086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd2a4d-df52-404d-96b2-04c9d1b94fbf None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:15.144440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:15.146013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:15.146512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:15.147000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:15.162427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:15.164235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:15.190173 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:15.191241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:15.193080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:15.193080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:15.193080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:15.193080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:15.193080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 433/877] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:15.199586 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:15.246431 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd2a4d-df52-404d-96b2-04c9d1b94fbf None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:15.282164 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ec8d0-3772-4713-9e88-d3bd34d5b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:15.282839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ec8d0-3772-4713-9e88-d3bd34d5b8d6 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:15.283124 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ec8d0-3772-4713-9e88-d3bd34d5b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:15.283407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ec8d0-3772-4713-9e88-d3bd34d5b8d6 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:15.284170 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ec8d0-3772-4713-9e88-d3bd34d5b8d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:15.285557 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ec8d0-3772-4713-9e88-d3bd34d5b8d6 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:15.306130 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 445/878] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:43:15 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:43:15.325108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08336e83-ab1a-4354-818e-f339c3c63d73 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:15.372308 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:15.373429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:15.373944 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:15.374446 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:15.376425 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:15.377032 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:15.378754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:15.397636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 434/879] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:15.400579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ec8d0-3772-4713-9e88-d3bd34d5b8d6 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:15.514028 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ec8d0-3772-4713-9e88-d3bd34d5b8d6 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:15.552679 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:15.553505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:15.553791 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:15.554069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:15.563666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:15.565192 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:15.582851 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:15.584089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:15.585202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 446/880] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:43:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:15.590262 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:15.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351b82-fa89-4734-b1bd-9c575f4d6b88 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:15.729612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3da0d-8e55-4e5e-88b6-50f161187009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:15.730708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3da0d-8e55-4e5e-88b6-50f161187009 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:15.731223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3da0d-8e55-4e5e-88b6-50f161187009 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:15.731874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3da0d-8e55-4e5e-88b6-50f161187009 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:15.732974 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3da0d-8e55-4e5e-88b6-50f161187009 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:15.733500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3da0d-8e55-4e5e-88b6-50f161187009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:15.735776 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3da0d-8e55-4e5e-88b6-50f161187009 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:15.754656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 435/881] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:43:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:15.760211 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:15.874416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d2e44-be95-4513-a118-07b38df7c84d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:15.910031 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822bd30-eaa5-4b10-a537-84695bbe3bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:15.911081 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822bd30-eaa5-4b10-a537-84695bbe3bc3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:15.911604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822bd30-eaa5-4b10-a537-84695bbe3bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:15.912139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822bd30-eaa5-4b10-a537-84695bbe3bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:15.989440 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822bd30-eaa5-4b10-a537-84695bbe3bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:15.991291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822bd30-eaa5-4b10-a537-84695bbe3bc3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.044031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb68bb-828e-4a98-910f-2f924119fe8b None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.044031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb68bb-828e-4a98-910f-2f924119fe8b None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.044347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb68bb-828e-4a98-910f-2f924119fe8b None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.045934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 436/882] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:16.052383 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb22a0-b82b-48cc-ac37-403980799533 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.052763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb22a0-b82b-48cc-ac37-403980799533 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.052954 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb22a0-b82b-48cc-ac37-403980799533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.070416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-aebb22a0-b82b-48cc-ac37-403980799533 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:16.071600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-aebb22a0-b82b-48cc-ac37-403980799533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:16.104416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 447/883] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:15 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:43:16.112845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822bd30-eaa5-4b10-a537-84695bbe3bc3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:16.148120 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 437/884] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:16.155692 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a721ac-a0f5-4e3f-bc40-12bad72b59d6 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.156012 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a721ac-a0f5-4e3f-bc40-12bad72b59d6 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.156322 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a721ac-a0f5-4e3f-bc40-12bad72b59d6 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.162874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 438/885] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:16.164138 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdce96a-fb09-4490-8a2c-34a9b5d1390d None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.164435 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdce96a-fb09-4490-8a2c-34a9b5d1390d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.164715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdce96a-fb09-4490-8a2c-34a9b5d1390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.184227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-8bdce96a-fb09-4490-8a2c-34a9b5d1390d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:16.185412 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-8bdce96a-fb09-4490-8a2c-34a9b5d1390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:16.224178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822bd30-eaa5-4b10-a537-84695bbe3bc3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:16.251327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 439/886] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:16.256993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdce96a-fb09-4490-8a2c-34a9b5d1390d None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:16.258634 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:16.259512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.259899 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.260252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.275667 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:16.277737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:16.301940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:16.303071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:16.304104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:16.304104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:16.304104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:16.304104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:16.304104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 448/887] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:16.305197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:16.366451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdce96a-fb09-4490-8a2c-34a9b5d1390d None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:16.400010 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32237a50-c80c-4a7a-b877-e6586e505049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:16.400671 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237a50-c80c-4a7a-b877-e6586e505049 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.400956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237a50-c80c-4a7a-b877-e6586e505049 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.401237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237a50-c80c-4a7a-b877-e6586e505049 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.401955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32237a50-c80c-4a7a-b877-e6586e505049 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:16.402398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f7c8a-0cc3-4786-b55d-9618277dea0d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:16.403312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32237a50-c80c-4a7a-b877-e6586e505049 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.419818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 440/888] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:43:16 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:16.419818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32237a50-c80c-4a7a-b877-e6586e505049 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:16.461408 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:16.462737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.463593 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.464368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.465234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:16.467934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:16.485147 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:16.486725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:16.487934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:16.491460 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 449/889] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:16.498042 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:16.549510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32237a50-c80c-4a7a-b877-e6586e505049 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:16.589671 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:16.590372 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.590940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.590940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.591673 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:16.592021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:16.593704 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.612449 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 441/890] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:16.613813 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:16.619815 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f48b2-df84-4748-9c6d-5946c5afde32 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:16.678050 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:16.678731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.679016 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.679294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.680086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:16.680395 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:16.681780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.693127 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 450/891] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:16.699421 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:16.742124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbf8cf-5035-4be9-963c-8b7226b9223d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:16.777348 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:16.778488 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.778488 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.778699 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.786466 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:16.788000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:16.802705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:16.803698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:16.804726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 442/892] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:16.809714 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:16.823028 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baba59-d815-42c6-9d84-a240abd1aa9c None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:16.865132 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:16.865958 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.866247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.866526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.867240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:16.867551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:16.869505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.878453 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 451/893] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:16.934710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5db355-9c4c-491e-99d3-54a223a97cc6 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:16.974988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97133ba5-6d97-4a78-ac7c-4a71579bfa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:16.975679 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97133ba5-6d97-4a78-ac7c-4a71579bfa31 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:16.976039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97133ba5-6d97-4a78-ac7c-4a71579bfa31 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:16.976319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97133ba5-6d97-4a78-ac7c-4a71579bfa31 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:16.977194 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97133ba5-6d97-4a78-ac7c-4a71579bfa31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:16.977508 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97133ba5-6d97-4a78-ac7c-4a71579bfa31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:16.978991 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97133ba5-6d97-4a78-ac7c-4a71579bfa31 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:16.993385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 443/894] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:16.999600 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:17.110276 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6916e7-5dab-4892-b0d1-790c11cc6e78 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:17.145911 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725c518-e75a-4493-9a38-92a49c780ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:17.146991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c518-e75a-4493-9a38-92a49c780ed0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:17.147509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c518-e75a-4493-9a38-92a49c780ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:17.148066 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725c518-e75a-4493-9a38-92a49c780ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:17.149139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c518-e75a-4493-9a38-92a49c780ed0 None admin] RBAC: Adding query filter params (role.id=c20278094aa143f3af7382f504c8116d, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=6226dd06a9d84bd0ac02077d29f9c7a2) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:17.149689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c518-e75a-4493-9a38-92a49c780ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:17.151359 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725c518-e75a-4493-9a38-92a49c780ed0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:17.158294 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 452/895] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:16 2022] GET /identity/v3/role_assignments?user.id=6226dd06a9d84bd0ac02077d29f9c7a2&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=c20278094aa143f3af7382f504c8116d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:17.752334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740bc7-d035-4aea-88ca-f1b41b95357d None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:17.752895 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740bc7-d035-4aea-88ca-f1b41b95357d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:17.752984 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09740bc7-d035-4aea-88ca-f1b41b95357d None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:17.754710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 444/896] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:17.760279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c82a2-022f-417e-b7fd-f6aef404ee9c None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:17.760738 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c82a2-022f-417e-b7fd-f6aef404ee9c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:17.760834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c82a2-022f-417e-b7fd-f6aef404ee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:17.778600 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-445c82a2-022f-417e-b7fd-f6aef404ee9c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:17.780203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-445c82a2-022f-417e-b7fd-f6aef404ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:17.850536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 453/897] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:17.873627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09740bc7-d035-4aea-88ca-f1b41b95357d None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:17.980919 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09740bc7-d035-4aea-88ca-f1b41b95357d None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:18.016995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:18.017724 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:18.018012 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:18.018289 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:18.018947 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:18.020341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:18.033065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:18.034288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:18.035924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 445/898] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:18.040578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c82a2-022f-417e-b7fd-f6aef404ee9c None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:18.143722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c82a2-022f-417e-b7fd-f6aef404ee9c None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:18.180160 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:18.180840 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:18.181127 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:18.181406 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:18.182122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:18.182432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:18.183826 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:18.189617 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 454/899] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:18.195334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:18.303689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb341c-117b-4a57-b82a-8b867776425d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:18.341275 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:18.342315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:18.342848 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:18.343348 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:18.344502 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:18.345039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:18.346618 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:18.352508 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 446/900] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:18.358626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:18.462802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbd6e8-7ec3-4a5f-8ed9-f7cd64d380d6 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:18.497936 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d5a18-9dc9-4621-b779-6e4ada317b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:18.498605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5a18-9dc9-4621-b779-6e4ada317b8a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:18.498895 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5a18-9dc9-4621-b779-6e4ada317b8a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:18.499175 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d5a18-9dc9-4621-b779-6e4ada317b8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:18.500540 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d5a18-9dc9-4621-b779-6e4ada317b8a None admin] RBAC: Adding query filter params (interface=public, service_id=c0a7e6d5e354435691a8075717c65159, region_id=RegionOne) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:18.501291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d5a18-9dc9-4621-b779-6e4ada317b8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:18.502358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d5a18-9dc9-4621-b779-6e4ada317b8a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:18.507979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 455/901] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:43:18 2022] GET /identity/v3/endpoints?service_id=c0a7e6d5e354435691a8075717c65159&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:18.514259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:18.621914 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338909e4-92ad-4c70-abe2-f6ab2af49064 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:18.659511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b8ee-5651-4fbf-bb58-4f7032010ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:18.660700 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b8ee-5651-4fbf-bb58-4f7032010ca9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:18.661234 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b8ee-5651-4fbf-bb58-4f7032010ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:18.661735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b8ee-5651-4fbf-bb58-4f7032010ca9 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:18.662975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1b8ee-5651-4fbf-bb58-4f7032010ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:18.664724 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1b8ee-5651-4fbf-bb58-4f7032010ca9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:18.671740 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 447/902] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:43:18 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:43:18.860467 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e6512-0bd9-4e11-a0f3-7d263bd3f391 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:18.861548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e6512-0bd9-4e11-a0f3-7d263bd3f391 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:18.862051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e6512-0bd9-4e11-a0f3-7d263bd3f391 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:18.864177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 456/903] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:18.869355 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bcc6-e8af-4a21-90a1-46a18955586f None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:18.870189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bcc6-e8af-4a21-90a1-46a18955586f None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:18.870692 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bcc6-e8af-4a21-90a1-46a18955586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:18.888788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-e5e5bcc6-e8af-4a21-90a1-46a18955586f None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:18.890315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-e5e5bcc6-e8af-4a21-90a1-46a18955586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:18.963121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 448/904] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:18.986873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e6512-0bd9-4e11-a0f3-7d263bd3f391 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:19.099208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e6512-0bd9-4e11-a0f3-7d263bd3f391 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:19.134669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb5051-ded0-45d0-aae1-55aa49711010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:19.135497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb5051-ded0-45d0-aae1-55aa49711010 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.135792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb5051-ded0-45d0-aae1-55aa49711010 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.136076 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb5051-ded0-45d0-aae1-55aa49711010 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.136733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb5051-ded0-45d0-aae1-55aa49711010 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:19.138106 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb5051-ded0-45d0-aae1-55aa49711010 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-10cb5051-ded0-45d0-aae1-55aa49711010 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:19.150582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:19.151624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:19.154706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 457/905] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:43:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:19.158927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bcc6-e8af-4a21-90a1-46a18955586f None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:19.216981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc009-e495-4cbc-8992-12e65eb329bf None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.217371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc009-e495-4cbc-8992-12e65eb329bf None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.217724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc009-e495-4cbc-8992-12e65eb329bf None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.220069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 458/906] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:19.225068 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5933-01bd-48c4-a120-492d8ac13d5f None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.225443 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5933-01bd-48c4-a120-492d8ac13d5f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.225804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5933-01bd-48c4-a120-492d8ac13d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.245048 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-dafc5933-01bd-48c4-a120-492d8ac13d5f None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:19.246537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-dafc5933-01bd-48c4-a120-492d8ac13d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:19.267314 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bcc6-e8af-4a21-90a1-46a18955586f None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:19.322370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:19.323390 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.323686 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.324003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.325371 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:19.325698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:19.327470 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:19.330859 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 459/907] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:19.338500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 449/908] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:19.339660 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc5933-01bd-48c4-a120-492d8ac13d5f None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:19.356306 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:19.459171 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc5933-01bd-48c4-a120-492d8ac13d5f None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:19.474818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9254ee3-229d-4d3a-bf96-5708132e49ff None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:19.497640 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:19.498407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.498621 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.498875 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.499592 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:19.499955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:19.501360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:19.511251 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 460/909] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:19.513305 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:19.519519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94454400-fc42-4d2b-90de-8539d4e0382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:19.520235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454400-fc42-4d2b-90de-8539d4e0382f None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.520524 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454400-fc42-4d2b-90de-8539d4e0382f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.520806 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94454400-fc42-4d2b-90de-8539d4e0382f None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.521549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94454400-fc42-4d2b-90de-8539d4e0382f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:19.522924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94454400-fc42-4d2b-90de-8539d4e0382f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:19.538508 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 450/910] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:43:19 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:43:19.540457 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc082-9fce-45b0-aeef-1049e655c5a4 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.541043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc082-9fce-45b0-aeef-1049e655c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.541616 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adc082-9fce-45b0-aeef-1049e655c5a4 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.543663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 451/911] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:19.549290 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f22e-4266-4305-a0b8-f7d3d1ce0aee None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.549946 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f22e-4266-4305-a0b8-f7d3d1ce0aee None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.550501 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f22e-4266-4305-a0b8-f7d3d1ce0aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.571156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-1c57f22e-4266-4305-a0b8-f7d3d1ce0aee None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:19.573007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-1c57f22e-4266-4305-a0b8-f7d3d1ce0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:19.636804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc1bf-2c3b-4393-9d69-5950b8070f6d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:19.667930 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 452/912] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:19.691694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:19.692416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.692708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.692992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.693812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] RBAC: Adding query filter params (interface=public, service_id=5280c6c2312140c08eea9115387c614f, region_id=RegionOne) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:19.694131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:19.695671 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:19.697117 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f22e-4266-4305-a0b8-f7d3d1ce0aee None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:19.707749 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 461/913] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:43:19 2022] GET /identity/v3/endpoints?service_id=5280c6c2312140c08eea9115387c614f&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:19.714153 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:19.817458 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f22e-4266-4305-a0b8-f7d3d1ce0aee None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:19.835582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf57732-0cbf-47ca-890b-86283cab1baa None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:19.864245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd80c6-cca8-4cbc-a7ec-1572727c8175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:19.866099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd80c6-cca8-4cbc-a7ec-1572727c8175 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.866626 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd80c6-cca8-4cbc-a7ec-1572727c8175 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.867284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd80c6-cca8-4cbc-a7ec-1572727c8175 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.878689 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677afd7b-cb27-4240-a349-d1008a5b6231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:19.879371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677afd7b-cb27-4240-a349-d1008a5b6231 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:19.879658 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677afd7b-cb27-4240-a349-d1008a5b6231 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:19.879967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677afd7b-cb27-4240-a349-d1008a5b6231 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:19.880659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677afd7b-cb27-4240-a349-d1008a5b6231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:19.882093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd80c6-cca8-4cbc-a7ec-1572727c8175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:19.882496 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677afd7b-cb27-4240-a349-d1008a5b6231 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-20dd80c6-cca8-4cbc-a7ec-1572727c8175 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:19.892771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:19.893898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:19.894840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:19.896127 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 462/914] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:43:19 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:43:19.898125 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 453/915] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:43:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:19.907605 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677afd7b-cb27-4240-a349-d1008a5b6231 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:20.025665 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677afd7b-cb27-4240-a349-d1008a5b6231 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:20.066297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:20.067532 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:20.068084 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:20.068595 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:20.069587 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:20.070125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:20.071841 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:20.082289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 463/916] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:43:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:20.088654 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd80c6-cca8-4cbc-a7ec-1572727c8175 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:20.199982 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd80c6-cca8-4cbc-a7ec-1572727c8175 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:20.236242 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:20.237449 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:20.237954 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:20.238448 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:20.249725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:20.252152 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:20.269967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:20.270985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:20.272524 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:20.272524 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:20.272524 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:20.272524 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:20.274505 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 454/917] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:20.284700 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:20.387327 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa200e-1504-4df0-9fc5-fcf350fff526 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:20.423445 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:20.424522 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:20.425028 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:20.425637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:20.426579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:20.427105 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:20.428741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:20.441973 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 464/918] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:20.448872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:20.551657 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaacc8b-fc70-42ea-9fe2-77d39a4588b4 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:20.594100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:20.594929 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:20.595215 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:20.595551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:20.603517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:20.605001 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:20.619998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:20.621088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:20.622543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 455/919] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:43:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:20.627888 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:20.734112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aed043-d428-4de8-8f34-986bdec2406f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:20.772254 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:20.773313 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:20.773934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:20.774440 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:20.775518 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:20.776090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:20.777776 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:20.798019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 465/920] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:43:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:20.803701 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:20.908694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9957b-7771-42d1-8ba3-8c0cbafd6752 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:20.948838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdc4ba-d2c6-4bfe-b274-b4fb31ee0c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:20.950043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdc4ba-d2c6-4bfe-b274-b4fb31ee0c97 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:20.950565 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdc4ba-d2c6-4bfe-b274-b4fb31ee0c97 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:20.951061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdc4ba-d2c6-4bfe-b274-b4fb31ee0c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:20.964305 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdc4ba-d2c6-4bfe-b274-b4fb31ee0c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:20.966373 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdc4ba-d2c6-4bfe-b274-b4fb31ee0c97 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-22cdc4ba-d2c6-4bfe-b274-b4fb31ee0c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:20.984865 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:20.985906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:20.986962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:20.986962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:20.986962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:20.986962 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:20.989530 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 456/921] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:20.996945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:21.101637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95d5bd-ad1f-4e36-b910-7e3e3787cd21 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:21.113408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863ad6a-efab-44d2-a508-c872af349d0d None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.113706 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863ad6a-efab-44d2-a508-c872af349d0d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.113976 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863ad6a-efab-44d2-a508-c872af349d0d None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.115476 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 457/922] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:21.120703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4145e6-a250-4600-acfd-2cb2721dd46e None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.121252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4145e6-a250-4600-acfd-2cb2721dd46e None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.121742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4145e6-a250-4600-acfd-2cb2721dd46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.139523 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-8f4145e6-a250-4600-acfd-2cb2721dd46e None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:21.141676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-8f4145e6-a250-4600-acfd-2cb2721dd46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:21.143438 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:21.144333 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.144628 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.144910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.146451 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:21.146774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:21.148199 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:21.163700 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 466/923] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:21.173730 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:21.247785 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 458/924] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:21.261911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4145e6-a250-4600-acfd-2cb2721dd46e None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:21.299197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473c91-b33f-4c76-b9c9-9627ac2b66b3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:21.342724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:21.344932 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.345701 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.346206 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.361141 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:21.363061 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:21.379126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4145e6-a250-4600-acfd-2cb2721dd46e None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:21.383033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:21.384063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:21.385052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:21.385052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:21.385052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:21.385052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:21.385052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:21.385052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:21.385052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:21.385052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:21.388013 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 467/925] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:21.395813 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:21.418777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:21.419703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.420108 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.420460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.421260 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:21.424356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:21.440975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:21.442388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:43:21.443526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:21.444496 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 459/926] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:21.452614 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:21.528344 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06775435-5c99-4d60-95d5-19e867411054 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:21.562224 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8f717-c7ac-4ec3-84f2-5d8036e4cff0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:21.565172 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:21.566140 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.566661 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.567141 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.568173 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:21.568724 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:21.570372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:21.582692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 468/927] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:21.589239 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:21.605550 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:21.606764 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.607296 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.608176 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.608922 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:21.609288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:21.610816 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:21.618768 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 460/928] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:21.632753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:21.704725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bb01-f112-4742-881b-f35f5e612ac1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:21.740374 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e18b9-efa1-4497-8c3a-940e263f7687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:21.741148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e18b9-efa1-4497-8c3a-940e263f7687 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.741432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e18b9-efa1-4497-8c3a-940e263f7687 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.741711 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e18b9-efa1-4497-8c3a-940e263f7687 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/6226dd06a9d84bd0ac02077d29f9c7a2/roles/c20278094aa143f3af7382f504c8116d` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.744435 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e18b9-efa1-4497-8c3a-940e263f7687 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=6226dd06a9d84bd0ac02077d29f9c7a2, role_id=c20278094aa143f3af7382f504c8116d)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:21.745801 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e18b9-efa1-4497-8c3a-940e263f7687 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:21.757177 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88c904-9fb6-41f8-a29d-0cbf0ac44730 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:21.763353 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 469/929] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:43:21 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/6226dd06a9d84bd0ac02077d29f9c7a2/roles/c20278094aa143f3af7382f504c8116d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:43:21.805410 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5b821-3548-414e-9a08-46251d35a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:21.806442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b821-3548-414e-9a08-46251d35a531 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.806945 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b821-3548-414e-9a08-46251d35a531 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.807412 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5b821-3548-414e-9a08-46251d35a531 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.808510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5b821-3548-414e-9a08-46251d35a531 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:21.809025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5b821-3548-414e-9a08-46251d35a531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:21.810703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5b821-3548-414e-9a08-46251d35a531 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:21.817874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 461/930] 10.222.0.32 () {56 vars in 1114 bytes} [Mon May 9 15:43:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:21.824634 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e18b9-efa1-4497-8c3a-940e263f7687 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:21.939046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e18b9-efa1-4497-8c3a-940e263f7687 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:21.979686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9a2e-9e96-4006-a3f7-bf9cfa21f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:21.980383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9a2e-9e96-4006-a3f7-bf9cfa21f6ca None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.980854 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9a2e-9e96-4006-a3f7-bf9cfa21f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.981064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9a2e-9e96-4006-a3f7-bf9cfa21f6ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.981772 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9a2e-9e96-4006-a3f7-bf9cfa21f6ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:21.983158 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9a2e-9e96-4006-a3f7-bf9cfa21f6ca None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:21.993101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6706c-98f5-40fa-9710-d114b70e0154 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:21.993619 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6706c-98f5-40fa-9710-d114b70e0154 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:21.993619 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6706c-98f5-40fa-9710-d114b70e0154 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:21.995267 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 462/931] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:22.001890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884aa2-186d-4e2d-b527-5327a3e2f4b1 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.002285 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884aa2-186d-4e2d-b527-5327a3e2f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.002573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884aa2-186d-4e2d-b527-5327a3e2f4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.008650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 470/932] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:43:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:22.020900 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-18884aa2-186d-4e2d-b527-5327a3e2f4b1 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:22.022133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-18884aa2-186d-4e2d-b527-5327a3e2f4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:22.114937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 463/933] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:22.138950 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9a2e-9e96-4006-a3f7-bf9cfa21f6ca None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:22.254190 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9a2e-9e96-4006-a3f7-bf9cfa21f6ca None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:22.289060 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f146788-9110-457e-b2ae-25ab349dbb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:22.289886 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f146788-9110-457e-b2ae-25ab349dbb76 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.290183 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f146788-9110-457e-b2ae-25ab349dbb76 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.290455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f146788-9110-457e-b2ae-25ab349dbb76 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.291126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f146788-9110-457e-b2ae-25ab349dbb76 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:22.292606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f146788-9110-457e-b2ae-25ab349dbb76 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-2f146788-9110-457e-b2ae-25ab349dbb76 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:22.305407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:22.306583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:22.307548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 471/934] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:22.313829 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18884aa2-186d-4e2d-b527-5327a3e2f4b1 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:22.397844 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a0d1-8e86-4187-aff8-28125ff23f0c None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.398207 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a0d1-8e86-4187-aff8-28125ff23f0c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.398412 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a0d1-8e86-4187-aff8-28125ff23f0c None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.400082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 472/935] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:22.411152 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41774e-5ddb-4866-9efb-56971048d712 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.411733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41774e-5ddb-4866-9efb-56971048d712 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.412283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41774e-5ddb-4866-9efb-56971048d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.433569 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-5e41774e-5ddb-4866-9efb-56971048d712 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:22.434782 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-5e41774e-5ddb-4866-9efb-56971048d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:22.454827 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18884aa2-186d-4e2d-b527-5327a3e2f4b1 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:22.504090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:22.505027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.505027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.505332 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.506035 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:22.506416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:22.507719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:22.517941 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 464/937] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:22.518301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 473/937] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:22.519360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:22.541480 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41774e-5ddb-4866-9efb-56971048d712 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:22.623133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28920f-a7c2-4c67-869b-7cc1d457d0f5 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:22.659097 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:22.660110 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.660610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.661056 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.662020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:22.662652 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:22.664312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:22.674450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41774e-5ddb-4866-9efb-56971048d712 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:22.675235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 465/938] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:22.676384 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:22.710072 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:22.711325 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.711887 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.712406 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.713335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:22.714937 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:22.728504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:22.729608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:43:22.730578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:22.733643 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 474/939] 10.222.0.32 () {56 vars in 1132 bytes} [Mon May 9 15:43:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:22.747447 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:22.799620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d00b3-4089-4219-b475-99e71fdd44b9 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:22.834683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:22.835505 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.836031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.836408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.837293 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] RBAC: Adding query filter params (interface=public, service_id=04cb751a95c648e691099eb9fdc9bc15, region_id=RegionOne) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:22.837689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:22.839127 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:22.845924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 466/940] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:43:22 2022] GET /identity/v3/endpoints?service_id=04cb751a95c648e691099eb9fdc9bc15&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:22.851235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:22.872242 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b2fa4-e2d1-41c7-b6ff-e38aac618d33 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:22.913283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:22.914704 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:22.915223 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:22.915694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:22.916627 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:22.917146 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:22.919483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:22.927298 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 475/941] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:22.932923 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:22.973513 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8d8d-8a5a-4f68-baee-732aa51c4bc5 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:23.009612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f4b8-6870-40de-a571-89a130ed5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:23.011115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f4b8-6870-40de-a571-89a130ed5905 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:23.011642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f4b8-6870-40de-a571-89a130ed5905 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:23.012183 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f4b8-6870-40de-a571-89a130ed5905 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:23.013094 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f4b8-6870-40de-a571-89a130ed5905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:23.014697 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f4b8-6870-40de-a571-89a130ed5905 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:23.021975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 467/942] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:43:22 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:43:23.038004 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ef264-91cb-4b0d-83c5-0d083204ed35 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:23.077153 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6964b94-21fa-4f8a-abb5-15f72dd0554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:23.077762 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964b94-21fa-4f8a-abb5-15f72dd0554b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:23.078112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964b94-21fa-4f8a-abb5-15f72dd0554b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:23.078563 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6964b94-21fa-4f8a-abb5-15f72dd0554b None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:23.079312 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6964b94-21fa-4f8a-abb5-15f72dd0554b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:23.079630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6964b94-21fa-4f8a-abb5-15f72dd0554b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:23.081125 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6964b94-21fa-4f8a-abb5-15f72dd0554b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:23.092398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 476/943] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:23.094312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f4b8-6870-40de-a571-89a130ed5905 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:23.211484 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f4b8-6870-40de-a571-89a130ed5905 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:23.247733 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eec03e-197a-44d7-9089-67d80417531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:23.248430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eec03e-197a-44d7-9089-67d80417531b None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:23.248717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eec03e-197a-44d7-9089-67d80417531b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:23.248996 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eec03e-197a-44d7-9089-67d80417531b None admin] PATH_INFO: `/v3/endpoints` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:23.249868 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eec03e-197a-44d7-9089-67d80417531b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:23.251369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eec03e-197a-44d7-9089-67d80417531b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:23.279243 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 468/944] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:43:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:24.323880 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4ceac-3fdc-4c34-a2fe-9fc6842d3841 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:24.324434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4ceac-3fdc-4c34-a2fe-9fc6842d3841 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:24.324434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4ceac-3fdc-4c34-a2fe-9fc6842d3841 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:24.325960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 477/945] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:24.332124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f69ac-d0ec-4815-a7e5-9e3540a125fa None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:24.332957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f69ac-d0ec-4815-a7e5-9e3540a125fa None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:24.333480 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f69ac-d0ec-4815-a7e5-9e3540a125fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:24.351890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-e10f69ac-d0ec-4815-a7e5-9e3540a125fa None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:24.353433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-e10f69ac-d0ec-4815-a7e5-9e3540a125fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:24.435716 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 469/946] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:24.460831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4ceac-3fdc-4c34-a2fe-9fc6842d3841 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:24.571252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4ceac-3fdc-4c34-a2fe-9fc6842d3841 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:24.579300 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a6a6-d731-4dba-90cf-0135d7ac2bcf None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:24.579615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a6a6-d731-4dba-90cf-0135d7ac2bcf None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:24.580275 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a6a6-d731-4dba-90cf-0135d7ac2bcf None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:24.581560 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 470/947] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:24.586556 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398e8ce-0255-4339-8fe9-c63ef855eead None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:24.586856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398e8ce-0255-4339-8fe9-c63ef855eead None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:24.587142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398e8ce-0255-4339-8fe9-c63ef855eead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:24.606388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-4398e8ce-0255-4339-8fe9-c63ef855eead None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:24.607607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-4398e8ce-0255-4339-8fe9-c63ef855eead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:24.614144 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77e5cb-e288-4b05-a595-e7ec308f1cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:24.615274 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e5cb-e288-4b05-a595-e7ec308f1cb8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:24.615795 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e5cb-e288-4b05-a595-e7ec308f1cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:24.616299 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e5cb-e288-4b05-a595-e7ec308f1cb8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:24.631509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77e5cb-e288-4b05-a595-e7ec308f1cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-3a77e5cb-e288-4b05-a595-e7ec308f1cb8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:24.643856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:24.644919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:24.645857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:24.649625 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 478/948] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:43:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:24.657562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77e5cb-e288-4b05-a595-e7ec308f1cb8 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:24.683737 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 471/949] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:24.708670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398e8ce-0255-4339-8fe9-c63ef855eead None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:24.783057 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77e5cb-e288-4b05-a595-e7ec308f1cb8 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:24.829304 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398e8ce-0255-4339-8fe9-c63ef855eead None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:24.830186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:24.831307 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:24.832627 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:24.833149 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:24.834134 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:24.834657 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:24.836286 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:24.852130 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 479/950] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:43:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:24.853830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:24.873073 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:24.873675 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:24.873931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:24.874212 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:24.875660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:24.877027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:24.878544 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: WARNING keystone.server.flask.common [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:43:24.897281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.sql.core [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:43:24.897281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:43:24.897281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [parameters: {'id': 'cb69bee35fb44ea4a42930e00f7dbd4c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:43:24.897281 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=275843) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb69bee35fb44ea4a42930e00f7dbd4c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb69bee35fb44ea4a42930e00f7dbd4c. May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application conn.query(q) May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:43:24.920442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result.read() May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 15:43:24.921450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application next(self.gen) May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application yield resource May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application next(self.gen) May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise self.value May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application session.commit() May 09 15:43:24.923279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.session.flush() May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application compat.raise_( May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:43:24.924357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:43:24.925419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application conn.query(q) May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result.read() May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:43:24.926344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [parameters: {'id': 'cb69bee35fb44ea4a42930e00f7dbd4c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:24.929119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:24.931186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb69bee35fb44ea4a42930e00f7dbd4c. May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 472/951] 10.222.0.32 () {60 vars in 1140 bytes} [Mon May 9 15:43:24 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:24.935972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:24.992455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f0c5-215f-457e-be66-50e6b8695150 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.029964 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.032330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.032864 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.033354 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.044989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.046853 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.058465 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2fedb-5a96-4e20-9c24-cb74c54ba35c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:25.067208 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:25.068486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:25.069541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:25.069541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:25.069541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:25.069541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:25.076211 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 480/952] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:25.077441 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:25.100867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.101687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.101975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.102254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.111684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.114463 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:25.133441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:25.134584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:25.136030 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 473/953] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:25.140454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:25.204357 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3cc9d-57dd-4542-95ec-f5ad4dd90400 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.249492 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.251183 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.251449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.251736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.252525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:25.252839 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.254234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.268063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fca19a-432a-45a3-acc4-0a83afdff655 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.274221 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 481/954] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:25.276750 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:25.313213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97f2b-59a4-4eed-bee4-fcc536f58b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.314069 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97f2b-59a4-4eed-bee4-fcc536f58b23 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.314361 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97f2b-59a4-4eed-bee4-fcc536f58b23 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.314639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97f2b-59a4-4eed-bee4-fcc536f58b23 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.315473 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97f2b-59a4-4eed-bee4-fcc536f58b23 None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:25.316271 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97f2b-59a4-4eed-bee4-fcc536f58b23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.318581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97f2b-59a4-4eed-bee4-fcc536f58b23 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.345306 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 474/955] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:25.368931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc5a84-e777-4973-aa88-02f027b7590d None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.369297 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc5a84-e777-4973-aa88-02f027b7590d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.369496 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc5a84-e777-4973-aa88-02f027b7590d None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.371247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 475/956] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:25.378114 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9a57-8ae4-47d5-97f2-11cfd843dc77 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.378811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9a57-8ae4-47d5-97f2-11cfd843dc77 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.378811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9a57-8ae4-47d5-97f2-11cfd843dc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.396353 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddd615-9bd8-4563-8117-a494eecc4944 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.396942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-856f9a57-8ae4-47d5-97f2-11cfd843dc77 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:25.398026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-856f9a57-8ae4-47d5-97f2-11cfd843dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:25.439665 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.440683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.441040 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.441334 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.450460 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.451993 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:25.472233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:25.473456 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:43:25.474622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:25.478421 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 482/957] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:43:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:25.479529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:25.488219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 476/958] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:25.506472 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f9a57-8ae4-47d5-97f2-11cfd843dc77 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:25.594914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372b3ce-fa93-4872-b67f-e85f6554da39 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.633219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f9a57-8ae4-47d5-97f2-11cfd843dc77 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.634241 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5a74f-885c-4f32-9d97-a5c88ecb3023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.634930 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5a74f-885c-4f32-9d97-a5c88ecb3023 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.635990 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5a74f-885c-4f32-9d97-a5c88ecb3023 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.635990 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5a74f-885c-4f32-9d97-a5c88ecb3023 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.636369 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5a74f-885c-4f32-9d97-a5c88ecb3023 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:25.636681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5a74f-885c-4f32-9d97-a5c88ecb3023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.638129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5a74f-885c-4f32-9d97-a5c88ecb3023 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.659239 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 483/959] 10.222.0.32 () {56 vars in 1149 bytes} [Mon May 9 15:43:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:25.660859 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e0403-0042-4649-bb99-e330d9d362d6 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.660859 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e0403-0042-4649-bb99-e330d9d362d6 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.661177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e0403-0042-4649-bb99-e330d9d362d6 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.662363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 484/960] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:25.666955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e0403-0042-4649-bb99-e330d9d362d6 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:25.674943 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9d2a0-d019-4146-962e-5a5020f5ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.675896 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d2a0-d019-4146-962e-5a5020f5ffde None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.676252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d2a0-d019-4146-962e-5a5020f5ffde None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.676604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d2a0-d019-4146-962e-5a5020f5ffde None admin] PATH_INFO: `/v3/services/object-store` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.677345 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9d2a0-d019-4146-962e-5a5020f5ffde None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.678791 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9d2a0-d019-4146-962e-5a5020f5ffde None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-a2f9d2a0-d019-4146-962e-5a5020f5ffde None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:25.691058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:25.692394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:25.693400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 477/961] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:25.695399 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6977633-a0ab-4670-bba2-2a49188a2034 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.695946 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6977633-a0ab-4670-bba2-2a49188a2034 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.696465 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6977633-a0ab-4670-bba2-2a49188a2034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.714076 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-c6977633-a0ab-4670-bba2-2a49188a2034 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:25.715265 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-c6977633-a0ab-4670-bba2-2a49188a2034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:25.774274 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e0403-0042-4649-bb99-e330d9d362d6 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.784605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 478/962] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:25.785460 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6977633-a0ab-4670-bba2-2a49188a2034 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:25.823416 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7cc9-5ad3-49cc-862a-04888c16f10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.824126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7cc9-5ad3-49cc-862a-04888c16f10e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.824431 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7cc9-5ad3-49cc-862a-04888c16f10e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.824695 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7cc9-5ad3-49cc-862a-04888c16f10e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.889138 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6977633-a0ab-4670-bba2-2a49188a2034 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:25.892498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7cc9-5ad3-49cc-862a-04888c16f10e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.893967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7cc9-5ad3-49cc-862a-04888c16f10e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.930879 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:25.931556 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:25.932216 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:25.932216 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:25.932855 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:25.933245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:25.934587 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:25.943980 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 479/963] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:25.943980 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.008860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 485/964] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:25 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:43:26.008860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7cc9-5ad3-49cc-862a-04888c16f10e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.045590 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2002d89-d047-4c1e-b961-19454432b1dd None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.080981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.081786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.082065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.082334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] PATH_INFO: `/v3/services/compute` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.082993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.084387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:26.096788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:26.097995 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:26.099025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 480/965] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:26.100671 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.114001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7cc9-5ad3-49cc-862a-04888c16f10e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.148585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.149259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.149548 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.149829 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.150536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:26.151281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.152982 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.165252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 486/966] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:26.165252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.200398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3ffb0-ad29-48b7-aad7-8d0f9ffae66a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.234079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.234893 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.235227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.235504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.246128 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.247634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:26.265807 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:26.267090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:26.268531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:26.268531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:26.268531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:26.268531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:26.268531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 481/967] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:26.272730 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.274122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d8260-efcb-4aa6-a838-d8acf27333e0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.310225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.310823 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.311361 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.311647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.312450 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] RBAC: Adding query filter params (name=compute) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:26.312766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.314154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.323808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 487/968] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:26.323808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.377034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5729541-0734-4c60-89d4-48febed4da8d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.410189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67935b4-a1c1-43a5-a97f-510f227c4a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.410845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67935b4-a1c1-43a5-a97f-510f227c4a1b None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.411126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67935b4-a1c1-43a5-a97f-510f227c4a1b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.411399 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67935b4-a1c1-43a5-a97f-510f227c4a1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.412167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67935b4-a1c1-43a5-a97f-510f227c4a1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.413531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67935b4-a1c1-43a5-a97f-510f227c4a1b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.417325 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241d1e2-1e77-4b33-9500-553dfaebaf1b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.432545 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 482/969] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:43:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:26.433652 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67935b4-a1c1-43a5-a97f-510f227c4a1b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.462387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.463260 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.463555 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.463869 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.464614 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:26.464927 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.466367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.479576 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 488/970] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:26.486910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.556522 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67935b4-a1c1-43a5-a97f-510f227c4a1b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.594312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.595058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.595411 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.595778 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.596590 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] RBAC: Adding query filter params (type=compute) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:26.596975 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.598493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.600711 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783492d6-5c24-4ab0-a4d5-79566e4abdc4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.608299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 483/971] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:26.644734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.645634 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.645974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.646263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.654536 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.656715 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:26.674761 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:26.675910 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:26.677515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 489/972] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:26.682151 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.795485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbbcc0-cba6-4f9e-9921-b5d288b47f92 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:26.837689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad255d7-7315-428b-b20e-ec5e856a962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:26.838371 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad255d7-7315-428b-b20e-ec5e856a962b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:26.838656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad255d7-7315-428b-b20e-ec5e856a962b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:26.838931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad255d7-7315-428b-b20e-ec5e856a962b None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:26.839722 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad255d7-7315-428b-b20e-ec5e856a962b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:26.840251 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad255d7-7315-428b-b20e-ec5e856a962b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:26.841486 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad255d7-7315-428b-b20e-ec5e856a962b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:26.856183 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 484/973] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:26.862544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:26.969822 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae455-cd28-4082-9b51-2dd2dbb02d30 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:27.007139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7381b8-1731-4b9d-aacc-4d3718438b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:27.008226 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7381b8-1731-4b9d-aacc-4d3718438b70 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:27.008737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7381b8-1731-4b9d-aacc-4d3718438b70 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:27.009255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7381b8-1731-4b9d-aacc-4d3718438b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:27.010316 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7381b8-1731-4b9d-aacc-4d3718438b70 None admin] RBAC: Adding query filter params (role.id=c20278094aa143f3af7382f504c8116d, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=6226dd06a9d84bd0ac02077d29f9c7a2) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:27.011244 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7381b8-1731-4b9d-aacc-4d3718438b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:27.012989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7381b8-1731-4b9d-aacc-4d3718438b70 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:27.019856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 490/974] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:26 2022] GET /identity/v3/role_assignments?user.id=6226dd06a9d84bd0ac02077d29f9c7a2&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=c20278094aa143f3af7382f504c8116d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:27.806274 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40494-9060-4133-9a2f-12d9f6ce99d4 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:27.807326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40494-9060-4133-9a2f-12d9f6ce99d4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:27.807873 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc40494-9060-4133-9a2f-12d9f6ce99d4 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:27.809757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 485/975] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:27.816952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403efb5-6558-4b38-81f3-847041e38c21 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:27.817843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403efb5-6558-4b38-81f3-847041e38c21 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:27.818357 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403efb5-6558-4b38-81f3-847041e38c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:27.836497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-8403efb5-6558-4b38-81f3-847041e38c21 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:27.838071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-8403efb5-6558-4b38-81f3-847041e38c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:27.912959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 491/976] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:27.940259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc40494-9060-4133-9a2f-12d9f6ce99d4 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:28.047265 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc40494-9060-4133-9a2f-12d9f6ce99d4 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:28.083407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:28.084036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:28.084322 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:28.084600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:28.085295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:28.086724 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:28.102204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.sql.core [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:43:28.102204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:43:28.102204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [parameters: {'user_id': 'ad8998b565814eb79e061ef5f2871e30', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:43:28.102204 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=275843) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application conn.query(q) May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result.read() May 09 15:43:28.111053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:43:28.112113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application next(self.gen) May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application yield resource May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application next(self.gen) May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise self.value May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application session.commit() May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:43:28.113302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.session.flush() May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application compat.raise_( May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:43:28.114375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:43:28.115440 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application conn.query(q) May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application result.read() May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:43:28.118029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ad8998b565814eb79e061ef5f2871e30', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:28.124403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 15:43:28.126838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 15:43:28.129515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 15:43:28.129515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 15:43:28.129515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:43:28.129515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:43:28.129515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:43:28.129515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:28.129515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 486/977] 10.222.0.32 () {60 vars in 1131 bytes} [Mon May 9 15:43:27 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:28.133549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403efb5-6558-4b38-81f3-847041e38c21 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:28.246718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403efb5-6558-4b38-81f3-847041e38c21 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:28.283291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e25157-af7e-4bfe-a763-93d56fc1a45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:28.284638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25157-af7e-4bfe-a763-93d56fc1a45b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:28.285223 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25157-af7e-4bfe-a763-93d56fc1a45b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:28.285740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25157-af7e-4bfe-a763-93d56fc1a45b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:28.293746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e25157-af7e-4bfe-a763-93d56fc1a45b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:28.295504 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e25157-af7e-4bfe-a763-93d56fc1a45b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-f2e25157-af7e-4bfe-a763-93d56fc1a45b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:28.314437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:28.315672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:28.317058 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 492/978] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:43:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:28.320684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:28.429400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae383dd-aba4-4537-b5ca-92121110839c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:28.465652 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce232ae-ab55-4b72-9722-3dd6abf68a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:28.466335 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce232ae-ab55-4b72-9722-3dd6abf68a0f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:28.466623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce232ae-ab55-4b72-9722-3dd6abf68a0f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:28.466903 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce232ae-ab55-4b72-9722-3dd6abf68a0f None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:28.467716 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce232ae-ab55-4b72-9722-3dd6abf68a0f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:28.468055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce232ae-ab55-4b72-9722-3dd6abf68a0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:28.470422 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce232ae-ab55-4b72-9722-3dd6abf68a0f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:28.511343 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 487/979] 10.222.0.32 () {56 vars in 1101 bytes} [Mon May 9 15:43:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:28.853706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2aae-a09b-450a-85fc-2353d40f549c None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:28.854219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2aae-a09b-450a-85fc-2353d40f549c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:28.854219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c2aae-a09b-450a-85fc-2353d40f549c None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:28.855879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 493/980] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:28.861344 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade2969-b0ae-440b-82d0-99e3eae3736e None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:28.861764 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade2969-b0ae-440b-82d0-99e3eae3736e None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:28.861954 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade2969-b0ae-440b-82d0-99e3eae3736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:28.879219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-9ade2969-b0ae-440b-82d0-99e3eae3736e None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:28.880792 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-9ade2969-b0ae-440b-82d0-99e3eae3736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:28.947958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 488/981] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:28.970884 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c2aae-a09b-450a-85fc-2353d40f549c None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:28.989382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08936-6fb3-42b4-8e43-8b4c1da30710 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:28.989382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08936-6fb3-42b4-8e43-8b4c1da30710 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:28.989382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08936-6fb3-42b4-8e43-8b4c1da30710 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:28.990406 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 489/982] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:28.995758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ee8ce-84ae-49e6-9ea8-4e6da031b07a None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:28.996079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ee8ce-84ae-49e6-9ea8-4e6da031b07a None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:28.996366 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ee8ce-84ae-49e6-9ea8-4e6da031b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.013369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-e05ee8ce-84ae-49e6-9ea8-4e6da031b07a None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:29.014569 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-e05ee8ce-84ae-49e6-9ea8-4e6da031b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:29.077180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c2aae-a09b-450a-85fc-2353d40f549c None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:29.083069 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 490/983] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:29.106172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ee8ce-84ae-49e6-9ea8-4e6da031b07a None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:29.112896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:29.113714 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.114001 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.114281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.114947 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:29.116367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:29.128873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:29.130030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:29.131030 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 494/984] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:29.136197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:29.217806 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ee8ce-84ae-49e6-9ea8-4e6da031b07a None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:29.238056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f1a5-6f47-4840-96ad-249a497f2ae3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:29.251364 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7ee4-a2a3-49eb-8715-72bb40679604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:29.252291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7ee4-a2a3-49eb-8715-72bb40679604 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.252586 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7ee4-a2a3-49eb-8715-72bb40679604 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.252856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7ee4-a2a3-49eb-8715-72bb40679604 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.253626 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7ee4-a2a3-49eb-8715-72bb40679604 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:29.255077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d7ee4-a2a3-49eb-8715-72bb40679604 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:29.272165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 491/985] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:43:29 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:43:29.286915 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:29.287624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.287953 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.288233 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.288972 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:29.289417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:29.290870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:29.296996 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 495/986] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:29.302982 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7ee4-a2a3-49eb-8715-72bb40679604 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:29.409850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d7ee4-a2a3-49eb-8715-72bb40679604 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:29.446336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b16b67-e044-406d-a2a6-7ba6b98cf17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:29.447033 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16b67-e044-406d-a2a6-7ba6b98cf17b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.447319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16b67-e044-406d-a2a6-7ba6b98cf17b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.447600 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b16b67-e044-406d-a2a6-7ba6b98cf17b None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.448363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b16b67-e044-406d-a2a6-7ba6b98cf17b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:29.448674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b16b67-e044-406d-a2a6-7ba6b98cf17b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:29.450102 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b16b67-e044-406d-a2a6-7ba6b98cf17b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:29.458202 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 492/987] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:29.462652 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:29.467015 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5920b9-19a8-4227-b3a5-ff1fce39a5cd None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.467398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5920b9-19a8-4227-b3a5-ff1fce39a5cd None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.467703 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5920b9-19a8-4227-b3a5-ff1fce39a5cd None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.469247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 493/988] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:29.474537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d149e-e48a-4eff-8f23-a507f6e045a7 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.474834 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d149e-e48a-4eff-8f23-a507f6e045a7 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.475127 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d149e-e48a-4eff-8f23-a507f6e045a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.492658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-958d149e-e48a-4eff-8f23-a507f6e045a7 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:29.493868 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-958d149e-e48a-4eff-8f23-a507f6e045a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:29.563476 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 494/989] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:29.572345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67319c-2b59-4653-8e5e-bfdc32bb8e63 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:29.584793 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d149e-e48a-4eff-8f23-a507f6e045a7 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:29.606230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:29.606899 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.607183 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.607463 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.608282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] RBAC: Adding query filter params (interface=admin, service_id=04cb751a95c648e691099eb9fdc9bc15, region_id=RegionOne) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:29.608596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:29.610628 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:29.616227 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 496/990] 10.222.0.32 () {56 vars in 1249 bytes} [Mon May 9 15:43:29 2022] GET /identity/v3/endpoints?service_id=04cb751a95c648e691099eb9fdc9bc15&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:29.621218 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:29.690230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d149e-e48a-4eff-8f23-a507f6e045a7 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:29.721834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30382ee7-0eb0-4b30-a70f-bb657c7392e0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:29.724750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908538c3-947b-4715-80af-9a469c974192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:29.725166 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908538c3-947b-4715-80af-9a469c974192 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.725514 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908538c3-947b-4715-80af-9a469c974192 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.725858 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908538c3-947b-4715-80af-9a469c974192 None admin] PATH_INFO: `/v3/services/image` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.726582 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908538c3-947b-4715-80af-9a469c974192 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:29.728042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908538c3-947b-4715-80af-9a469c974192 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-908538c3-947b-4715-80af-9a469c974192 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:29.740347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:29.741640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:29.747537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 495/991] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:43:29 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:29.748515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908538c3-947b-4715-80af-9a469c974192 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:29.757556 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2869c8-125e-4f1a-8493-38f43e9112c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:29.758285 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2869c8-125e-4f1a-8493-38f43e9112c3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.758584 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2869c8-125e-4f1a-8493-38f43e9112c3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.758862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2869c8-125e-4f1a-8493-38f43e9112c3 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.759835 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2869c8-125e-4f1a-8493-38f43e9112c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:29.761225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2869c8-125e-4f1a-8493-38f43e9112c3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:29.768169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 497/992] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:43:29 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:43:29.859363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908538c3-947b-4715-80af-9a469c974192 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:29.896336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98606a98-c5aa-451e-95cb-656537ba3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:29.897031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606a98-c5aa-451e-95cb-656537ba3d91 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:29.897296 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606a98-c5aa-451e-95cb-656537ba3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:29.897553 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98606a98-c5aa-451e-95cb-656537ba3d91 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:29.898269 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98606a98-c5aa-451e-95cb-656537ba3d91 None admin] RBAC: Adding query filter params (name=image) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:29.898574 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98606a98-c5aa-451e-95cb-656537ba3d91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:29.899989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98606a98-c5aa-451e-95cb-656537ba3d91 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:29.905518 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 496/993] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:29.911170 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2869c8-125e-4f1a-8493-38f43e9112c3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:30.017608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2869c8-125e-4f1a-8493-38f43e9112c3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:30.051432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b287da1-01d2-4abc-bcb1-b81c9671162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:30.052142 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287da1-01d2-4abc-bcb1-b81c9671162b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:30.052429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287da1-01d2-4abc-bcb1-b81c9671162b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:30.052707 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287da1-01d2-4abc-bcb1-b81c9671162b None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:30.053414 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b287da1-01d2-4abc-bcb1-b81c9671162b None admin] RBAC: Adding query filter params (type=image) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:30.053719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b287da1-01d2-4abc-bcb1-b81c9671162b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:30.055095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b287da1-01d2-4abc-bcb1-b81c9671162b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:30.059893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 498/994] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:31.563368 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e459ee-e0b6-48a3-9e30-0103e8d65d13 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:31.564062 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e459ee-e0b6-48a3-9e30-0103e8d65d13 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:31.564062 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e459ee-e0b6-48a3-9e30-0103e8d65d13 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:31.565487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 497/995] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:31.570766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616366b7-6a73-4abe-baf2-c4782e7e49e8 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:31.571181 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616366b7-6a73-4abe-baf2-c4782e7e49e8 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:31.571378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616366b7-6a73-4abe-baf2-c4782e7e49e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:31.588170 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-616366b7-6a73-4abe-baf2-c4782e7e49e8 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:31.589368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-616366b7-6a73-4abe-baf2-c4782e7e49e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:31.654933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 499/996] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:31.677764 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e459ee-e0b6-48a3-9e30-0103e8d65d13 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:31.779223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e459ee-e0b6-48a3-9e30-0103e8d65d13 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:31.813053 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:31.813922 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:31.814146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:31.814421 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:31.815078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:31.816463 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:31.828516 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:31.829665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:31.830696 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:31.834702 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 498/997] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:31.835984 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616366b7-6a73-4abe-baf2-c4782e7e49e8 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:31.938370 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616366b7-6a73-4abe-baf2-c4782e7e49e8 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:31.971454 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e8ef4-9e93-4f81-adb1-42746a8c1f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:31.972154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e8ef4-9e93-4f81-adb1-42746a8c1f2c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:31.972439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e8ef4-9e93-4f81-adb1-42746a8c1f2c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:31.972715 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e8ef4-9e93-4f81-adb1-42746a8c1f2c None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:31.973424 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e8ef4-9e93-4f81-adb1-42746a8c1f2c None admin] RBAC: Adding query filter params (name=compute) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:31.973734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e8ef4-9e93-4f81-adb1-42746a8c1f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:31.975109 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e8ef4-9e93-4f81-adb1-42746a8c1f2c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:31.979968 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 500/998] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:31.985767 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:32.071132 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8982-def4-4eb5-a861-2369844513bc None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.071325 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8982-def4-4eb5-a861-2369844513bc None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.071609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8982-def4-4eb5-a861-2369844513bc None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.073186 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 501/999] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:32.078668 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ef6b9-9426-45cd-b92c-1b1645c843f7 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.079008 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ef6b9-9426-45cd-b92c-1b1645c843f7 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.079250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ef6b9-9426-45cd-b92c-1b1645c843f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.089450 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aebc72-8733-4cfb-9f51-88a267ea43e3 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:32.096740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-ff9ef6b9-9426-45cd-b92c-1b1645c843f7 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:32.097936 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-ff9ef6b9-9426-45cd-b92c-1b1645c843f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:32.123168 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:32.123924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.124213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.125431 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.126201 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] RBAC: Adding query filter params (type=compute) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:32.126523 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:32.127985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:32.133901 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 499/1000] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:32.140135 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:32.183974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 502/1001] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:32.200593 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ef6b9-9426-45cd-b92c-1b1645c843f7 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:32.246536 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df4d28-1a65-4abc-a512-f003b1822997 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:32.280835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:32.282021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.282311 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.282595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.283394 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] RBAC: Adding query filter params (interface=public, service_id=05bc6a70e3cd4d4ca706e060caaf97be, region_id=RegionOne) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:32.283707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:32.285100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:32.294695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 500/1002] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:43:32 2022] GET /identity/v3/endpoints?service_id=05bc6a70e3cd4d4ca706e060caaf97be&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:32.295595 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:32.303219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ef6b9-9426-45cd-b92c-1b1645c843f7 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:32.337484 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57085c3-339e-4b84-b49b-5ec50b0a1e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:32.338218 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57085c3-339e-4b84-b49b-5ec50b0a1e8b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.338505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57085c3-339e-4b84-b49b-5ec50b0a1e8b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.338782 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57085c3-339e-4b84-b49b-5ec50b0a1e8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.339439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57085c3-339e-4b84-b49b-5ec50b0a1e8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:32.340858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57085c3-339e-4b84-b49b-5ec50b0a1e8b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-a57085c3-339e-4b84-b49b-5ec50b0a1e8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:32.353526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:32.354881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:32.355948 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 503/1003] 10.222.0.32 () {56 vars in 1126 bytes} [Mon May 9 15:43:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:32.356885 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0042-dd13-480b-9e2c-efb926e7a5b4 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.356885 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0042-dd13-480b-9e2c-efb926e7a5b4 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.356885 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa0042-dd13-480b-9e2c-efb926e7a5b4 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.359802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 504/1004] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:32.361578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0042-dd13-480b-9e2c-efb926e7a5b4 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:32.398162 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29342b5a-3fad-47da-b40c-27ed6c015f57 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:32.430584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64237-9db2-40e2-b6e7-f6e133eec1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:32.431244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64237-9db2-40e2-b6e7-f6e133eec1ff None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.431528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64237-9db2-40e2-b6e7-f6e133eec1ff None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.431827 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64237-9db2-40e2-b6e7-f6e133eec1ff None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.432506 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64237-9db2-40e2-b6e7-f6e133eec1ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:32.434003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64237-9db2-40e2-b6e7-f6e133eec1ff None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:32.440509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 501/1005] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:43:32 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:43:32.441725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6bbc-347e-4362-adc6-78d4cdc1b39a None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.441993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6bbc-347e-4362-adc6-78d4cdc1b39a None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.442273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6bbc-347e-4362-adc6-78d4cdc1b39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.460515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-ce6b6bbc-347e-4362-adc6-78d4cdc1b39a None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:32.462016 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-ce6b6bbc-347e-4362-adc6-78d4cdc1b39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:32.464989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa0042-dd13-480b-9e2c-efb926e7a5b4 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:32.501974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:32.502659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.502940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.503216 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.503969 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:32.504277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:32.505694 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:32.511216 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 505/1006] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:32.518617 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:32.540245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 502/1007] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:32.564685 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6bbc-347e-4362-adc6-78d4cdc1b39a None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:32.623936 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904b292-c585-4898-abdb-3fdf76b0a264 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:32.661091 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:32.661776 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.662320 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.662320 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.663036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:32.663348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:32.664809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:32.667909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6bbc-347e-4362-adc6-78d4cdc1b39a None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:32.670227 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 506/1008] 10.222.0.32 () {56 vars in 1122 bytes} [Mon May 9 15:43:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:32.675955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:32.706547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80353e36-ea33-43a0-ad61-002cdc00bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:32.707231 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80353e36-ea33-43a0-ad61-002cdc00bc33 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.707518 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80353e36-ea33-43a0-ad61-002cdc00bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.707836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80353e36-ea33-43a0-ad61-002cdc00bc33 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.708570 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80353e36-ea33-43a0-ad61-002cdc00bc33 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:32.709942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80353e36-ea33-43a0-ad61-002cdc00bc33 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:32.726799 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 503/1009] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:43:32 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:43:32.801808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146f407-90ee-445d-a394-d55554698c83 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:32.846189 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200abed-f4df-4121-8305-c40ccb0d9cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:32.846869 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200abed-f4df-4121-8305-c40ccb0d9cd9 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:32.847157 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200abed-f4df-4121-8305-c40ccb0d9cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:32.847432 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200abed-f4df-4121-8305-c40ccb0d9cd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:32.848212 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200abed-f4df-4121-8305-c40ccb0d9cd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:32.849609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200abed-f4df-4121-8305-c40ccb0d9cd9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:32.871812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 507/1010] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:43:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:43:34.745574 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d6bb-c30b-4c46-899b-5f4c4df3929b None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:34.746124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d6bb-c30b-4c46-899b-5f4c4df3929b None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:34.746124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046d6bb-c30b-4c46-899b-5f4c4df3929b None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:34.747535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 504/1011] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:34.753633 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298c27-4746-487c-a2ed-a58d9b5c531e None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:34.754070 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298c27-4746-487c-a2ed-a58d9b5c531e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:34.754175 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298c27-4746-487c-a2ed-a58d9b5c531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:34.771875 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-15298c27-4746-487c-a2ed-a58d9b5c531e None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:34.773568 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-15298c27-4746-487c-a2ed-a58d9b5c531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:34.879824 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 508/1012] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:34 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:34.900878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046d6bb-c30b-4c46-899b-5f4c4df3929b None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.004444 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046d6bb-c30b-4c46-899b-5f4c4df3929b None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.034089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93dcf0-d007-4b4f-8144-17486605412b None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.034464 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93dcf0-d007-4b4f-8144-17486605412b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.034653 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93dcf0-d007-4b4f-8144-17486605412b None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.036286 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 509/1013] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:35.039535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.040382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.040666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.040942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.041109 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856379a-5762-4aef-a417-9681595c136b None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.041389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856379a-5762-4aef-a417-9681595c136b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.041601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.041706 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856379a-5762-4aef-a417-9681595c136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.042967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:35.055667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:35.062636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:35.063788 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 505/1014] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:35.064740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-f856379a-5762-4aef-a417-9681595c136b None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:35.064740 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-f856379a-5762-4aef-a417-9681595c136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:35.064901 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.127255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 510/1015] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:35 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:35.150843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856379a-5762-4aef-a417-9681595c136b None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.167044 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b89678-47d7-4390-9b35-5b99c091b8e2 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.201832 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5f89e-d8c4-4a97-b612-f2ea165c384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.204430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f89e-d8c4-4a97-b612-f2ea165c384d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.204725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f89e-d8c4-4a97-b612-f2ea165c384d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.205002 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f89e-d8c4-4a97-b612-f2ea165c384d None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.205725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5f89e-d8c4-4a97-b612-f2ea165c384d None admin] RBAC: Adding query filter params (name=compute) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:35.206033 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5f89e-d8c4-4a97-b612-f2ea165c384d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.207403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5f89e-d8c4-4a97-b612-f2ea165c384d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.214612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 506/1016] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:35.215702 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0fe8-f70b-46c2-932b-f12ad51fcad8 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.216019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0fe8-f70b-46c2-932b-f12ad51fcad8 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.216302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0fe8-f70b-46c2-932b-f12ad51fcad8 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.217668 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 507/1017] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:35.221289 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0fe8-f70b-46c2-932b-f12ad51fcad8 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.252198 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856379a-5762-4aef-a417-9681595c136b None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.286103 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c45d5f-80f3-4147-aca1-e57dbaaf4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.286820 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45d5f-80f3-4147-aca1-e57dbaaf4e7c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.287122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45d5f-80f3-4147-aca1-e57dbaaf4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.287396 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c45d5f-80f3-4147-aca1-e57dbaaf4e7c None admin] PATH_INFO: `/v3/services/image` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.288083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c45d5f-80f3-4147-aca1-e57dbaaf4e7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.289467 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c45d5f-80f3-4147-aca1-e57dbaaf4e7c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-59c45d5f-80f3-4147-aca1-e57dbaaf4e7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:35.301314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:35.302462 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:35.303489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 511/1018] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:43:35 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:35.304492 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5323c-a040-4773-83a2-33653f69f2f2 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.304492 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5323c-a040-4773-83a2-33653f69f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.304648 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5323c-a040-4773-83a2-33653f69f2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.318986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0fe8-f70b-46c2-932b-f12ad51fcad8 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.321241 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-e7e5323c-a040-4773-83a2-33653f69f2f2 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:35.322426 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-e7e5323c-a040-4773-83a2-33653f69f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:35.352358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.353024 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.353309 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.353589 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.354294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] RBAC: Adding query filter params (type=compute) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:35.354605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.355981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.360708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 508/1019] 10.222.0.32 () {56 vars in 1112 bytes} [Mon May 9 15:43:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:35.361485 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.388998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 512/1020] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:35 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:35.389827 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5323c-a040-4773-83a2-33653f69f2f2 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.458077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5da18e-a739-4a76-8bec-c6d592cd585e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.489888 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5323c-a040-4773-83a2-33653f69f2f2 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.491385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.492114 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.492404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.492687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.493408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] RBAC: Adding query filter params (name=image) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:35.493719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.495083 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.500727 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 509/1021] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:35.501515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.525067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c40b-92b2-4244-9627-9d56c66cd70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.525746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c40b-92b2-4244-9627-9d56c66cd70e None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.526034 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c40b-92b2-4244-9627-9d56c66cd70e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.526315 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c40b-92b2-4244-9627-9d56c66cd70e None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.527060 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628c40b-92b2-4244-9627-9d56c66cd70e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.528473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628c40b-92b2-4244-9627-9d56c66cd70e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.547671 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 513/1022] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:43:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:35.548464 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c40b-92b2-4244-9627-9d56c66cd70e None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.608079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ae140-8bf7-4c5e-97a3-5a90370b655e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.653494 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd8e4-eb61-4a33-be5a-4a2c524d304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.654308 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd8e4-eb61-4a33-be5a-4a2c524d304d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.654597 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd8e4-eb61-4a33-be5a-4a2c524d304d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.654936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecd8e4-eb61-4a33-be5a-4a2c524d304d None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.656377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecd8e4-eb61-4a33-be5a-4a2c524d304d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.658086 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecd8e4-eb61-4a33-be5a-4a2c524d304d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.660043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 510/1023] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:35.662935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c40b-92b2-4244-9627-9d56c66cd70e None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.665765 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd8e4-eb61-4a33-be5a-4a2c524d304d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.701906 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.702789 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.703078 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.703363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.704223 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] RBAC: Adding query filter params (type=image) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:35.704541 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.706029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.711824 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 514/1024] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:35.717629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.777507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecd8e4-eb61-4a33-be5a-4a2c524d304d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.816947 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b5003-0ae1-41cd-b776-5951d9d2f370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.817547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5003-0ae1-41cd-b776-5951d9d2f370 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.817822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5003-0ae1-41cd-b776-5951d9d2f370 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.818107 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b5003-0ae1-41cd-b776-5951d9d2f370 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.818824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b5003-0ae1-41cd-b776-5951d9d2f370 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.820407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b5003-0ae1-41cd-b776-5951d9d2f370 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.830096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a6402-7879-4f35-8232-7d5060938ef7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:35.852596 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 511/1025] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:43:35 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:43:35.867559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a0b35-c24b-4908-89b3-a95888d3024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:35.868388 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a0b35-c24b-4908-89b3-a95888d3024f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:35.868679 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a0b35-c24b-4908-89b3-a95888d3024f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:35.868961 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a0b35-c24b-4908-89b3-a95888d3024f None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:35.869792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a0b35-c24b-4908-89b3-a95888d3024f None admin] RBAC: Adding query filter params (interface=public, service_id=7990040f9c84416fb4af38621227df3d, region_id=RegionOne) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:35.870115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a0b35-c24b-4908-89b3-a95888d3024f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:35.871549 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a0b35-c24b-4908-89b3-a95888d3024f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:35.879863 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 515/1026] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:43:35 2022] GET /identity/v3/endpoints?service_id=7990040f9c84416fb4af38621227df3d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:35.884768 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b5003-0ae1-41cd-b776-5951d9d2f370 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:35.994106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b5003-0ae1-41cd-b776-5951d9d2f370 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:36.030130 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1204c-51c3-4d2d-95c6-a82dbac6af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:36.031504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1204c-51c3-4d2d-95c6-a82dbac6af80 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:36.031819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1204c-51c3-4d2d-95c6-a82dbac6af80 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:36.032169 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1204c-51c3-4d2d-95c6-a82dbac6af80 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:36.032901 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1204c-51c3-4d2d-95c6-a82dbac6af80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:36.034308 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1204c-51c3-4d2d-95c6-a82dbac6af80 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:36.047791 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 512/1027] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:43:35 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:43:37.930244 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa767c-474a-47f0-b8f7-79a6c66ab84e None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:37.930800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa767c-474a-47f0-b8f7-79a6c66ab84e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:37.930800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa767c-474a-47f0-b8f7-79a6c66ab84e None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:37.932393 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 516/1028] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:37.938715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a435-a32b-4377-84f3-6eba1f40fc35 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:37.939181 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a435-a32b-4377-84f3-6eba1f40fc35 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:37.939268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a435-a32b-4377-84f3-6eba1f40fc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:37.956930 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-ed24a435-a32b-4377-84f3-6eba1f40fc35 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:37.958134 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-ed24a435-a32b-4377-84f3-6eba1f40fc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:38.026846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 513/1029] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:38.052064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa767c-474a-47f0-b8f7-79a6c66ab84e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.164612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa767c-474a-47f0-b8f7-79a6c66ab84e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:38.201551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364dde-af05-4cb4-83dd-40b63d0b3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:38.202293 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364dde-af05-4cb4-83dd-40b63d0b3910 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.203116 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364dde-af05-4cb4-83dd-40b63d0b3910 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.203460 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364dde-af05-4cb4-83dd-40b63d0b3910 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.213475 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0364dde-af05-4cb4-83dd-40b63d0b3910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-b0364dde-af05-4cb4-83dd-40b63d0b3910 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:38.222219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:38.223296 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:38.229423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 517/1030] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:38.231029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a435-a32b-4377-84f3-6eba1f40fc35 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.231368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68d4c-52d6-413d-aaa8-2f10cd2b3ee2 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.231660 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68d4c-52d6-413d-aaa8-2f10cd2b3ee2 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.231970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68d4c-52d6-413d-aaa8-2f10cd2b3ee2 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.233409 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 518/1031] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:38.239608 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe5b27-1b58-4199-8709-1ae57439de59 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.239932 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe5b27-1b58-4199-8709-1ae57439de59 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.240217 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe5b27-1b58-4199-8709-1ae57439de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.257609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-e6fe5b27-1b58-4199-8709-1ae57439de59 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:38.258802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-e6fe5b27-1b58-4199-8709-1ae57439de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:38.327664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 519/1032] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:38.329040 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d835f-ef80-445a-af61-48470fea5aed None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.329337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d835f-ef80-445a-af61-48470fea5aed None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.329618 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d835f-ef80-445a-af61-48470fea5aed None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.330109 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a435-a32b-4377-84f3-6eba1f40fc35 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:38.331028 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 520/1033] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:38.336182 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ccd9-8205-4974-be83-5cee28d2e69d None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.336476 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ccd9-8205-4974-be83-5cee28d2e69d None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.336757 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ccd9-8205-4974-be83-5cee28d2e69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.352835 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-8e69ccd9-8205-4974-be83-5cee28d2e69d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:38.354023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-8e69ccd9-8205-4974-be83-5cee28d2e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:38.364318 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:38.364992 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.365275 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.365551 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.366298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:38.366598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:38.367974 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:38.376437 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 514/1034] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:38.378056 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.419529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 521/1035] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:38.424023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ccd9-8205-4974-be83-5cee28d2e69d None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.476543 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0805b-1fc3-4598-b36f-7ebf0e423e85 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:38.509198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ae49-1fd4-4cb5-8469-d6932524c922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:38.509997 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ae49-1fd4-4cb5-8469-d6932524c922 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.510283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ae49-1fd4-4cb5-8469-d6932524c922 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.510561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ae49-1fd4-4cb5-8469-d6932524c922 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.511750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454ae49-1fd4-4cb5-8469-d6932524c922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:38.513199 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454ae49-1fd4-4cb5-8469-d6932524c922 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:38.515627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 515/1036] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:38.516385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ae49-1fd4-4cb5-8469-d6932524c922 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.518071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ccd9-8205-4974-be83-5cee28d2e69d None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:38.552223 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:38.553023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.553309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.553587 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.563603 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:38.565089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:38.582077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:38.583191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:38.584324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:38.584324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:38.584324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:38.584324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:38.584324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 522/1037] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:38.584659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.620745 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ae49-1fd4-4cb5-8469-d6932524c922 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:38.653610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569881ef-e33e-4089-8268-333717466c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:38.654401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569881ef-e33e-4089-8268-333717466c36 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.654689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569881ef-e33e-4089-8268-333717466c36 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.654968 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569881ef-e33e-4089-8268-333717466c36 None admin] PATH_INFO: `/v3/services/image` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.656256 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569881ef-e33e-4089-8268-333717466c36 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:38.657640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569881ef-e33e-4089-8268-333717466c36 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-569881ef-e33e-4089-8268-333717466c36 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:38.669040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:38.670379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:43:38.672240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:38.676083 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 516/1038] 10.222.0.32 () {56 vars in 1105 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:38.676821 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569881ef-e33e-4089-8268-333717466c36 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.681353 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271c16f-7343-46a9-9e3e-ca5df6f28d11 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:38.714045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81b12-b16d-4045-954d-604b65a96bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:38.714718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81b12-b16d-4045-954d-604b65a96bcf None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.715007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81b12-b16d-4045-954d-604b65a96bcf None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.715289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81b12-b16d-4045-954d-604b65a96bcf None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.716032 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c81b12-b16d-4045-954d-604b65a96bcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:38.717465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c81b12-b16d-4045-954d-604b65a96bcf None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:38.746870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 523/1039] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:43:38 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:38.746870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81b12-b16d-4045-954d-604b65a96bcf None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.795624 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569881ef-e33e-4089-8268-333717466c36 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:38.833403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:38.834082 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.834366 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.834659 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.835381 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:38.835685 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:38.837124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:38.851950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 517/1040] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:38.856410 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.868775 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81b12-b16d-4045-954d-604b65a96bcf None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:38.905320 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:38.906622 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:38.906917 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:38.907205 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:38.907971 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] RBAC: Adding query filter params (name=image) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:38.908290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:38.909731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:38.915194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 524/1041] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:38.922812 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:38.972553 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31196-a08b-48b4-bc72-32fa87fc8810 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:39.014502 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:39.015302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:39.015586 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:39.015921 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] PATH_INFO: `/v3/users/nova` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:39.023603 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:39.025085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:39.028907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82c5e2-cf11-4ea5-825d-232b8690f617 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:39.040005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:39.041131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:39.042264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 518/1042] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:39.049251 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:39.065390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:39.066067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:39.066354 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:39.066630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:39.067344 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] RBAC: Adding query filter params (type=image) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:39.067675 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:39.069074 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:39.074279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 525/1043] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:39.080024 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:39.158610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed348-0493-4637-91f6-cf0ce26b3173 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:39.193877 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f76f0-38b4-4734-89a9-ade11df144c1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:39.202128 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:39.204561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:39.205429 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:39.206246 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:39.207329 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:39.208009 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:39.210326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:39.229960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87d64c-6980-455d-bc41-d6ab81e7b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:39.230627 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d64c-6980-455d-bc41-d6ab81e7b8d7 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:39.230940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d64c-6980-455d-bc41-d6ab81e7b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:39.231224 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87d64c-6980-455d-bc41-d6ab81e7b8d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:39.232079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 519/1044] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:43:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:39.232202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87d64c-6980-455d-bc41-d6ab81e7b8d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:39.233371 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87d64c-6980-455d-bc41-d6ab81e7b8d7 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:39.237781 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:39.253338 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 526/1045] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:43:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:43:39.353546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad2b5b-047d-455c-9ca5-fc34cd3d7291 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:39.399648 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e86e6-34b6-4ece-8440-ddd204ffd9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:39.400643 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e86e6-34b6-4ece-8440-ddd204ffd9cb None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:39.401110 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e86e6-34b6-4ece-8440-ddd204ffd9cb None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:39.401549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e86e6-34b6-4ece-8440-ddd204ffd9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:39.473256 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e86e6-34b6-4ece-8440-ddd204ffd9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:39.474719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e86e6-34b6-4ece-8440-ddd204ffd9cb None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:39.575384 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 520/1046] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:43:39.581853 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87d64c-6980-455d-bc41-d6ab81e7b8d7 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:39.680117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87d64c-6980-455d-bc41-d6ab81e7b8d7 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:39.713575 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:39.714370 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:39.714701 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:39.714981 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:39.725651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:39.727089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:39.743998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:39.745112 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:39.746639 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:39.746639 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:39.746639 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:39.746639 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:39.747846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 527/1047] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:39.750960 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e86e6-34b6-4ece-8440-ddd204ffd9cb None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:39.848087 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e86e6-34b6-4ece-8440-ddd204ffd9cb None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:39.880464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:39.881129 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:39.881410 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:39.881680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:39.882392 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:39.882695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:39.884087 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:39.900110 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 521/1048] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:39.901690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:40.017314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7dd12-8754-4074-aeb0-0d7321f39b64 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:40.055914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:40.056745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:40.056987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:40.057262 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:40.064204 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:40.065645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:40.079664 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:40.080903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:40.086690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 528/1049] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:40.088868 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:40.188607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e069a3c-6d18-4c54-82c7-64f0c7a318d9 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:40.221245 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94a0a6-4884-4231-8e87-ec10c42e9ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:40.221906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a0a6-4884-4231-8e87-ec10c42e9ae1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:40.222186 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a0a6-4884-4231-8e87-ec10c42e9ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:40.222459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a0a6-4884-4231-8e87-ec10c42e9ae1 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:40.223238 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a0a6-4884-4231-8e87-ec10c42e9ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:40.223545 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a0a6-4884-4231-8e87-ec10c42e9ae1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:40.224989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a0a6-4884-4231-8e87-ec10c42e9ae1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:40.237356 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 522/1050] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:40.243038 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:40.350674 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2551dc1-966a-4ed9-8624-6b1f518befd4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:40.383745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2e8e9-17e0-48c7-8159-ad44af24d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:40.384429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2e8e9-17e0-48c7-8159-ad44af24d642 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:40.384712 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2e8e9-17e0-48c7-8159-ad44af24d642 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:40.384985 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2e8e9-17e0-48c7-8159-ad44af24d642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:40.385814 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2e8e9-17e0-48c7-8159-ad44af24d642 None admin] RBAC: Adding query filter params (role.id=c20278094aa143f3af7382f504c8116d, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=8bc210c9b3f94f09b32127dc754a2094) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:40.386128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2e8e9-17e0-48c7-8159-ad44af24d642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:40.387560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2e8e9-17e0-48c7-8159-ad44af24d642 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:40.394107 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 529/1051] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:40 2022] GET /identity/v3/role_assignments?user.id=8bc210c9b3f94f09b32127dc754a2094&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=c20278094aa143f3af7382f504c8116d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:41.079263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b419a-ab0d-49de-b65f-20fe9ba21afd None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.079671 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b419a-ab0d-49de-b65f-20fe9ba21afd None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.079852 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b419a-ab0d-49de-b65f-20fe9ba21afd None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.081290 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 523/1052] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:41.086562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef3635-3a2e-459b-9a05-5931b2d04870 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.087033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef3635-3a2e-459b-9a05-5931b2d04870 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.087135 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef3635-3a2e-459b-9a05-5931b2d04870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.105140 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-27ef3635-3a2e-459b-9a05-5931b2d04870 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:41.106353 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-27ef3635-3a2e-459b-9a05-5931b2d04870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:41.174672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 530/1053] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:41.198999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b419a-ab0d-49de-b65f-20fe9ba21afd None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:41.300354 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b419a-ab0d-49de-b65f-20fe9ba21afd None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:41.334110 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c1a1c-e60e-4ca1-8002-ae48e8229814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:41.334837 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c1a1c-e60e-4ca1-8002-ae48e8229814 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.335125 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c1a1c-e60e-4ca1-8002-ae48e8229814 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.335404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c1a1c-e60e-4ca1-8002-ae48e8229814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.348654 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c1a1c-e60e-4ca1-8002-ae48e8229814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-693c1a1c-e60e-4ca1-8002-ae48e8229814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:41.356608 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:41.357815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:41.360760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:41.362725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 524/1054] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:41.365453 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef3635-3a2e-459b-9a05-5931b2d04870 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:41.465403 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef3635-3a2e-459b-9a05-5931b2d04870 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:41.501436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a320ddb-ed68-47d2-8026-0ca12d1988fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:41.502185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a320ddb-ed68-47d2-8026-0ca12d1988fe None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.502478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a320ddb-ed68-47d2-8026-0ca12d1988fe None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.502813 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a320ddb-ed68-47d2-8026-0ca12d1988fe None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.503577 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a320ddb-ed68-47d2-8026-0ca12d1988fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:41.503920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a320ddb-ed68-47d2-8026-0ca12d1988fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:41.505308 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a320ddb-ed68-47d2-8026-0ca12d1988fe None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:41.514162 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 531/1055] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:41.519743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c1a1c-e60e-4ca1-8002-ae48e8229814 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:41.553512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde3f9-5032-4959-9deb-a50439c6c74b None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.553819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde3f9-5032-4959-9deb-a50439c6c74b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.554088 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde3f9-5032-4959-9deb-a50439c6c74b None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.555591 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 532/1056] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:41.560573 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dff14-a92d-4c76-b403-1b55e2409eaa None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.560872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dff14-a92d-4c76-b403-1b55e2409eaa None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.561408 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dff14-a92d-4c76-b403-1b55e2409eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.578243 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-fa2dff14-a92d-4c76-b403-1b55e2409eaa None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:41.579448 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-fa2dff14-a92d-4c76-b403-1b55e2409eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:41.623505 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c1a1c-e60e-4ca1-8002-ae48e8229814 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:41.649256 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 533/1057] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:41.659064 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9171f-43c3-4851-9da0-e051fc23817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:41.660183 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9171f-43c3-4851-9da0-e051fc23817e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.660654 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9171f-43c3-4851-9da0-e051fc23817e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9171f-43c3-4851-9da0-e051fc23817e None admin] PATH_INFO: `/v3/users/8e7913c068ce48caae44d69f68ec3262` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.672628 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dff14-a92d-4c76-b403-1b55e2409eaa None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:41.676160 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9171f-43c3-4851-9da0-e051fc23817e None admin] RBAC: Authorizing `identity:get_user(user_id=8e7913c068ce48caae44d69f68ec3262)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:41.677607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9171f-43c3-4851-9da0-e051fc23817e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:41.679459 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 525/1058] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:43:41 2022] GET /identity/v3/users/8e7913c068ce48caae44d69f68ec3262 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:41.685300 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9171f-43c3-4851-9da0-e051fc23817e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:41.770392 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dff14-a92d-4c76-b403-1b55e2409eaa None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:41.786593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9171f-43c3-4851-9da0-e051fc23817e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:41.804275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef38e2-86df-4393-9e7a-163644ee979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:41.804929 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef38e2-86df-4393-9e7a-163644ee979d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.805218 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef38e2-86df-4393-9e7a-163644ee979d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.805499 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef38e2-86df-4393-9e7a-163644ee979d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.821235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d86c0-ddf7-45fc-a2a9-40742446aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:41.821894 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d86c0-ddf7-45fc-a2a9-40742446aaa2 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:41.822181 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d86c0-ddf7-45fc-a2a9-40742446aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:41.822463 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d86c0-ddf7-45fc-a2a9-40742446aaa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:41.873890 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef38e2-86df-4393-9e7a-163644ee979d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:41.876636 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef38e2-86df-4393-9e7a-163644ee979d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:41.888124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d86c0-ddf7-45fc-a2a9-40742446aaa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:41.889568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d86c0-ddf7-45fc-a2a9-40742446aaa2 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:41.984190 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 534/1059] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:43:41.986336 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef38e2-86df-4393-9e7a-163644ee979d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:41.989308 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 526/1060] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:43:41.994878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d86c0-ddf7-45fc-a2a9-40742446aaa2 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:42.093166 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef38e2-86df-4393-9e7a-163644ee979d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:42.093758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d86c0-ddf7-45fc-a2a9-40742446aaa2 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:42.128753 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:42.129471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:42.129752 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:42.130023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:42.134407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71765-bb1f-4d88-9262-e43ded127a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:42.135537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71765-bb1f-4d88-9262-e43ded127a5f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:42.136072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71765-bb1f-4d88-9262-e43ded127a5f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:42.136599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71765-bb1f-4d88-9262-e43ded127a5f None admin] PATH_INFO: `/v3/projects/3403cd89968a4fdb94ad3d468d7ae905` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:42.137892 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e71765-bb1f-4d88-9262-e43ded127a5f None admin] RBAC: Authorizing `identity:get_project(project_id=3403cd89968a4fdb94ad3d468d7ae905)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:42.139418 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e71765-bb1f-4d88-9262-e43ded127a5f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:42.141154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:42.142059 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 527/1061] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:43:41 2022] GET /identity/v3/projects/3403cd89968a4fdb94ad3d468d7ae905 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:42.142588 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:42.147729 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71765-bb1f-4d88-9262-e43ded127a5f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:42.162006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:42.163117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:42.169309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:42.169309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:42.169309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:42.169309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:42.169309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 535/1062] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:42.169309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:42.262029 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71765-bb1f-4d88-9262-e43ded127a5f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:42.267989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb30c-5538-4de7-b5e2-29e9bb129da3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:42.296302 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a720-9d08-4a4f-8613-d95a28024647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:42.296971 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a720-9d08-4a4f-8613-d95a28024647 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:42.297262 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a720-9d08-4a4f-8613-d95a28024647 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:42.297540 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a720-9d08-4a4f-8613-d95a28024647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:42.298377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598a720-9d08-4a4f-8613-d95a28024647 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=3403cd89968a4fdb94ad3d468d7ae905, user.id=8e7913c068ce48caae44d69f68ec3262) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:42.298695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598a720-9d08-4a4f-8613-d95a28024647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:42.300148 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598a720-9d08-4a4f-8613-d95a28024647 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:42.301138 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97784b-c255-4996-a3bb-377630891f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:42.301803 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97784b-c255-4996-a3bb-377630891f1b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:42.302089 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97784b-c255-4996-a3bb-377630891f1b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:42.302363 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97784b-c255-4996-a3bb-377630891f1b None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:42.303086 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97784b-c255-4996-a3bb-377630891f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:42.303392 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97784b-c255-4996-a3bb-377630891f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:42.304791 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97784b-c255-4996-a3bb-377630891f1b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:42.315818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 528/1063] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:42 2022] GET /identity/v3/role_assignments?user.id=8e7913c068ce48caae44d69f68ec3262&scope.project.id=3403cd89968a4fdb94ad3d468d7ae905&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:42.318369 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 536/1064] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:42.638599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53c058-341e-44c1-950e-1a2b43cb892e None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:42.638978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53c058-341e-44c1-950e-1a2b43cb892e None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:42.639159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53c058-341e-44c1-950e-1a2b43cb892e None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:42.641497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 529/1065] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:42.646897 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22eb0-54f6-4a89-91e0-274061a210b3 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:42.647201 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22eb0-54f6-4a89-91e0-274061a210b3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:42.647487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec22eb0-54f6-4a89-91e0-274061a210b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:42.665537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-fec22eb0-54f6-4a89-91e0-274061a210b3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:42.666739 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-fec22eb0-54f6-4a89-91e0-274061a210b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:42.733546 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 537/1066] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:42.757260 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53c058-341e-44c1-950e-1a2b43cb892e None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:42.860708 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53c058-341e-44c1-950e-1a2b43cb892e None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:42.894017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d3e4-9df3-44a5-ad86-7e9bba095f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:42.894754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d3e4-9df3-44a5-ad86-7e9bba095f02 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:42.895039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d3e4-9df3-44a5-ad86-7e9bba095f02 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:42.895316 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d3e4-9df3-44a5-ad86-7e9bba095f02 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:42.905244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810d3e4-9df3-44a5-ad86-7e9bba095f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-e810d3e4-9df3-44a5-ad86-7e9bba095f02 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:42.913367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:42.914625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:42.915634 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 530/1067] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:43:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:42.920713 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22eb0-54f6-4a89-91e0-274061a210b3 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:43.016683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec22eb0-54f6-4a89-91e0-274061a210b3 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:43.050027 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:43.050695 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:43.050977 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:43.051251 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:43.052027 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:43.052334 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:43.053701 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:43.061962 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 538/1068] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:43:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:43.068312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d3e4-9df3-44a5-ad86-7e9bba095f02 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:43.178704 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810d3e4-9df3-44a5-ad86-7e9bba095f02 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:43.211716 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:43.212549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:43.212838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:43.213115 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:43.223796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:43.225248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:43.242413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:43.248292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:43.249715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:43.249715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:43.249715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:43.249715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:43.249715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 531/1069] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:43.250073 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:43.345360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038bab-49f6-40b5-82a2-787d0c9b7c1a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:43.377769 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:43.378425 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:43.378713 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:43.378994 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:43.379712 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:43.380052 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:43.381427 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:43.393414 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 539/1070] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:43.400669 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:43.500509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10891662-b8ba-4aa8-8fcc-d661ab39251f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:43.533558 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:43.534360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:43.534647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:43.534926 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:43.542405 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:43.543875 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:43.557734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:43.559075 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:43.560625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 532/1071] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:43:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:43.564955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:43.661783 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0f99d-7586-457c-b6ad-e2c523eb7bba None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:43.696931 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:43.697606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:43.697893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:43.698170 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:43.699006 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:43.699315 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:43.700786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:43.718748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 540/1072] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:43:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:43.724357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:43.820979 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184802d-ad69-4df0-9e22-02f0335870f3 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:43.852846 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:43.853640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:43.853923 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:43.854200 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:43.864870 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:43.866296 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:43.885022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:43.886254 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:43.887568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:43.887568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:43.887568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:43.887568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:43.891797 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 533/1073] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:43.892171 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:43.988866 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bc18d-3d19-41bf-840f-dca9e309a973 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:44.021588 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:44.022247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:44.022529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:44.022805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:44.023518 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:44.023849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:44.025221 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:44.037460 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 541/1074] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:44.043090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:44.149943 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d9a3b-49f0-45bc-97c9-012d0d967e82 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:44.186920 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:44.187930 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:44.188217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:44.188493 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:44.195206 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:44.196678 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:44.211445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:44.212986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:44.214504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 534/1075] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:44.219039 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:44.315562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fef12-89ed-40a4-9828-6132ed1891c5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:44.348626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d76cf7-7a58-48db-bb44-93a58a0c5d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:44.349289 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d76cf7-7a58-48db-bb44-93a58a0c5d23 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:44.349578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d76cf7-7a58-48db-bb44-93a58a0c5d23 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:44.349859 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d76cf7-7a58-48db-bb44-93a58a0c5d23 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:44.350645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d76cf7-7a58-48db-bb44-93a58a0c5d23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:44.350959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d76cf7-7a58-48db-bb44-93a58a0c5d23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:44.352433 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d76cf7-7a58-48db-bb44-93a58a0c5d23 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:44.364463 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 542/1076] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:44.370379 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:44.472717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f2f12-b2c6-43a4-bfee-5e36f1714c0a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:44.506837 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928581b2-bb2f-47c0-9372-565f01c2dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:44.507717 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928581b2-bb2f-47c0-9372-565f01c2dba8 None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:44.508022 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928581b2-bb2f-47c0-9372-565f01c2dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:44.508291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928581b2-bb2f-47c0-9372-565f01c2dba8 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/8bc210c9b3f94f09b32127dc754a2094/roles/c20278094aa143f3af7382f504c8116d` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:44.510463 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928581b2-bb2f-47c0-9372-565f01c2dba8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=8bc210c9b3f94f09b32127dc754a2094, role_id=c20278094aa143f3af7382f504c8116d)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:44.511909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928581b2-bb2f-47c0-9372-565f01c2dba8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:44.525292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 535/1077] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:43:44 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/8bc210c9b3f94f09b32127dc754a2094/roles/c20278094aa143f3af7382f504c8116d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:43:44.588879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bd74-6d66-46ad-8af7-07ee45848c7c None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:44.589207 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bd74-6d66-46ad-8af7-07ee45848c7c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:44.589493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bd74-6d66-46ad-8af7-07ee45848c7c None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:44.590999 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 543/1078] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:44.597402 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00b595-2663-40ce-96b2-a7cf4d2553a3 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:44.597783 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00b595-2663-40ce-96b2-a7cf4d2553a3 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:44.598043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00b595-2663-40ce-96b2-a7cf4d2553a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:44.615827 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-ad00b595-2663-40ce-96b2-a7cf4d2553a3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:44.617063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-ad00b595-2663-40ce-96b2-a7cf4d2553a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:44.686333 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 536/1079] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:44.711537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9bd74-6d66-46ad-8af7-07ee45848c7c None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:44.813210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9bd74-6d66-46ad-8af7-07ee45848c7c None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:44.847633 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1601ef-35bf-4026-929f-43b61cce0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:44.848479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1601ef-35bf-4026-929f-43b61cce0a5b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:44.848829 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1601ef-35bf-4026-929f-43b61cce0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:44.849141 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1601ef-35bf-4026-929f-43b61cce0a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:44.859783 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1601ef-35bf-4026-929f-43b61cce0a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-0a1601ef-35bf-4026-929f-43b61cce0a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:44.867491 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:44.868794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:44.870020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:44.871016 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 544/1080] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:44.875809 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00b595-2663-40ce-96b2-a7cf4d2553a3 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:44.973533 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00b595-2663-40ce-96b2-a7cf4d2553a3 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:45.007591 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:45.008283 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:45.008568 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:45.008842 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:45.009598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:45.009904 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:45.011263 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:45.020058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 537/1081] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:45.025710 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1601ef-35bf-4026-929f-43b61cce0a5b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:45.123218 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1601ef-35bf-4026-929f-43b61cce0a5b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:45.155465 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86319a5b-2458-4622-a390-431db4e06fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:45.156436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86319a5b-2458-4622-a390-431db4e06fb0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:45.156718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86319a5b-2458-4622-a390-431db4e06fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:45.156991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86319a5b-2458-4622-a390-431db4e06fb0 None admin] PATH_INFO: `/v3/users/8e7913c068ce48caae44d69f68ec3262` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:45.158163 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86319a5b-2458-4622-a390-431db4e06fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=8e7913c068ce48caae44d69f68ec3262)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:45.159583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86319a5b-2458-4622-a390-431db4e06fb0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:45.161231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 545/1082] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:43:45 2022] GET /identity/v3/users/8e7913c068ce48caae44d69f68ec3262 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:45.166888 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:45.265136 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541fc5b-98df-4fd8-bdd7-bb192fb3614c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:45.298676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a267-f604-4b32-867a-ed6f070da91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:45.299542 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a267-f604-4b32-867a-ed6f070da91e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:45.299942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a267-f604-4b32-867a-ed6f070da91e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:45.300172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a267-f604-4b32-867a-ed6f070da91e None admin] PATH_INFO: `/v3/projects/3403cd89968a4fdb94ad3d468d7ae905` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:45.301366 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a267-f604-4b32-867a-ed6f070da91e None admin] RBAC: Authorizing `identity:get_project(project_id=3403cd89968a4fdb94ad3d468d7ae905)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:45.302809 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a267-f604-4b32-867a-ed6f070da91e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:45.304587 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 538/1083] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:43:45 2022] GET /identity/v3/projects/3403cd89968a4fdb94ad3d468d7ae905 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:45.310426 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86319a5b-2458-4622-a390-431db4e06fb0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:45.406846 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86319a5b-2458-4622-a390-431db4e06fb0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:45.442773 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1210392-91ee-4e34-8b93-ad84fff28012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:45.443652 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210392-91ee-4e34-8b93-ad84fff28012 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:45.444019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210392-91ee-4e34-8b93-ad84fff28012 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:45.444295 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210392-91ee-4e34-8b93-ad84fff28012 None admin] PATH_INFO: `/v3/projects/3403cd89968a4fdb94ad3d468d7ae905/users/8e7913c068ce48caae44d69f68ec3262/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:45.446923 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1210392-91ee-4e34-8b93-ad84fff28012 None admin] RBAC: Authorizing `identity:create_grant(project_id=3403cd89968a4fdb94ad3d468d7ae905, user_id=8e7913c068ce48caae44d69f68ec3262, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:45.448387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1210392-91ee-4e34-8b93-ad84fff28012 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:45.461581 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 546/1084] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:43:45 2022] PUT /identity/v3/projects/3403cd89968a4fdb94ad3d468d7ae905/users/8e7913c068ce48caae44d69f68ec3262/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:43:46.748089 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1322e-166c-438c-8c50-dc8a0a10e02a None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:46.748690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1322e-166c-438c-8c50-dc8a0a10e02a None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:46.748690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1322e-166c-438c-8c50-dc8a0a10e02a None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:46.750620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 539/1085] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:46.756019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70e9e5-0fd0-49c2-ba42-0398217b1758 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:46.756444 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70e9e5-0fd0-49c2-ba42-0398217b1758 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:46.756582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70e9e5-0fd0-49c2-ba42-0398217b1758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:46.773018 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-7e70e9e5-0fd0-49c2-ba42-0398217b1758 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:46.774193 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-7e70e9e5-0fd0-49c2-ba42-0398217b1758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:46.838297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 547/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:46.862567 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1322e-166c-438c-8c50-dc8a0a10e02a None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:46.961063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1322e-166c-438c-8c50-dc8a0a10e02a None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:46.994142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04414f0-5b58-4352-93cf-5f93baeb9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:46.994948 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04414f0-5b58-4352-93cf-5f93baeb9344 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:46.995227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04414f0-5b58-4352-93cf-5f93baeb9344 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:46.995500 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04414f0-5b58-4352-93cf-5f93baeb9344 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.006227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04414f0-5b58-4352-93cf-5f93baeb9344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-b04414f0-5b58-4352-93cf-5f93baeb9344 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:47.014341 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:47.015627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:47.021639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 540/1087] 10.222.0.32 () {56 vars in 1120 bytes} [Mon May 9 15:43:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:43:47.022487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70e9e5-0fd0-49c2-ba42-0398217b1758 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:47.119384 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70e9e5-0fd0-49c2-ba42-0398217b1758 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:47.152942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:47.153615 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.153901 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.154179 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.154926 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:47.155267 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:47.156683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:47.164672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 548/1088] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:43:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:47.170441 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04414f0-5b58-4352-93cf-5f93baeb9344 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:47.268748 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04414f0-5b58-4352-93cf-5f93baeb9344 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:47.301159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:47.301956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.302242 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.302522 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.314469 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:47.315959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:47.332423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:47.338509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:47.339841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:47.339841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:47.339841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:47.339841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:47.339841 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 541/1089] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:47.340221 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:47.437261 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0d38a-0890-4c89-9264-0639ab3a7e44 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:47.469779 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:47.470436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.470722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.471002 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.471717 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:47.472057 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:47.473430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:47.484825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 549/1090] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:47.490419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:47.596484 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8837f4-fd14-474b-8b08-e9d33a24c9d0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:47.630082 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb3013-7ebb-4ebc-a934-d0f741a54c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:47.630875 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb3013-7ebb-4ebc-a934-d0f741a54c55 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.631159 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb3013-7ebb-4ebc-a934-d0f741a54c55 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.631433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb3013-7ebb-4ebc-a934-d0f741a54c55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.638843 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb3013-7ebb-4ebc-a934-d0f741a54c55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:47.641388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb3013-7ebb-4ebc-a934-d0f741a54c55 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-c1bb3013-7ebb-4ebc-a934-d0f741a54c55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:43:47.655037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:47.656391 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:47.657528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 542/1091] 10.222.0.32 () {56 vars in 1093 bytes} [Mon May 9 15:43:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:47.662422 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:47.705519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6f37-3e5c-44cb-9c44-d857fd2c9db5 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.705826 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6f37-3e5c-44cb-9c44-d857fd2c9db5 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.706070 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6f37-3e5c-44cb-9c44-d857fd2c9db5 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.707578 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 543/1092] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:43:47.712533 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26138d05-40a0-4555-963b-e564431fea6c None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.712830 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26138d05-40a0-4555-963b-e564431fea6c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.713117 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26138d05-40a0-4555-963b-e564431fea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.729802 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-26138d05-40a0-4555-963b-e564431fea6c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:47.730985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-26138d05-40a0-4555-963b-e564431fea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:47.762539 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b54b-26c4-45cb-8ca4-bb084362ee5d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:47.795630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 544/1093] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:47.797498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:47.798177 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.798467 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.798750 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.799593 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:47.799941 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:47.801382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:47.819439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 550/1094] 10.222.0.32 () {56 vars in 1133 bytes} [Mon May 9 15:43:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:47.820068 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26138d05-40a0-4555-963b-e564431fea6c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:47.824818 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:47.916743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26138d05-40a0-4555-963b-e564431fea6c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:47.921468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497fa4b-a034-4029-bdac-9b561a506f34 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:47.950622 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ce08-0d1e-43cf-a88f-6b676d646262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:47.951426 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ce08-0d1e-43cf-a88f-6b676d646262 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.951719 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ce08-0d1e-43cf-a88f-6b676d646262 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.952086 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ce08-0d1e-43cf-a88f-6b676d646262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.955644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481cb7c-ab1c-4d0f-b571-5df76c3193a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:47.956338 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481cb7c-ab1c-4d0f-b571-5df76c3193a5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:47.956623 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481cb7c-ab1c-4d0f-b571-5df76c3193a5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:47.956905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481cb7c-ab1c-4d0f-b571-5df76c3193a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:47.962317 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78ce08-0d1e-43cf-a88f-6b676d646262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-0a78ce08-0d1e-43cf-a88f-6b676d646262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:43:47.970133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:47.971401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:43:47.972453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 545/1095] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:47.977334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ce08-0d1e-43cf-a88f-6b676d646262 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.023264 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481cb7c-ab1c-4d0f-b571-5df76c3193a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.024754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481cb7c-ab1c-4d0f-b571-5df76c3193a5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.073924 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ce08-0d1e-43cf-a88f-6b676d646262 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.105685 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.106352 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.106637 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.106921 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.107667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:48.108005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.109878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.117808 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 546/1096] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:48.119796 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 551/1097] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:43:48.123451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.125644 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481cb7c-ab1c-4d0f-b571-5df76c3193a5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.219230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807a25a-c632-42f8-9dc6-a4f88e1c7aa6 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.220700 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481cb7c-ab1c-4d0f-b571-5df76c3193a5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.253257 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef474c-f72f-4253-a354-7533c17e7cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.254235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef474c-f72f-4253-a354-7533c17e7cbe None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.254365 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.254642 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef474c-f72f-4253-a354-7533c17e7cbe None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.254979 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef474c-f72f-4253-a354-7533c17e7cbe None admin] PATH_INFO: `/v3/users/8e7913c068ce48caae44d69f68ec3262` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.255081 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.255300 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.255585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.256243 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef474c-f72f-4253-a354-7533c17e7cbe None admin] RBAC: Authorizing `identity:get_user(user_id=8e7913c068ce48caae44d69f68ec3262)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.257687 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef474c-f72f-4253-a354-7533c17e7cbe None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.259396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 547/1098] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/users/8e7913c068ce48caae44d69f68ec3262 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:48.264998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef474c-f72f-4253-a354-7533c17e7cbe None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.265862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.267314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:43:48.285266 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:48.286538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:48.288063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:43:48.288063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:43:48.288063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:43:48.288063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:48.288063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 552/1099] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:48.292021 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.362261 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef474c-f72f-4253-a354-7533c17e7cbe None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.385737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda406-5a89-4aeb-a15b-1e1deb131f6b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.394234 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e939f0-7ef5-420b-b381-635a79afd058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.394886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e939f0-7ef5-420b-b381-635a79afd058 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.395175 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e939f0-7ef5-420b-b381-635a79afd058 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.395456 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e939f0-7ef5-420b-b381-635a79afd058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.417979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.418631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.418914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.419185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.419929 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:48.420231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.422174 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.432989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 553/1100] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:48.439092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.462133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e939f0-7ef5-420b-b381-635a79afd058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.463609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e939f0-7ef5-420b-b381-635a79afd058 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.532281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489bf2a-10d2-4e13-ad4d-1914de38abce None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.557914 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 548/1101] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:43:48.564620 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e939f0-7ef5-420b-b381-635a79afd058 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.565078 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.565877 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.566163 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.566439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.573142 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.574598 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:43:48.589230 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:43:48.595284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 554/1102] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:43:48.596527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.658535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e939f0-7ef5-420b-b381-635a79afd058 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.691514 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0304603-15a1-489e-997d-4decd1b3a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.692397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0304603-15a1-489e-997d-4decd1b3a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.692680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0304603-15a1-489e-997d-4decd1b3a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.692955 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0304603-15a1-489e-997d-4decd1b3a5c4 None admin] PATH_INFO: `/v3/projects/3403cd89968a4fdb94ad3d468d7ae905` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.693108 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd714d9-4600-494a-9b0a-1216ca948d05 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.694126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0304603-15a1-489e-997d-4decd1b3a5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=3403cd89968a4fdb94ad3d468d7ae905)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.695534 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0304603-15a1-489e-997d-4decd1b3a5c4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.697258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 549/1103] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/projects/3403cd89968a4fdb94ad3d468d7ae905 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:48.703213 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0304603-15a1-489e-997d-4decd1b3a5c4 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.726360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.727020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.727306 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.727582 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.728408 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:48.728718 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.730143 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.743879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 555/1104] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:48.750604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:48.800883 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0304603-15a1-489e-997d-4decd1b3a5c4 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.835132 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36111740-be08-4e37-ad3a-bcefd5557a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.835815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111740-be08-4e37-ad3a-bcefd5557a3d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.836106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111740-be08-4e37-ad3a-bcefd5557a3d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.836384 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36111740-be08-4e37-ad3a-bcefd5557a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.837224 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36111740-be08-4e37-ad3a-bcefd5557a3d None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=3403cd89968a4fdb94ad3d468d7ae905, user.id=8e7913c068ce48caae44d69f68ec3262) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:48.837540 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36111740-be08-4e37-ad3a-bcefd5557a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.838971 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36111740-be08-4e37-ad3a-bcefd5557a3d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.844905 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 550/1105] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/role_assignments?user.id=8e7913c068ce48caae44d69f68ec3262&scope.project.id=3403cd89968a4fdb94ad3d468d7ae905&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:48.845847 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256c368-eb67-4deb-86d5-c21a52b2c44f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:48.883360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27fab9-30ae-420c-9f10-3ea785723302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:48.884079 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27fab9-30ae-420c-9f10-3ea785723302 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:48.884370 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27fab9-30ae-420c-9f10-3ea785723302 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:48.884650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27fab9-30ae-420c-9f10-3ea785723302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:48.885511 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27fab9-30ae-420c-9f10-3ea785723302 None admin] RBAC: Adding query filter params (role.id=c20278094aa143f3af7382f504c8116d, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=8bc210c9b3f94f09b32127dc754a2094) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:48.885831 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27fab9-30ae-420c-9f10-3ea785723302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:48.887322 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27fab9-30ae-420c-9f10-3ea785723302 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:48.894515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 556/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:48 2022] GET /identity/v3/role_assignments?user.id=8bc210c9b3f94f09b32127dc754a2094&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=c20278094aa143f3af7382f504c8116d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:51.140503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ecb42-b967-4762-82f7-33168b60a1cc None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:51.141103 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ecb42-b967-4762-82f7-33168b60a1cc None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:51.141103 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ecb42-b967-4762-82f7-33168b60a1cc None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:51.142430 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 551/1107] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:51.147661 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5874848-c359-437f-9f45-fd7a1144fcb3 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:51.148104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5874848-c359-437f-9f45-fd7a1144fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:51.148252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5874848-c359-437f-9f45-fd7a1144fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:51.164513 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-a5874848-c359-437f-9f45-fd7a1144fcb3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:51.165686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-a5874848-c359-437f-9f45-fd7a1144fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:51.230790 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 557/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:43:51.256806 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ecb42-b967-4762-82f7-33168b60a1cc None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:51.354722 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ecb42-b967-4762-82f7-33168b60a1cc None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:51.387364 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0eccf7-3fa2-4d2a-9918-6524a5f7d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:51.388184 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0eccf7-3fa2-4d2a-9918-6524a5f7d526 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:51.388474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0eccf7-3fa2-4d2a-9918-6524a5f7d526 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:51.388754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0eccf7-3fa2-4d2a-9918-6524a5f7d526 None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:51.390146 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0eccf7-3fa2-4d2a-9918-6524a5f7d526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:51.391639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0eccf7-3fa2-4d2a-9918-6524a5f7d526 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:51.393219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 552/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:51.398858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5874848-c359-437f-9f45-fd7a1144fcb3 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:51.493269 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5874848-c359-437f-9f45-fd7a1144fcb3 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:51.524673 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d3634-d737-4f0f-8580-abba0f97a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:51.525324 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3634-d737-4f0f-8580-abba0f97a66b None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:51.525604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3634-d737-4f0f-8580-abba0f97a66b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:51.525879 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3634-d737-4f0f-8580-abba0f97a66b None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:51.526579 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d3634-d737-4f0f-8580-abba0f97a66b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:51.528025 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d3634-d737-4f0f-8580-abba0f97a66b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:51.547753 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 558/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:43:51 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:43:53.823039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdacb0-d7fe-4b00-b839-5f6f85484eee None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:53.823641 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdacb0-d7fe-4b00-b839-5f6f85484eee None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:53.823641 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdacb0-d7fe-4b00-b839-5f6f85484eee None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:53.824986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 553/1111] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:53.830298 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db7bed-f5d7-46f2-8ed8-1685d66970e1 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:53.830737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db7bed-f5d7-46f2-8ed8-1685d66970e1 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:53.830873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db7bed-f5d7-46f2-8ed8-1685d66970e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:53.847736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-76db7bed-f5d7-46f2-8ed8-1685d66970e1 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:53.848955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-76db7bed-f5d7-46f2-8ed8-1685d66970e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:53.913234 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 559/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:53.936610 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdacb0-d7fe-4b00-b839-5f6f85484eee None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:54.035583 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdacb0-d7fe-4b00-b839-5f6f85484eee None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:54.069819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab1d9e-6ea6-4815-b666-249671bfdbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:54.070673 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab1d9e-6ea6-4815-b666-249671bfdbe6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:54.070963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab1d9e-6ea6-4815-b666-249671bfdbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:54.071235 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab1d9e-6ea6-4815-b666-249671bfdbe6 None admin] PATH_INFO: `/v3/roles/c0ef3a26cb124115962df9d8c742f9f1` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:54.072742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab1d9e-6ea6-4815-b666-249671bfdbe6 None admin] RBAC: Authorizing `identity:get_role(role_id=c0ef3a26cb124115962df9d8c742f9f1)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:54.074220 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab1d9e-6ea6-4815-b666-249671bfdbe6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:54.075537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 554/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:43:53 2022] GET /identity/v3/roles/c0ef3a26cb124115962df9d8c742f9f1 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:54.081489 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db7bed-f5d7-46f2-8ed8-1685d66970e1 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:54.177136 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db7bed-f5d7-46f2-8ed8-1685d66970e1 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:54.211231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd789db-99f6-4a95-9268-0c700c994226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:54.212129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd789db-99f6-4a95-9268-0c700c994226 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:54.212417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd789db-99f6-4a95-9268-0c700c994226 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:54.212693 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd789db-99f6-4a95-9268-0c700c994226 None admin] PATH_INFO: `/v3/users/fa66eb2775a040998d362d191c8b4915` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:54.226146 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd789db-99f6-4a95-9268-0c700c994226 None admin] RBAC: Authorizing `identity:get_user(user_id=fa66eb2775a040998d362d191c8b4915)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:54.227594 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd789db-99f6-4a95-9268-0c700c994226 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:54.229273 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 560/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:43:54 2022] GET /identity/v3/users/fa66eb2775a040998d362d191c8b4915 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:54.235795 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab1d9e-6ea6-4815-b666-249671bfdbe6 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:54.333058 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab1d9e-6ea6-4815-b666-249671bfdbe6 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:54.365946 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241e56-68e5-4d38-8eb0-68fa2cfc743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:54.366587 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241e56-68e5-4d38-8eb0-68fa2cfc743b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:54.366873 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241e56-68e5-4d38-8eb0-68fa2cfc743b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:54.367149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241e56-68e5-4d38-8eb0-68fa2cfc743b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:54.431232 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71241e56-68e5-4d38-8eb0-68fa2cfc743b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:54.432689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71241e56-68e5-4d38-8eb0-68fa2cfc743b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:54.525078 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 555/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:43:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:43:54.531000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd789db-99f6-4a95-9268-0c700c994226 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:54.626429 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd789db-99f6-4a95-9268-0c700c994226 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:54.658987 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac992d60-f9ea-4162-a200-770d8a310b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:54.659858 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992d60-f9ea-4162-a200-770d8a310b6e None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:54.660145 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992d60-f9ea-4162-a200-770d8a310b6e None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:54.660422 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac992d60-f9ea-4162-a200-770d8a310b6e None admin] PATH_INFO: `/v3/projects/3403cd89968a4fdb94ad3d468d7ae905` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:54.661585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac992d60-f9ea-4162-a200-770d8a310b6e None admin] RBAC: Authorizing `identity:get_project(project_id=3403cd89968a4fdb94ad3d468d7ae905)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:54.663016 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac992d60-f9ea-4162-a200-770d8a310b6e None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:54.664720 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 561/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:43:54 2022] GET /identity/v3/projects/3403cd89968a4fdb94ad3d468d7ae905 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:43:54.671227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241e56-68e5-4d38-8eb0-68fa2cfc743b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:54.765828 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241e56-68e5-4d38-8eb0-68fa2cfc743b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:54.798093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0c34e-e58b-4607-9bb2-14075f59ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:54.798741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0c34e-e58b-4607-9bb2-14075f59ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:54.799025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0c34e-e58b-4607-9bb2-14075f59ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:54.799298 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0c34e-e58b-4607-9bb2-14075f59ffc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:54.800156 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0c34e-e58b-4607-9bb2-14075f59ffc0 None admin] RBAC: Adding query filter params (role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=3403cd89968a4fdb94ad3d468d7ae905, user.id=fa66eb2775a040998d362d191c8b4915) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:43:54.800465 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0c34e-e58b-4607-9bb2-14075f59ffc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:54.801876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0c34e-e58b-4607-9bb2-14075f59ffc0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:54.807114 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 556/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:43:54 2022] GET /identity/v3/role_assignments?user.id=fa66eb2775a040998d362d191c8b4915&scope.project.id=3403cd89968a4fdb94ad3d468d7ae905&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:57.026080 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58ea40-bb00-4d78-97c8-54605186bbed None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:57.026665 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58ea40-bb00-4d78-97c8-54605186bbed None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:57.026665 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58ea40-bb00-4d78-97c8-54605186bbed None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:57.028035 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 562/1118] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:57.033285 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e812f0d-c7d7-4775-8dd1-e515f68e7ca3 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:57.033730 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e812f0d-c7d7-4775-8dd1-e515f68e7ca3 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:57.033840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e812f0d-c7d7-4775-8dd1-e515f68e7ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:57.051190 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-4e812f0d-c7d7-4775-8dd1-e515f68e7ca3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:57.052404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-4e812f0d-c7d7-4775-8dd1-e515f68e7ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:43:57.117273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 557/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:43:57.139983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58ea40-bb00-4d78-97c8-54605186bbed None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:57.236835 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58ea40-bb00-4d78-97c8-54605186bbed None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:57.269043 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d75d1f-f5b9-40b8-ba06-1b2d1d933739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:57.269885 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75d1f-f5b9-40b8-ba06-1b2d1d933739 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:57.270167 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75d1f-f5b9-40b8-ba06-1b2d1d933739 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:57.270442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75d1f-f5b9-40b8-ba06-1b2d1d933739 None admin] PATH_INFO: `/v3/roles/c0ef3a26cb124115962df9d8c742f9f1` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:57.271941 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d75d1f-f5b9-40b8-ba06-1b2d1d933739 None admin] RBAC: Authorizing `identity:get_role(role_id=c0ef3a26cb124115962df9d8c742f9f1)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:57.273317 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d75d1f-f5b9-40b8-ba06-1b2d1d933739 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:57.274677 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 563/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:43:57 2022] GET /identity/v3/roles/c0ef3a26cb124115962df9d8c742f9f1 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:57.281077 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e812f0d-c7d7-4775-8dd1-e515f68e7ca3 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:57.376676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e812f0d-c7d7-4775-8dd1-e515f68e7ca3 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:57.408771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b8ad1-2781-43ed-803d-e7d194d40f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:57.409623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8ad1-2781-43ed-803d-e7d194d40f62 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:57.409906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8ad1-2781-43ed-803d-e7d194d40f62 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:57.410182 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b8ad1-2781-43ed-803d-e7d194d40f62 None admin] PATH_INFO: `/v3/users/fa66eb2775a040998d362d191c8b4915` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:57.411358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b8ad1-2781-43ed-803d-e7d194d40f62 None admin] RBAC: Authorizing `identity:get_user(user_id=fa66eb2775a040998d362d191c8b4915)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:57.412814 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b8ad1-2781-43ed-803d-e7d194d40f62 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:57.414416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 558/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:43:57 2022] GET /identity/v3/users/fa66eb2775a040998d362d191c8b4915 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:57.420148 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d75d1f-f5b9-40b8-ba06-1b2d1d933739 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:57.515573 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d75d1f-f5b9-40b8-ba06-1b2d1d933739 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:57.548451 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2a5f1-105a-4cea-8e27-8a7f38618520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:57.549237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a5f1-105a-4cea-8e27-8a7f38618520 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:57.549525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a5f1-105a-4cea-8e27-8a7f38618520 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:57.549804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a5f1-105a-4cea-8e27-8a7f38618520 None admin] PATH_INFO: `/v3/projects/3403cd89968a4fdb94ad3d468d7ae905` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:57.550985 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2a5f1-105a-4cea-8e27-8a7f38618520 None admin] RBAC: Authorizing `identity:get_project(project_id=3403cd89968a4fdb94ad3d468d7ae905)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:57.552451 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2a5f1-105a-4cea-8e27-8a7f38618520 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:57.554126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 564/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:43:57 2022] GET /identity/v3/projects/3403cd89968a4fdb94ad3d468d7ae905 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:43:57.559899 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b8ad1-2781-43ed-803d-e7d194d40f62 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:43:57.654856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b8ad1-2781-43ed-803d-e7d194d40f62 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:43:57.688149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa587c66-b1c6-4a13-b760-a96fef447f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:43:57.689015 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587c66-b1c6-4a13-b760-a96fef447f7f None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:57.689297 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587c66-b1c6-4a13-b760-a96fef447f7f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:57.689571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587c66-b1c6-4a13-b760-a96fef447f7f None admin] PATH_INFO: `/v3/projects/3403cd89968a4fdb94ad3d468d7ae905/users/fa66eb2775a040998d362d191c8b4915/roles/c0ef3a26cb124115962df9d8c742f9f1` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:57.691730 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa587c66-b1c6-4a13-b760-a96fef447f7f None admin] RBAC: Authorizing `identity:create_grant(project_id=3403cd89968a4fdb94ad3d468d7ae905, user_id=fa66eb2775a040998d362d191c8b4915, role_id=c0ef3a26cb124115962df9d8c742f9f1)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:43:57.693181 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa587c66-b1c6-4a13-b760-a96fef447f7f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:43:57.706219 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 559/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:43:57 2022] PUT /identity/v3/projects/3403cd89968a4fdb94ad3d468d7ae905/users/fa66eb2775a040998d362d191c8b4915/roles/c0ef3a26cb124115962df9d8c742f9f1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:43:59.925604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e82bc-f89b-48eb-93d7-a5f2099780fd None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:59.926191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e82bc-f89b-48eb-93d7-a5f2099780fd None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:59.926191 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e82bc-f89b-48eb-93d7-a5f2099780fd None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:59.927537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 565/1124] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:43:59.932840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c2c0-7afc-492a-9ce9-090d5ac2c2d8 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:43:59.933257 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c2c0-7afc-492a-9ce9-090d5ac2c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:43:59.933404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787c2c0-7afc-492a-9ce9-090d5ac2c2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:43:59.949907 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-f787c2c0-7afc-492a-9ce9-090d5ac2c2d8 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:43:59.951097 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-f787c2c0-7afc-492a-9ce9-090d5ac2c2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:00.014658 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 560/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:43:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:00.038585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e82bc-f89b-48eb-93d7-a5f2099780fd None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:00.135945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e82bc-f89b-48eb-93d7-a5f2099780fd None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:00.168743 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0b6b-e77f-4429-83ce-1561b62055a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:00.169596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0b6b-e77f-4429-83ce-1561b62055a4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:00.169884 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0b6b-e77f-4429-83ce-1561b62055a4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:00.170206 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0b6b-e77f-4429-83ce-1561b62055a4 None admin] PATH_INFO: `/v3/roles/c0ef3a26cb124115962df9d8c742f9f1` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:00.171730 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c0b6b-e77f-4429-83ce-1561b62055a4 None admin] RBAC: Authorizing `identity:get_role(role_id=c0ef3a26cb124115962df9d8c742f9f1)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:00.173362 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c0b6b-e77f-4429-83ce-1561b62055a4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:00.174517 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 566/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:44:00 2022] GET /identity/v3/roles/c0ef3a26cb124115962df9d8c742f9f1 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:00.180291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787c2c0-7afc-492a-9ce9-090d5ac2c2d8 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:00.275131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787c2c0-7afc-492a-9ce9-090d5ac2c2d8 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:00.307990 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2740803-7dcf-4abb-ab1e-19c76db7cce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:00.308857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2740803-7dcf-4abb-ab1e-19c76db7cce4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:00.309144 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2740803-7dcf-4abb-ab1e-19c76db7cce4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:00.309423 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2740803-7dcf-4abb-ab1e-19c76db7cce4 None admin] PATH_INFO: `/v3/users/fa66eb2775a040998d362d191c8b4915` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:00.310602 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2740803-7dcf-4abb-ab1e-19c76db7cce4 None admin] RBAC: Authorizing `identity:get_user(user_id=fa66eb2775a040998d362d191c8b4915)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:00.312635 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2740803-7dcf-4abb-ab1e-19c76db7cce4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:00.314244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 561/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:44:00 2022] GET /identity/v3/users/fa66eb2775a040998d362d191c8b4915 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:00.319991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0b6b-e77f-4429-83ce-1561b62055a4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:00.415351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0b6b-e77f-4429-83ce-1561b62055a4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:00.448188 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ae32-286e-4f33-b6b8-3ee7e5e7a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:00.448772 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ae32-286e-4f33-b6b8-3ee7e5e7a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:00.449061 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ae32-286e-4f33-b6b8-3ee7e5e7a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:00.449341 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407ae32-286e-4f33-b6b8-3ee7e5e7a4e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:00.512917 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ae32-286e-4f33-b6b8-3ee7e5e7a4e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:00.514969 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407ae32-286e-4f33-b6b8-3ee7e5e7a4e3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:00.607896 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 567/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:44:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:44:00.613998 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2740803-7dcf-4abb-ab1e-19c76db7cce4 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:00.711442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2740803-7dcf-4abb-ab1e-19c76db7cce4 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:00.744031 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779c576-d422-4fc0-80fd-0b22277705f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:00.744886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c576-d422-4fc0-80fd-0b22277705f6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:00.745172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c576-d422-4fc0-80fd-0b22277705f6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:00.745453 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779c576-d422-4fc0-80fd-0b22277705f6 None admin] PATH_INFO: `/v3/projects/3403cd89968a4fdb94ad3d468d7ae905` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:00.746633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779c576-d422-4fc0-80fd-0b22277705f6 None admin] RBAC: Authorizing `identity:get_project(project_id=3403cd89968a4fdb94ad3d468d7ae905)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:00.748088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779c576-d422-4fc0-80fd-0b22277705f6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:00.750519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 562/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:44:00 2022] GET /identity/v3/projects/3403cd89968a4fdb94ad3d468d7ae905 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:00.756567 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ae32-286e-4f33-b6b8-3ee7e5e7a4e3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:00.849438 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407ae32-286e-4f33-b6b8-3ee7e5e7a4e3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:00.881708 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff76aa-256a-4636-8cd7-0a210a000ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:00.882339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff76aa-256a-4636-8cd7-0a210a000ef1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:00.882620 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff76aa-256a-4636-8cd7-0a210a000ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:00.882895 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff76aa-256a-4636-8cd7-0a210a000ef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:00.883707 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff76aa-256a-4636-8cd7-0a210a000ef1 None admin] RBAC: Adding query filter params (role.id=c0ef3a26cb124115962df9d8c742f9f1, scope.project.id=3403cd89968a4fdb94ad3d468d7ae905, user.id=fa66eb2775a040998d362d191c8b4915) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:00.884046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff76aa-256a-4636-8cd7-0a210a000ef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:00.885468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff76aa-256a-4636-8cd7-0a210a000ef1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:00.892878 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 568/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:44:00 2022] GET /identity/v3/role_assignments?user.id=fa66eb2775a040998d362d191c8b4915&scope.project.id=3403cd89968a4fdb94ad3d468d7ae905&role.id=c0ef3a26cb124115962df9d8c742f9f1 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:03.140509 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7514c-0658-4bba-a95e-8d776156f4a4 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:03.141099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7514c-0658-4bba-a95e-8d776156f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:03.141099 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7514c-0658-4bba-a95e-8d776156f4a4 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:03.142449 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 563/1131] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:03.147654 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5e1cd-2298-4376-9c49-e4bd841b0b9e None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:03.148139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5e1cd-2298-4376-9c49-e4bd841b0b9e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:03.148256 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5e1cd-2298-4376-9c49-e4bd841b0b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:03.164624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-fff5e1cd-2298-4376-9c49-e4bd841b0b9e None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:03.165797 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-fff5e1cd-2298-4376-9c49-e4bd841b0b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:03.230577 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 569/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:03.255452 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7514c-0658-4bba-a95e-8d776156f4a4 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:03.354445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7514c-0658-4bba-a95e-8d776156f4a4 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:03.387150 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42c2b0-1a29-4707-840e-5c73ce4683fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:03.387989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c2b0-1a29-4707-840e-5c73ce4683fd None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:03.388280 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c2b0-1a29-4707-840e-5c73ce4683fd None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:03.388561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c2b0-1a29-4707-840e-5c73ce4683fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:03.389872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42c2b0-1a29-4707-840e-5c73ce4683fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:03.391357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42c2b0-1a29-4707-840e-5c73ce4683fd None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:03.392957 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 564/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:44:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:03.398662 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5e1cd-2298-4376-9c49-e4bd841b0b9e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:03.492632 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5e1cd-2298-4376-9c49-e4bd841b0b9e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:03.523882 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af92a1-bb8b-49c4-9351-dddb2cda0722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:03.524529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af92a1-bb8b-49c4-9351-dddb2cda0722 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:03.524809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af92a1-bb8b-49c4-9351-dddb2cda0722 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:03.525081 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af92a1-bb8b-49c4-9351-dddb2cda0722 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:03.525776 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af92a1-bb8b-49c4-9351-dddb2cda0722 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:03.527198 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af92a1-bb8b-49c4-9351-dddb2cda0722 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:03.551960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 570/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:44:03 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:44:05.796397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea15cc-749c-4bf8-b9f8-6aeea27da3d9 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:05.797021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea15cc-749c-4bf8-b9f8-6aeea27da3d9 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:05.797126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea15cc-749c-4bf8-b9f8-6aeea27da3d9 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:05.798468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 565/1135] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:05.804476 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e49c8-cf2b-4a99-966a-981987c75832 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:05.804907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e49c8-cf2b-4a99-966a-981987c75832 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:05.805051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e49c8-cf2b-4a99-966a-981987c75832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:05.821880 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-af4e49c8-cf2b-4a99-966a-981987c75832 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:05.823075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-af4e49c8-cf2b-4a99-966a-981987c75832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:05.888477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 571/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:05.914546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea15cc-749c-4bf8-b9f8-6aeea27da3d9 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:06.011180 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea15cc-749c-4bf8-b9f8-6aeea27da3d9 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:06.044407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76b9de-a2b9-4f8e-84be-83a4d47119cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:06.045322 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76b9de-a2b9-4f8e-84be-83a4d47119cc None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:06.045601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76b9de-a2b9-4f8e-84be-83a4d47119cc None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:06.045874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76b9de-a2b9-4f8e-84be-83a4d47119cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:06.047102 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76b9de-a2b9-4f8e-84be-83a4d47119cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:06.048510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76b9de-a2b9-4f8e-84be-83a4d47119cc None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:06.050116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 566/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:44:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:06.055826 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e49c8-cf2b-4a99-966a-981987c75832 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:06.155612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e49c8-cf2b-4a99-966a-981987c75832 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:06.188908 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250e0a0-7375-42c1-bd5e-60d4401ae296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:06.189588 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250e0a0-7375-42c1-bd5e-60d4401ae296 None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:06.189878 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250e0a0-7375-42c1-bd5e-60d4401ae296 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:06.190159 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250e0a0-7375-42c1-bd5e-60d4401ae296 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:06.190875 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250e0a0-7375-42c1-bd5e-60d4401ae296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:06.192364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250e0a0-7375-42c1-bd5e-60d4401ae296 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:06.212060 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 572/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:44:06 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:44:08.494455 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b38c1-de64-43e9-ad3e-2661765c7d07 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:08.495032 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b38c1-de64-43e9-ad3e-2661765c7d07 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:08.495032 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b38c1-de64-43e9-ad3e-2661765c7d07 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:08.496419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 567/1139] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:08.502484 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3030d-cb61-4cec-91b2-5048a8bcdcaa None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:08.502918 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3030d-cb61-4cec-91b2-5048a8bcdcaa None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:08.503029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3030d-cb61-4cec-91b2-5048a8bcdcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:08.522024 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-bef3030d-cb61-4cec-91b2-5048a8bcdcaa None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:08.523202 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-bef3030d-cb61-4cec-91b2-5048a8bcdcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:08.593612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 573/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:08.618026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b38c1-de64-43e9-ad3e-2661765c7d07 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:08.717645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b38c1-de64-43e9-ad3e-2661765c7d07 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:08.753420 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678488a4-d5ac-4609-95b9-fee80a203ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:08.754151 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678488a4-d5ac-4609-95b9-fee80a203ad5 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:08.754433 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678488a4-d5ac-4609-95b9-fee80a203ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:08.754707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678488a4-d5ac-4609-95b9-fee80a203ad5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:08.765253 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678488a4-d5ac-4609-95b9-fee80a203ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-678488a4-d5ac-4609-95b9-fee80a203ad5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:44:08.772867 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:44:08.774131 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:44:08.775510 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 568/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:44:08.780352 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3030d-cb61-4cec-91b2-5048a8bcdcaa None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:08.877392 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3030d-cb61-4cec-91b2-5048a8bcdcaa None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:08.909247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:08.909912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:08.910199 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:08.910479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:08.911222 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:08.911529 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:08.912952 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:08.920777 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 574/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:08.927323 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678488a4-d5ac-4609-95b9-fee80a203ad5 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:09.023386 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678488a4-d5ac-4609-95b9-fee80a203ad5 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:09.054812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7283343-a56a-4e99-bea7-f21b4c0e7715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:09.055663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7283343-a56a-4e99-bea7-f21b4c0e7715 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:09.055968 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7283343-a56a-4e99-bea7-f21b4c0e7715 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:09.056242 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7283343-a56a-4e99-bea7-f21b4c0e7715 None admin] PATH_INFO: `/v3/users/b3333642446d4905ac8659b52eb2617f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:09.069656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7283343-a56a-4e99-bea7-f21b4c0e7715 None admin] RBAC: Authorizing `identity:get_user(user_id=b3333642446d4905ac8659b52eb2617f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:09.071095 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7283343-a56a-4e99-bea7-f21b4c0e7715 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:09.072763 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 569/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:44:08 2022] GET /identity/v3/users/b3333642446d4905ac8659b52eb2617f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:09.078621 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:09.181121 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66996de-45e6-4fcd-b207-306aed56878d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:09.213485 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4f2d5-40f2-4643-b7bd-ff537118fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:09.214124 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4f2d5-40f2-4643-b7bd-ff537118fc94 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:09.214407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4f2d5-40f2-4643-b7bd-ff537118fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:09.214681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4f2d5-40f2-4643-b7bd-ff537118fc94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:09.277593 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4f2d5-40f2-4643-b7bd-ff537118fc94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:09.278970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4f2d5-40f2-4643-b7bd-ff537118fc94 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:09.371423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 575/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:44:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:44:09.377942 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7283343-a56a-4e99-bea7-f21b4c0e7715 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:09.473469 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7283343-a56a-4e99-bea7-f21b4c0e7715 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:09.505812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46dcfe-4f49-4ad4-9a6d-9c7190080ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:09.506669 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46dcfe-4f49-4ad4-9a6d-9c7190080ce9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:09.506956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46dcfe-4f49-4ad4-9a6d-9c7190080ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:09.507238 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46dcfe-4f49-4ad4-9a6d-9c7190080ce9 None admin] PATH_INFO: `/v3/projects/aea04e6cf7654b58abce1598945dd570` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:09.508432 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46dcfe-4f49-4ad4-9a6d-9c7190080ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=aea04e6cf7654b58abce1598945dd570)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:09.509856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46dcfe-4f49-4ad4-9a6d-9c7190080ce9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:09.511537 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 570/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:44:09 2022] GET /identity/v3/projects/aea04e6cf7654b58abce1598945dd570 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:09.518102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4f2d5-40f2-4643-b7bd-ff537118fc94 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:09.611338 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4f2d5-40f2-4643-b7bd-ff537118fc94 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:09.643389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0a5d3-435a-498d-a62d-be377ecf28ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:09.644050 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a5d3-435a-498d-a62d-be377ecf28ed None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:09.644334 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a5d3-435a-498d-a62d-be377ecf28ed None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:09.644614 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a5d3-435a-498d-a62d-be377ecf28ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:09.645434 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0a5d3-435a-498d-a62d-be377ecf28ed None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=aea04e6cf7654b58abce1598945dd570, user.id=b3333642446d4905ac8659b52eb2617f) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:09.645745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0a5d3-435a-498d-a62d-be377ecf28ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:09.647162 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0a5d3-435a-498d-a62d-be377ecf28ed None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:09.652387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 576/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:44:09 2022] GET /identity/v3/role_assignments?user.id=b3333642446d4905ac8659b52eb2617f&scope.project.id=aea04e6cf7654b58abce1598945dd570&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:11.881918 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835366ab-50d5-4194-8c58-9a31c93becfe None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:11.882487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835366ab-50d5-4194-8c58-9a31c93becfe None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:11.882487 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835366ab-50d5-4194-8c58-9a31c93becfe None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:11.883859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 571/1147] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:11.889154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc43b-371a-4e44-bb3a-6b234256c32e None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:11.890079 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc43b-371a-4e44-bb3a-6b234256c32e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:11.890278 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc43b-371a-4e44-bb3a-6b234256c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:11.907209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-3aafc43b-371a-4e44-bb3a-6b234256c32e None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:11.908420 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-3aafc43b-371a-4e44-bb3a-6b234256c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:11.973440 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 577/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:11.995651 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835366ab-50d5-4194-8c58-9a31c93becfe None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:12.094396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835366ab-50d5-4194-8c58-9a31c93becfe None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:12.126521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba818d7-5ece-4e13-bc4d-e910ae9a8cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:12.127303 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba818d7-5ece-4e13-bc4d-e910ae9a8cce None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:12.127583 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba818d7-5ece-4e13-bc4d-e910ae9a8cce None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:12.127885 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba818d7-5ece-4e13-bc4d-e910ae9a8cce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:12.137580 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba818d7-5ece-4e13-bc4d-e910ae9a8cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-9ba818d7-5ece-4e13-bc4d-e910ae9a8cce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:44:12.145521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:44:12.146845 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:44:12.148227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 572/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:44:12.152634 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc43b-371a-4e44-bb3a-6b234256c32e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:12.248395 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc43b-371a-4e44-bb3a-6b234256c32e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:12.281619 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:12.282282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:12.282569 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:12.282848 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:12.283597 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:12.283940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:12.285323 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:12.293201 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 578/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:12.299187 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba818d7-5ece-4e13-bc4d-e910ae9a8cce None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:12.394377 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba818d7-5ece-4e13-bc4d-e910ae9a8cce None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:12.426376 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6efe-8780-4ca8-864d-e209c922ea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:12.427239 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6efe-8780-4ca8-864d-e209c922ea2e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:12.427521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6efe-8780-4ca8-864d-e209c922ea2e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:12.427819 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6efe-8780-4ca8-864d-e209c922ea2e None admin] PATH_INFO: `/v3/users/b3333642446d4905ac8659b52eb2617f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:12.428988 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e6efe-8780-4ca8-864d-e209c922ea2e None admin] RBAC: Authorizing `identity:get_user(user_id=b3333642446d4905ac8659b52eb2617f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:12.430399 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e6efe-8780-4ca8-864d-e209c922ea2e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:12.432036 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 573/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:44:12 2022] GET /identity/v3/users/b3333642446d4905ac8659b52eb2617f => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:12.438490 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:12.535290 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a81d-d1d0-4017-a7db-fa5add994a37 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:12.567620 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e9d78-3599-4de1-b715-60bcd6fb3be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:12.568497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e9d78-3599-4de1-b715-60bcd6fb3be0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:12.568785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e9d78-3599-4de1-b715-60bcd6fb3be0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:12.569063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e9d78-3599-4de1-b715-60bcd6fb3be0 None admin] PATH_INFO: `/v3/projects/aea04e6cf7654b58abce1598945dd570` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:12.570247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e9d78-3599-4de1-b715-60bcd6fb3be0 None admin] RBAC: Authorizing `identity:get_project(project_id=aea04e6cf7654b58abce1598945dd570)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:12.571679 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e9d78-3599-4de1-b715-60bcd6fb3be0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:12.573379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 579/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:44:12 2022] GET /identity/v3/projects/aea04e6cf7654b58abce1598945dd570 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:44:12.579490 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6efe-8780-4ca8-864d-e209c922ea2e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:12.675750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6efe-8780-4ca8-864d-e209c922ea2e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:12.707313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4efe41-39b7-420e-a45f-5be2f91b09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:12.708212 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efe41-39b7-420e-a45f-5be2f91b09df None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:12.708494 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efe41-39b7-420e-a45f-5be2f91b09df None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:12.708769 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4efe41-39b7-420e-a45f-5be2f91b09df None admin] PATH_INFO: `/v3/projects/aea04e6cf7654b58abce1598945dd570/users/b3333642446d4905ac8659b52eb2617f/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:12.710683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4efe41-39b7-420e-a45f-5be2f91b09df None admin] RBAC: Authorizing `identity:create_grant(project_id=aea04e6cf7654b58abce1598945dd570, user_id=b3333642446d4905ac8659b52eb2617f, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:12.712125 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4efe41-39b7-420e-a45f-5be2f91b09df None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:12.725977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 574/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:44:12 2022] PUT /identity/v3/projects/aea04e6cf7654b58abce1598945dd570/users/b3333642446d4905ac8659b52eb2617f/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:44:14.988983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90f6cf-c023-4b58-9d35-cc7b452bf245 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:14.989650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90f6cf-c023-4b58-9d35-cc7b452bf245 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:14.989650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90f6cf-c023-4b58-9d35-cc7b452bf245 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:14.990914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 580/1154] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:14.996126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47ef2-5980-4597-a11e-c81659bd046c None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:14.996597 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47ef2-5980-4597-a11e-c81659bd046c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:14.996710 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a47ef2-5980-4597-a11e-c81659bd046c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:15.013121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-c6a47ef2-5980-4597-a11e-c81659bd046c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:15.014326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-c6a47ef2-5980-4597-a11e-c81659bd046c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:15.079923 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 575/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:15.103593 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90f6cf-c023-4b58-9d35-cc7b452bf245 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:15.203970 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90f6cf-c023-4b58-9d35-cc7b452bf245 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:15.236643 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe3ae-5a73-4146-82bc-ce3709d94a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:15.237431 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe3ae-5a73-4146-82bc-ce3709d94a48 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:15.237719 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe3ae-5a73-4146-82bc-ce3709d94a48 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:15.238000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe3ae-5a73-4146-82bc-ce3709d94a48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:15.247892 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebe3ae-5a73-4146-82bc-ce3709d94a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-3eebe3ae-5a73-4146-82bc-ce3709d94a48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:44:15.256219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:44:15.257763 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:44:15.259069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 581/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:44:15.263445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a47ef2-5980-4597-a11e-c81659bd046c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:15.358818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a47ef2-5980-4597-a11e-c81659bd046c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:15.392116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:15.392769 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:15.393056 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:15.393336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:15.394090 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:15.394398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:15.395758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:15.403531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 576/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:15.409338 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe3ae-5a73-4146-82bc-ce3709d94a48 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:15.503490 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe3ae-5a73-4146-82bc-ce3709d94a48 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:15.534909 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719462d-3060-4835-afc5-14e89da1a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:15.535847 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719462d-3060-4835-afc5-14e89da1a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:15.536069 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719462d-3060-4835-afc5-14e89da1a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:15.536341 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719462d-3060-4835-afc5-14e89da1a7a0 None admin] PATH_INFO: `/v3/users/b3333642446d4905ac8659b52eb2617f` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:15.537509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719462d-3060-4835-afc5-14e89da1a7a0 None admin] RBAC: Authorizing `identity:get_user(user_id=b3333642446d4905ac8659b52eb2617f)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:15.538934 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719462d-3060-4835-afc5-14e89da1a7a0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:15.540559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 582/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:44:15 2022] GET /identity/v3/users/b3333642446d4905ac8659b52eb2617f => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:15.546511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:15.643021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253da73-7e5f-429b-b80e-39450afb8172 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:15.675324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358321c-a4de-4f36-b0ea-32a15e812eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:15.675992 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358321c-a4de-4f36-b0ea-32a15e812eaf None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:15.676284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358321c-a4de-4f36-b0ea-32a15e812eaf None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:15.676567 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358321c-a4de-4f36-b0ea-32a15e812eaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:15.741244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358321c-a4de-4f36-b0ea-32a15e812eaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:15.742689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358321c-a4de-4f36-b0ea-32a15e812eaf None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:15.837070 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 577/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:44:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:44:15.843023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719462d-3060-4835-afc5-14e89da1a7a0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:15.939183 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719462d-3060-4835-afc5-14e89da1a7a0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:15.971562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c5aca-96e9-46b8-acd2-412ce7f9f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:15.972442 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5aca-96e9-46b8-acd2-412ce7f9f9ac None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:15.972735 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5aca-96e9-46b8-acd2-412ce7f9f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:15.973016 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5aca-96e9-46b8-acd2-412ce7f9f9ac None admin] PATH_INFO: `/v3/projects/aea04e6cf7654b58abce1598945dd570` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:15.974195 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c5aca-96e9-46b8-acd2-412ce7f9f9ac None admin] RBAC: Authorizing `identity:get_project(project_id=aea04e6cf7654b58abce1598945dd570)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:15.975637 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c5aca-96e9-46b8-acd2-412ce7f9f9ac None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:15.977355 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 583/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:44:15 2022] GET /identity/v3/projects/aea04e6cf7654b58abce1598945dd570 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:15.984060 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358321c-a4de-4f36-b0ea-32a15e812eaf None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:16.083549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358321c-a4de-4f36-b0ea-32a15e812eaf None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:16.118594 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75115b8f-950b-40a7-a59e-8b2409b65b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:16.119185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75115b8f-950b-40a7-a59e-8b2409b65b1c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:16.119470 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75115b8f-950b-40a7-a59e-8b2409b65b1c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:16.119757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75115b8f-950b-40a7-a59e-8b2409b65b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:16.120615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75115b8f-950b-40a7-a59e-8b2409b65b1c None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=aea04e6cf7654b58abce1598945dd570, user.id=b3333642446d4905ac8659b52eb2617f) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:16.120930 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75115b8f-950b-40a7-a59e-8b2409b65b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:16.122355 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75115b8f-950b-40a7-a59e-8b2409b65b1c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:16.128560 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 578/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:44:15 2022] GET /identity/v3/role_assignments?user.id=b3333642446d4905ac8659b52eb2617f&scope.project.id=aea04e6cf7654b58abce1598945dd570&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:18.382085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24456-8acb-4f63-b168-99e965b00b1b None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:18.382651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24456-8acb-4f63-b168-99e965b00b1b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:18.382651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24456-8acb-4f63-b168-99e965b00b1b None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:18.384050 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 584/1162] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:18.389202 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a8ed-b227-416f-b05c-f572f20e7898 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:18.389715 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a8ed-b227-416f-b05c-f572f20e7898 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:18.389840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a8ed-b227-416f-b05c-f572f20e7898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:18.407330 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-f8f0a8ed-b227-416f-b05c-f572f20e7898 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:18.408530 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-f8f0a8ed-b227-416f-b05c-f572f20e7898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:18.472667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 579/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:18.494448 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24456-8acb-4f63-b168-99e965b00b1b None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:18.590905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24456-8acb-4f63-b168-99e965b00b1b None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:18.623013 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9996d-e152-4d31-9ff2-46c65423ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:18.623651 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9996d-e152-4d31-9ff2-46c65423ff20 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:18.624552 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9996d-e152-4d31-9ff2-46c65423ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:18.624829 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9996d-e152-4d31-9ff2-46c65423ff20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:18.688302 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9996d-e152-4d31-9ff2-46c65423ff20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:18.689752 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9996d-e152-4d31-9ff2-46c65423ff20 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:18.782423 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 585/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:44:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:44:18.788458 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a8ed-b227-416f-b05c-f572f20e7898 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:18.883554 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a8ed-b227-416f-b05c-f572f20e7898 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:18.915289 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93aa48-b0da-48d7-bccd-4b5f653b47e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:18.916111 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93aa48-b0da-48d7-bccd-4b5f653b47e3 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:18.916400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93aa48-b0da-48d7-bccd-4b5f653b47e3 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:18.916682 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93aa48-b0da-48d7-bccd-4b5f653b47e3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:18.923864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93aa48-b0da-48d7-bccd-4b5f653b47e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:18.925321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93aa48-b0da-48d7-bccd-4b5f653b47e3 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-ec93aa48-b0da-48d7-bccd-4b5f653b47e3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:44:18.939604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:44:18.941042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:44:18.942291 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 580/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:44:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:44:18.946838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9996d-e152-4d31-9ff2-46c65423ff20 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:19.042349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9996d-e152-4d31-9ff2-46c65423ff20 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:19.075142 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d162c71-a196-4724-b72a-cef470842e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:19.075819 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162c71-a196-4724-b72a-cef470842e8c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:19.076109 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162c71-a196-4724-b72a-cef470842e8c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:19.076388 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d162c71-a196-4724-b72a-cef470842e8c None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:19.077271 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d162c71-a196-4724-b72a-cef470842e8c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:19.077514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d162c71-a196-4724-b72a-cef470842e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:19.079050 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d162c71-a196-4724-b72a-cef470842e8c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:19.086029 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 586/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Mon May 9 15:44:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:21.289640 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25202e-0200-4e9c-872c-f823435c2f86 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:21.290218 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25202e-0200-4e9c-872c-f823435c2f86 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:21.290218 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25202e-0200-4e9c-872c-f823435c2f86 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:21.291563 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 581/1167] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:21.297606 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e949a-6f62-41c6-b1a6-531891bf38a2 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:21.298046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e949a-6f62-41c6-b1a6-531891bf38a2 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:21.298160 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e949a-6f62-41c6-b1a6-531891bf38a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:21.315046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-243e949a-6f62-41c6-b1a6-531891bf38a2 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:21.316271 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-243e949a-6f62-41c6-b1a6-531891bf38a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:21.381480 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 587/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:21.403886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25202e-0200-4e9c-872c-f823435c2f86 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:21.502823 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25202e-0200-4e9c-872c-f823435c2f86 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:21.535266 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ffd7f-85ef-4f3c-963c-241e526b8016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:21.535946 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ffd7f-85ef-4f3c-963c-241e526b8016 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:21.536234 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ffd7f-85ef-4f3c-963c-241e526b8016 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:21.536515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ffd7f-85ef-4f3c-963c-241e526b8016 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:21.537252 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ffd7f-85ef-4f3c-963c-241e526b8016 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:21.538612 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ffd7f-85ef-4f3c-963c-241e526b8016 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:21.553240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 582/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Mon May 9 15:44:21 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:44:23.796639 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae7eac-61b2-4b3c-ac6d-44090fe3a083 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:23.797270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae7eac-61b2-4b3c-ac6d-44090fe3a083 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:23.797270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae7eac-61b2-4b3c-ac6d-44090fe3a083 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:23.798564 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 588/1170] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:23.804195 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e01d4-a19e-43b5-a754-a942c19975b8 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:23.804639 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e01d4-a19e-43b5-a754-a942c19975b8 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:23.804758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e01d4-a19e-43b5-a754-a942c19975b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:23.821945 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-b61e01d4-a19e-43b5-a754-a942c19975b8 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:23.823127 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-b61e01d4-a19e-43b5-a754-a942c19975b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:23.888136 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 583/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:23.911800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae7eac-61b2-4b3c-ac6d-44090fe3a083 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:24.009792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae7eac-61b2-4b3c-ac6d-44090fe3a083 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:24.052288 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6277c8-85ab-4b04-84a7-08a8f0c724a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:24.053108 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6277c8-85ab-4b04-84a7-08a8f0c724a9 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:24.053394 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6277c8-85ab-4b04-84a7-08a8f0c724a9 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:24.053671 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6277c8-85ab-4b04-84a7-08a8f0c724a9 None admin] PATH_INFO: `/v3/domains/8dd40aa8a7c24511a4e2923c2466214e` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:24.068415 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6277c8-85ab-4b04-84a7-08a8f0c724a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8dd40aa8a7c24511a4e2923c2466214e)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:24.069873 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6277c8-85ab-4b04-84a7-08a8f0c724a9 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:24.071537 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 589/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 9 15:44:23 2022] GET /identity/v3/domains/8dd40aa8a7c24511a4e2923c2466214e => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:24.077664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e01d4-a19e-43b5-a754-a942c19975b8 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:24.174134 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e01d4-a19e-43b5-a754-a942c19975b8 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:24.207557 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e7e5a-3617-46ae-9fd0-a150aed0b815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:24.208253 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e7e5a-3617-46ae-9fd0-a150aed0b815 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:24.208539 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e7e5a-3617-46ae-9fd0-a150aed0b815 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:24.208820 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e7e5a-3617-46ae-9fd0-a150aed0b815 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:24.209545 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e7e5a-3617-46ae-9fd0-a150aed0b815 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:24.210978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e7e5a-3617-46ae-9fd0-a150aed0b815 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:24.236906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 584/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:44:24 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:44:26.506333 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f8a8-ec71-4bcb-a266-1090e2891f2c None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:26.506905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f8a8-ec71-4bcb-a266-1090e2891f2c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:26.506905 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f8a8-ec71-4bcb-a266-1090e2891f2c None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:26.508292 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 590/1174] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:26.513676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31f51-9424-40da-8955-ec3aee6c1302 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:26.514646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31f51-9424-40da-8955-ec3aee6c1302 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:26.514875 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31f51-9424-40da-8955-ec3aee6c1302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:26.531898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-76b31f51-9424-40da-8955-ec3aee6c1302 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:26.533080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-76b31f51-9424-40da-8955-ec3aee6c1302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:26.598326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 585/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:26.622825 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5f8a8-ec71-4bcb-a266-1090e2891f2c None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:26.723514 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5f8a8-ec71-4bcb-a266-1090e2891f2c None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:26.758453 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22094f9-e8bf-4573-905b-c22f4d85b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:26.759225 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22094f9-e8bf-4573-905b-c22f4d85b4fd None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:26.759510 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22094f9-e8bf-4573-905b-c22f4d85b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:26.759808 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22094f9-e8bf-4573-905b-c22f4d85b4fd None admin] PATH_INFO: `/v3/domains/8dd40aa8a7c24511a4e2923c2466214e` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:26.761038 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22094f9-e8bf-4573-905b-c22f4d85b4fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=8dd40aa8a7c24511a4e2923c2466214e)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:26.762515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22094f9-e8bf-4573-905b-c22f4d85b4fd None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:26.765311 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 591/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Mon May 9 15:44:26 2022] GET /identity/v3/domains/8dd40aa8a7c24511a4e2923c2466214e => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:26.770771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b31f51-9424-40da-8955-ec3aee6c1302 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:26.867879 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b31f51-9424-40da-8955-ec3aee6c1302 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:26.901063 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bd1f4-254d-48ab-9a75-ac1383352e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:26.901723 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd1f4-254d-48ab-9a75-ac1383352e0c None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:26.902008 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd1f4-254d-48ab-9a75-ac1383352e0c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:26.902285 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd1f4-254d-48ab-9a75-ac1383352e0c None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:26.903003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bd1f4-254d-48ab-9a75-ac1383352e0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:26.904466 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bd1f4-254d-48ab-9a75-ac1383352e0c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:26.924378 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 586/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:44:26 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:44:29.187121 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05796807-9e40-446c-a6d4-e32f28dded78 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:29.187646 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05796807-9e40-446c-a6d4-e32f28dded78 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:29.192134 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05796807-9e40-446c-a6d4-e32f28dded78 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:29.192134 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 592/1178] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:29.194571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080465-e28a-4c40-87e3-40b145f1982c None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:29.195060 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080465-e28a-4c40-87e3-40b145f1982c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:29.195160 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080465-e28a-4c40-87e3-40b145f1982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:29.211899 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-37080465-e28a-4c40-87e3-40b145f1982c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:29.213646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-37080465-e28a-4c40-87e3-40b145f1982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:29.278694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 587/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:29.302798 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05796807-9e40-446c-a6d4-e32f28dded78 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:29.401297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05796807-9e40-446c-a6d4-e32f28dded78 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:29.433838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1c708-fc46-4265-891c-9c9d92ea9972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:29.434618 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1c708-fc46-4265-891c-9c9d92ea9972 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:29.434907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1c708-fc46-4265-891c-9c9d92ea9972 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:29.435187 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1c708-fc46-4265-891c-9c9d92ea9972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:29.445863 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1c708-fc46-4265-891c-9c9d92ea9972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-35c1c708-fc46-4265-891c-9c9d92ea9972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:44:29.453726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:44:29.454998 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:44:29.456383 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 593/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:44:29.460979 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37080465-e28a-4c40-87e3-40b145f1982c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:29.560193 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37080465-e28a-4c40-87e3-40b145f1982c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:29.593241 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:29.593909 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:29.594196 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:29.594475 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:29.595226 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:29.595535 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:29.596938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:29.604707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 588/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:29.611291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1c708-fc46-4265-891c-9c9d92ea9972 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:29.709436 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1c708-fc46-4265-891c-9c9d92ea9972 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:29.742799 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26b6e0-b271-49ea-bc72-4fce64ca44a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:29.743673 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b6e0-b271-49ea-bc72-4fce64ca44a1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:29.743983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b6e0-b271-49ea-bc72-4fce64ca44a1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:29.744264 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26b6e0-b271-49ea-bc72-4fce64ca44a1 None admin] PATH_INFO: `/v3/users/5dc5315cbf904000b9dfed68eca8f151` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:29.757181 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26b6e0-b271-49ea-bc72-4fce64ca44a1 None admin] RBAC: Authorizing `identity:get_user(user_id=5dc5315cbf904000b9dfed68eca8f151)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:29.758628 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26b6e0-b271-49ea-bc72-4fce64ca44a1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:29.760316 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 594/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:44:29 2022] GET /identity/v3/users/5dc5315cbf904000b9dfed68eca8f151 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:29.767045 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:29.863299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a99dd-dbb9-42e6-b218-d1bfbb65742b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:29.895151 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa92121-0d35-438e-a327-43264c9046e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:29.895815 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92121-0d35-438e-a327-43264c9046e4 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:29.896104 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92121-0d35-438e-a327-43264c9046e4 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:29.896382 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92121-0d35-438e-a327-43264c9046e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:29.959927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa92121-0d35-438e-a327-43264c9046e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:29.961312 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa92121-0d35-438e-a327-43264c9046e4 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:30.053970 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 589/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:44:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:44:30.059869 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26b6e0-b271-49ea-bc72-4fce64ca44a1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:30.153723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26b6e0-b271-49ea-bc72-4fce64ca44a1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:30.187916 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6da9e-b0a4-472f-bd70-578c8636dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:30.188770 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6da9e-b0a4-472f-bd70-578c8636dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:30.189051 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6da9e-b0a4-472f-bd70-578c8636dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:30.189325 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6da9e-b0a4-472f-bd70-578c8636dfe0 None admin] PATH_INFO: `/v3/projects/1f2e349866eb4b3ab5752c2edd57107e` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:30.190490 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6da9e-b0a4-472f-bd70-578c8636dfe0 None admin] RBAC: Authorizing `identity:get_project(project_id=1f2e349866eb4b3ab5752c2edd57107e)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:30.191962 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6da9e-b0a4-472f-bd70-578c8636dfe0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:30.193650 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 595/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:44:30 2022] GET /identity/v3/projects/1f2e349866eb4b3ab5752c2edd57107e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:30.199709 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa92121-0d35-438e-a327-43264c9046e4 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:30.295037 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa92121-0d35-438e-a327-43264c9046e4 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:30.327638 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67822c07-0334-4da5-a39e-710869d1f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:30.328315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822c07-0334-4da5-a39e-710869d1f25a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:30.328603 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822c07-0334-4da5-a39e-710869d1f25a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:30.328880 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822c07-0334-4da5-a39e-710869d1f25a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:30.329705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67822c07-0334-4da5-a39e-710869d1f25a None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=1f2e349866eb4b3ab5752c2edd57107e, user.id=5dc5315cbf904000b9dfed68eca8f151) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:30.330016 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67822c07-0334-4da5-a39e-710869d1f25a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:30.331443 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67822c07-0334-4da5-a39e-710869d1f25a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:30.336737 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 590/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:44:30 2022] GET /identity/v3/role_assignments?user.id=5dc5315cbf904000b9dfed68eca8f151&scope.project.id=1f2e349866eb4b3ab5752c2edd57107e&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:32.527323 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73419c-94c4-4daf-841a-3ade939ce952 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:32.527921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73419c-94c4-4daf-841a-3ade939ce952 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:32.527921 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73419c-94c4-4daf-841a-3ade939ce952 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:32.529291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 596/1186] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:32.534495 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fce85-e512-446d-a427-324fd46ad3f4 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:32.534930 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fce85-e512-446d-a427-324fd46ad3f4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:32.535040 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fce85-e512-446d-a427-324fd46ad3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:32.551329 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-082fce85-e512-446d-a427-324fd46ad3f4 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:32.552530 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-082fce85-e512-446d-a427-324fd46ad3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:32.616517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 591/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:44:32.639486 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73419c-94c4-4daf-841a-3ade939ce952 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:32.737951 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73419c-94c4-4daf-841a-3ade939ce952 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:32.772217 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0e265-1726-43fb-9933-e8931a7e0a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:32.773003 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0e265-1726-43fb-9933-e8931a7e0a82 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:32.773284 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0e265-1726-43fb-9933-e8931a7e0a82 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:32.773555 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0e265-1726-43fb-9933-e8931a7e0a82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:32.783595 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0e265-1726-43fb-9933-e8931a7e0a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-59c0e265-1726-43fb-9933-e8931a7e0a82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:44:32.791178 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:44:32.792471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:44:32.793692 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 597/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:44:32.798438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fce85-e512-446d-a427-324fd46ad3f4 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:32.898418 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fce85-e512-446d-a427-324fd46ad3f4 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:32.930760 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:32.931424 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:32.931711 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:32.932020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:32.932771 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:32.933079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:32.934438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:32.942950 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 592/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:32.948904 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0e265-1726-43fb-9933-e8931a7e0a82 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:33.042762 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0e265-1726-43fb-9933-e8931a7e0a82 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:33.074803 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda09636-7dc2-4a24-9299-813cb63601a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:33.075656 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09636-7dc2-4a24-9299-813cb63601a6 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:33.075969 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09636-7dc2-4a24-9299-813cb63601a6 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:33.076796 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda09636-7dc2-4a24-9299-813cb63601a6 None admin] PATH_INFO: `/v3/users/5dc5315cbf904000b9dfed68eca8f151` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:33.078166 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda09636-7dc2-4a24-9299-813cb63601a6 None admin] RBAC: Authorizing `identity:get_user(user_id=5dc5315cbf904000b9dfed68eca8f151)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:33.079596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda09636-7dc2-4a24-9299-813cb63601a6 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:33.081224 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 598/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:44:32 2022] GET /identity/v3/users/5dc5315cbf904000b9dfed68eca8f151 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:33.086862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:33.183189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f7fad-d56b-48c7-8311-6d30e3612264 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:33.216170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065262e2-df4a-4320-8606-aab35f23348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:33.217743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065262e2-df4a-4320-8606-aab35f23348e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:33.218202 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065262e2-df4a-4320-8606-aab35f23348e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:33.218484 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065262e2-df4a-4320-8606-aab35f23348e None admin] PATH_INFO: `/v3/projects/1f2e349866eb4b3ab5752c2edd57107e` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:33.219681 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065262e2-df4a-4320-8606-aab35f23348e None admin] RBAC: Authorizing `identity:get_project(project_id=1f2e349866eb4b3ab5752c2edd57107e)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:33.221153 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065262e2-df4a-4320-8606-aab35f23348e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:33.222863 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 593/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:44:33 2022] GET /identity/v3/projects/1f2e349866eb4b3ab5752c2edd57107e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:33.228703 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda09636-7dc2-4a24-9299-813cb63601a6 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:33.323960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda09636-7dc2-4a24-9299-813cb63601a6 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:33.355926 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b536e-f19a-4ff0-8193-cb5ec47df4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:33.356805 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b536e-f19a-4ff0-8193-cb5ec47df4c6 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:33.357085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b536e-f19a-4ff0-8193-cb5ec47df4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:33.357360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b536e-f19a-4ff0-8193-cb5ec47df4c6 None admin] PATH_INFO: `/v3/projects/1f2e349866eb4b3ab5752c2edd57107e/users/5dc5315cbf904000b9dfed68eca8f151/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:33.359678 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b536e-f19a-4ff0-8193-cb5ec47df4c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f2e349866eb4b3ab5752c2edd57107e, user_id=5dc5315cbf904000b9dfed68eca8f151, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:33.361142 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b536e-f19a-4ff0-8193-cb5ec47df4c6 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:33.374020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 599/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:44:33 2022] PUT /identity/v3/projects/1f2e349866eb4b3ab5752c2edd57107e/users/5dc5315cbf904000b9dfed68eca8f151/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:44:35.553427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feb98b-a0e9-4a2b-847e-b39210132fca None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:35.554005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feb98b-a0e9-4a2b-847e-b39210132fca None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:35.554005 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39feb98b-a0e9-4a2b-847e-b39210132fca None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:35.555375 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 594/1193] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:44:35.560774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc531-ba3a-47e6-b420-f62e9c9caad3 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:35.561180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc531-ba3a-47e6-b420-f62e9c9caad3 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:35.561333 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc531-ba3a-47e6-b420-f62e9c9caad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:35.577960 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-e93dc531-ba3a-47e6-b420-f62e9c9caad3 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:44:35.579161 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-e93dc531-ba3a-47e6-b420-f62e9c9caad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:44:35.642946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 600/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:44:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:44:35.666227 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39feb98b-a0e9-4a2b-847e-b39210132fca None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:35.766185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39feb98b-a0e9-4a2b-847e-b39210132fca None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:35.799504 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752231cd-8a7a-4499-bf95-e4183bb421df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:35.800317 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752231cd-8a7a-4499-bf95-e4183bb421df None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:35.800605 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752231cd-8a7a-4499-bf95-e4183bb421df None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:35.800882 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752231cd-8a7a-4499-bf95-e4183bb421df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:35.811033 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752231cd-8a7a-4499-bf95-e4183bb421df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-752231cd-8a7a-4499-bf95-e4183bb421df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:44:35.818676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:44:35.819931 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:44:35.821189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 595/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:44:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:44:35.825996 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc531-ba3a-47e6-b420-f62e9c9caad3 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:35.920344 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc531-ba3a-47e6-b420-f62e9c9caad3 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:35.952842 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:35.953497 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:35.953789 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:35.954067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:35.954811 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:35.955121 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:35.956522 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:35.964253 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 601/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:35.970471 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752231cd-8a7a-4499-bf95-e4183bb421df None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:36.068498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752231cd-8a7a-4499-bf95-e4183bb421df None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:36.101495 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b412cf-5b4c-4c5a-9d23-2265d8342388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:36.102360 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b412cf-5b4c-4c5a-9d23-2265d8342388 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:36.102647 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b412cf-5b4c-4c5a-9d23-2265d8342388 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:36.102927 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b412cf-5b4c-4c5a-9d23-2265d8342388 None admin] PATH_INFO: `/v3/users/5dc5315cbf904000b9dfed68eca8f151` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:36.104140 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b412cf-5b4c-4c5a-9d23-2265d8342388 None admin] RBAC: Authorizing `identity:get_user(user_id=5dc5315cbf904000b9dfed68eca8f151)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:36.105581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b412cf-5b4c-4c5a-9d23-2265d8342388 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:36.107216 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 596/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Mon May 9 15:44:35 2022] GET /identity/v3/users/5dc5315cbf904000b9dfed68eca8f151 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:36.113339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:36.210242 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04904f52-a406-4663-bfb7-2d960e6fcc9a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:36.242547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2921655-a0c0-41c8-8f8d-22c21ea08fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:36.243194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2921655-a0c0-41c8-8f8d-22c21ea08fa5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:36.243482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2921655-a0c0-41c8-8f8d-22c21ea08fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:36.243785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2921655-a0c0-41c8-8f8d-22c21ea08fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:36.308041 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2921655-a0c0-41c8-8f8d-22c21ea08fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:36.309487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2921655-a0c0-41c8-8f8d-22c21ea08fa5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:36.404473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 602/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:44:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:44:36.410415 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b412cf-5b4c-4c5a-9d23-2265d8342388 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:36.508411 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b412cf-5b4c-4c5a-9d23-2265d8342388 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:36.541004 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb258a22-eb02-4bcf-9d9d-fd6af64feca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:36.541853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258a22-eb02-4bcf-9d9d-fd6af64feca9 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:36.542139 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258a22-eb02-4bcf-9d9d-fd6af64feca9 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:36.542416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258a22-eb02-4bcf-9d9d-fd6af64feca9 None admin] PATH_INFO: `/v3/projects/1f2e349866eb4b3ab5752c2edd57107e` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:36.543583 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb258a22-eb02-4bcf-9d9d-fd6af64feca9 None admin] RBAC: Authorizing `identity:get_project(project_id=1f2e349866eb4b3ab5752c2edd57107e)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:36.545451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb258a22-eb02-4bcf-9d9d-fd6af64feca9 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:36.547145 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 597/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Mon May 9 15:44:36 2022] GET /identity/v3/projects/1f2e349866eb4b3ab5752c2edd57107e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:44:36.553167 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2921655-a0c0-41c8-8f8d-22c21ea08fa5 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:44:36.648733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2921655-a0c0-41c8-8f8d-22c21ea08fa5 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:44:36.681164 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa028720-ef0c-4a57-98b2-dc620b2595a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:44:36.681813 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028720-ef0c-4a57-98b2-dc620b2595a0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:44:36.682101 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028720-ef0c-4a57-98b2-dc620b2595a0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:44:36.682379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa028720-ef0c-4a57-98b2-dc620b2595a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:44:36.683210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa028720-ef0c-4a57-98b2-dc620b2595a0 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=1f2e349866eb4b3ab5752c2edd57107e, user.id=5dc5315cbf904000b9dfed68eca8f151) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:44:36.683528 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa028720-ef0c-4a57-98b2-dc620b2595a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:44:36.685008 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa028720-ef0c-4a57-98b2-dc620b2595a0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:44:36.691726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 603/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:44:36 2022] GET /identity/v3/role_assignments?user.id=5dc5315cbf904000b9dfed68eca8f151&scope.project.id=1f2e349866eb4b3ab5752c2edd57107e&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:35.917538 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7f24-aa7f-4297-839e-bbf994709d4d None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:35.918200 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7f24-aa7f-4297-839e-bbf994709d4d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:35.918200 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7f24-aa7f-4297-839e-bbf994709d4d None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:35.920511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 598/1201] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:45:35.928326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289bb47-2e06-4522-ac80-df254eedb53d None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:35.928933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289bb47-2e06-4522-ac80-df254eedb53d None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:35.928933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289bb47-2e06-4522-ac80-df254eedb53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:35.948909 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-6289bb47-2e06-4522-ac80-df254eedb53d None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:35.951028 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-6289bb47-2e06-4522-ac80-df254eedb53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:36.024017 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 604/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:45:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:45:36.049767 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7f24-aa7f-4297-839e-bbf994709d4d None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:36.152137 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7f24-aa7f-4297-839e-bbf994709d4d None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:36.192512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:36.193323 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:36.193611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:36.193893 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:36.204736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:36.206174 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:36.223593 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:36.229969 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:36.231507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:36.231507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:36.231507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:36.231507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:36.231507 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 599/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:36.232180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289bb47-2e06-4522-ac80-df254eedb53d None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:36.334569 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289bb47-2e06-4522-ac80-df254eedb53d None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:36.368011 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485a68c-6a59-4b3d-b5e1-05f7f9af79f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:36.368680 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485a68c-6a59-4b3d-b5e1-05f7f9af79f2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:36.368963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485a68c-6a59-4b3d-b5e1-05f7f9af79f2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:36.369236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485a68c-6a59-4b3d-b5e1-05f7f9af79f2 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:36.369949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485a68c-6a59-4b3d-b5e1-05f7f9af79f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:36.370255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485a68c-6a59-4b3d-b5e1-05f7f9af79f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:36.371648 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485a68c-6a59-4b3d-b5e1-05f7f9af79f2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:36.389726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 605/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:36.390989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:36.495304 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98794ef-0109-4326-9fc1-2c528586ae9d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:36.529142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d0318-690d-4d51-a681-c787dbd10e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:36.529518 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0318-690d-4d51-a681-c787dbd10e16 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:36.529761 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0318-690d-4d51-a681-c787dbd10e16 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:36.530039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d0318-690d-4d51-a681-c787dbd10e16 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:36.530754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d0318-690d-4d51-a681-c787dbd10e16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:36.532200 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d0318-690d-4d51-a681-c787dbd10e16 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:36.553136 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 600/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Mon May 9 15:45:36 2022] POST /identity/v3/users => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:45:39.045833 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064903c8-89c5-4d1a-a410-ba7316715eb1 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:39.046430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064903c8-89c5-4d1a-a410-ba7316715eb1 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:39.046430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064903c8-89c5-4d1a-a410-ba7316715eb1 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:39.047860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 606/1206] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:39.054182 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e230b6-7915-4297-9616-f3fd7a89171c None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:39.054670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e230b6-7915-4297-9616-f3fd7a89171c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:39.054774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e230b6-7915-4297-9616-f3fd7a89171c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:39.074876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-66e230b6-7915-4297-9616-f3fd7a89171c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:39.076442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-66e230b6-7915-4297-9616-f3fd7a89171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:39.165388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 601/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:45:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:45:39.193002 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064903c8-89c5-4d1a-a410-ba7316715eb1 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:39.331913 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064903c8-89c5-4d1a-a410-ba7316715eb1 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:39.374367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b382-a912-4a3d-92a2-8aa2e99578ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:39.375495 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b382-a912-4a3d-92a2-8aa2e99578ed None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:39.375919 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b382-a912-4a3d-92a2-8aa2e99578ed None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:39.376213 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b382-a912-4a3d-92a2-8aa2e99578ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:39.390379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695b382-a912-4a3d-92a2-8aa2e99578ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-5695b382-a912-4a3d-92a2-8aa2e99578ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:45:39.400387 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:39.401834 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:39.402870 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 607/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:45:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:39.409052 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e230b6-7915-4297-9616-f3fd7a89171c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:39.529442 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e230b6-7915-4297-9616-f3fd7a89171c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:39.572386 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:39.573071 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:39.573357 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:39.573632 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:39.574398 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:39.574713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:39.576218 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:39.587877 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 602/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:39.593083 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b382-a912-4a3d-92a2-8aa2e99578ed None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:39.710382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b382-a912-4a3d-92a2-8aa2e99578ed None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:39.748274 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:39.749229 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:39.749492 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:39.749800 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:39.762117 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:39.764832 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:39.787090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:39.788356 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:39.789439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:39.789439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:39.789439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:39.789439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:39.789439 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 608/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:39.793294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:39.924741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64795f-f20f-4c2f-ac24-d15c9aa7af3a None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:39.965853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:39.966874 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:39.967244 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:39.967550 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:39.968342 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:39.968713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:39.970154 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:39.984276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 603/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:39.990855 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:40.105668 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0039dd-81ea-45e8-91de-bf63d833db7f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:40.143974 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:40.144776 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:40.145067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:40.145360 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] PATH_INFO: `/v3/users/placement` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:40.154210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:40.155675 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:45:40.172240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:40.173722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:40.175843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 609/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:45:40.179960 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:40.298638 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d904a4-020d-4b70-9ab5-528d8444962e None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:40.342989 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:40.344753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:40.344753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:40.344753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:40.345164 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:40.345396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:40.347026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:40.368468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 604/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:45:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:40.374736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:40.492803 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64612471-91e4-40a1-95c7-1d6c6e7ee112 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:40.531411 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476c08-3f35-4d5f-8f45-f86f0cf7eaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:40.532101 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476c08-3f35-4d5f-8f45-f86f0cf7eaab None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:40.532390 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476c08-3f35-4d5f-8f45-f86f0cf7eaab None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:40.532669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476c08-3f35-4d5f-8f45-f86f0cf7eaab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:40.608093 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476c08-3f35-4d5f-8f45-f86f0cf7eaab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:40.609804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476c08-3f35-4d5f-8f45-f86f0cf7eaab None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:40.731671 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 610/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:45:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:45:40.734458 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:40.851758 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443ae66-6198-478b-8349-a8a5f6565b68 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:40.889158 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:40.890113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:40.890397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:40.890672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:40.902358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:40.904307 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:40.927225 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:40.928725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:40.930149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:40.930149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:40.930149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:40.930149 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:40.931981 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 605/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:40.938943 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476c08-3f35-4d5f-8f45-f86f0cf7eaab None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:41.064023 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476c08-3f35-4d5f-8f45-f86f0cf7eaab None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:41.104321 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:41.105262 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:41.105709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:41.107097 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:41.108845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:41.109770 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:41.111196 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:41.125722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 611/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:41.131683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:41.249684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfafe3-ced5-4c29-a788-61cb893fe77d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:41.293805 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:41.295735 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:41.296057 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:41.296362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:41.304983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:41.306488 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:45:41.322321 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:41.323645 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:41.324777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 606/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:41.332446 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:41.456120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4593a-dc56-46fe-b5d4-02b5f63062cb None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:41.494685 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223073f-9a3c-44fb-a3c8-1a96369df157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:41.495345 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223073f-9a3c-44fb-a3c8-1a96369df157 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:41.495652 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223073f-9a3c-44fb-a3c8-1a96369df157 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:41.495933 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223073f-9a3c-44fb-a3c8-1a96369df157 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:41.496729 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223073f-9a3c-44fb-a3c8-1a96369df157 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:41.497064 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223073f-9a3c-44fb-a3c8-1a96369df157 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:41.498845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223073f-9a3c-44fb-a3c8-1a96369df157 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:41.511444 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 612/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:41.517490 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:41.628413 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8b891-da37-4d7e-8899-0409d5aece96 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:41.668049 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba5f6d-9713-4e65-b72b-e2d34a874b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:41.669007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5f6d-9713-4e65-b72b-e2d34a874b39 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:41.669665 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5f6d-9713-4e65-b72b-e2d34a874b39 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:41.670268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba5f6d-9713-4e65-b72b-e2d34a874b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:41.671133 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba5f6d-9713-4e65-b72b-e2d34a874b39 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=6b4724ee840f4a18834f9dc2efde9f6d) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:41.671445 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba5f6d-9713-4e65-b72b-e2d34a874b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:41.673080 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba5f6d-9713-4e65-b72b-e2d34a874b39 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:41.680003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 607/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:45:41 2022] GET /identity/v3/role_assignments?user.id=6b4724ee840f4a18834f9dc2efde9f6d&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:44.122925 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd422-2ce4-49e0-9f8a-9b9156ba26d0 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:44.123569 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd422-2ce4-49e0-9f8a-9b9156ba26d0 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:44.123670 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd422-2ce4-49e0-9f8a-9b9156ba26d0 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:44.125301 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 613/1220] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:44.132068 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe028b4-5379-42e0-8c4d-5299756dc840 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:44.132068 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe028b4-5379-42e0-8c4d-5299756dc840 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:44.132707 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe028b4-5379-42e0-8c4d-5299756dc840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:44.151144 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-8fe028b4-5379-42e0-8c4d-5299756dc840 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:44.152395 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-8fe028b4-5379-42e0-8c4d-5299756dc840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:44.236676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 608/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:45:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:45:44.260626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dd422-2ce4-49e0-9f8a-9b9156ba26d0 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:44.367786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dd422-2ce4-49e0-9f8a-9b9156ba26d0 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:44.406323 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2c2f7-61e3-4785-9834-1f1f49aa5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:44.407197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c2f7-61e3-4785-9834-1f1f49aa5972 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:44.407483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c2f7-61e3-4785-9834-1f1f49aa5972 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:44.407786 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2c2f7-61e3-4785-9834-1f1f49aa5972 None admin] PATH_INFO: `/v3/roles/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:44.419236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2c2f7-61e3-4785-9834-1f1f49aa5972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-94f2c2f7-61e3-4785-9834-1f1f49aa5972 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:45:44.428413 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:44.435512 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:44.436780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 614/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:45:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:44.437835 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe028b4-5379-42e0-8c4d-5299756dc840 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:44.537198 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe028b4-5379-42e0-8c4d-5299756dc840 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:44.570676 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:44.571342 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:44.571625 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:44.571933 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:44.572679 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] RBAC: Adding query filter params (name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:44.572985 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:44.574340 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:44.582525 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 609/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:45:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:44.588596 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2c2f7-61e3-4785-9834-1f1f49aa5972 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:44.699236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2c2f7-61e3-4785-9834-1f1f49aa5972 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:44.737136 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:44.738066 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:44.738455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:44.738741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:44.752684 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:44.755009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:44.777978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:44.779348 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:44.780479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:44.780479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:44.780479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:44.780479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:44.780479 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 615/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:45:44.786968 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:44.892614 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2fd94-3326-4fce-8476-4bac51964982 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:44.931872 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:44.932571 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:44.932983 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:44.933370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:44.934347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:44.934938 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:44.936526 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:44.951607 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 610/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:44.957287 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:45.070843 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c16a7e-0ffa-4b77-8a64-6bcb0b91e0e0 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:45.106481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:45.107299 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:45.107585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:45.107895 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] PATH_INFO: `/v3/users/placement` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:45.116490 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:45.118203 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:45:45.135197 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:45.136955 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:45.138862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 616/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:45.144380 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:45.256853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd8e45-b1f6-4c17-a4ea-01fa948f8d50 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:45.292581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:45.293271 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:45.293611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:45.293932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:45.294824 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:45.295126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:45.296601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:45.314540 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 611/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:45:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:45.320008 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:45.430623 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b231-1eae-44b2-a367-43bdf033f019 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:45.467789 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:45.468609 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:45.468893 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:45.469166 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:45.480102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:45.481570 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:45.498629 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:45.499845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:45.501358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:45.501358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:45.501358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:45.501358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:45.501358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 617/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:45.505470 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:45.619670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb361ae2-43b8-448a-9b84-baba9d5f1912 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:45.658811 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:45.659474 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:45.659755 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:45.660055 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:45.660769 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:45.661072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:45.662420 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:45.678443 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 612/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:45.679671 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:45.788326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83efa9-ff42-4b7e-9cec-db8c404adba8 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:45.824180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:45.825013 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:45.825903 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:45.826274 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:45.833274 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:45.834780 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:45:45.850417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:45.851589 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:45.858641 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 618/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:45.859340 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:45.963940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81268d2e-63b4-4d7d-b20f-cd55366014a8 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:45.999489 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2803-dd29-4d04-9c3b-04a3d336513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:46.000407 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2803-dd29-4d04-9c3b-04a3d336513a None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:46.000840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2803-dd29-4d04-9c3b-04a3d336513a None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:46.001027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2803-dd29-4d04-9c3b-04a3d336513a None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:46.001967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d2803-dd29-4d04-9c3b-04a3d336513a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:46.002404 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d2803-dd29-4d04-9c3b-04a3d336513a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:46.004315 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d2803-dd29-4d04-9c3b-04a3d336513a None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:46.017581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 613/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:46.024461 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:46.131754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe4a3-f978-4709-b6a3-f0f8ea78e994 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:46.167349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc49178-0aa0-4e11-8db2-4eb82c277a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:46.168280 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49178-0aa0-4e11-8db2-4eb82c277a93 None admin] REQUEST_METHOD: `PUT` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:46.168570 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49178-0aa0-4e11-8db2-4eb82c277a93 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:46.168868 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc49178-0aa0-4e11-8db2-4eb82c277a93 None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/6b4724ee840f4a18834f9dc2efde9f6d/roles/a0d927cd47694ddd9d6e391569dce904` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:46.184366 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc49178-0aa0-4e11-8db2-4eb82c277a93 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=6b4724ee840f4a18834f9dc2efde9f6d, role_id=a0d927cd47694ddd9d6e391569dce904)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:46.186525 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc49178-0aa0-4e11-8db2-4eb82c277a93 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:46.199256 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 619/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:45:46 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/6b4724ee840f4a18834f9dc2efde9f6d/roles/a0d927cd47694ddd9d6e391569dce904 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:45:48.503864 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa6e0-4f76-4d31-ab12-9b8c268c8bba None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:48.504904 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa6e0-4f76-4d31-ab12-9b8c268c8bba None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:48.504904 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa6e0-4f76-4d31-ab12-9b8c268c8bba None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:48.506007 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 614/1233] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:48.511395 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb19f6-ea96-4d1a-9a87-f92ff697658f None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:48.511902 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb19f6-ea96-4d1a-9a87-f92ff697658f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:48.511999 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb19f6-ea96-4d1a-9a87-f92ff697658f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:48.529247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-2ebb19f6-ea96-4d1a-9a87-f92ff697658f None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:48.530480 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-2ebb19f6-ea96-4d1a-9a87-f92ff697658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:48.599071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 620/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:45:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:45:48.623081 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afa6e0-4f76-4d31-ab12-9b8c268c8bba None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:48.727214 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afa6e0-4f76-4d31-ab12-9b8c268c8bba None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:48.775369 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c520c-efed-4646-89bc-0e330ce43c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:48.776110 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c520c-efed-4646-89bc-0e330ce43c9b None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:48.776392 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c520c-efed-4646-89bc-0e330ce43c9b None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:48.776669 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c520c-efed-4646-89bc-0e330ce43c9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:48.788490 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c520c-efed-4646-89bc-0e330ce43c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-d54c520c-efed-4646-89bc-0e330ce43c9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:45:48.797859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:48.799464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:48.801020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 615/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Mon May 9 15:45:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:48.806471 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb19f6-ea96-4d1a-9a87-f92ff697658f None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:48.922259 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb19f6-ea96-4d1a-9a87-f92ff697658f None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:48.959918 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:48.960704 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:48.960989 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:48.961322 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:48.962067 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] RBAC: Adding query filter params (name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:48.962368 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:48.963741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:48.973104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 621/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Mon May 9 15:45:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:48.978886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c520c-efed-4646-89bc-0e330ce43c9b None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:49.081168 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c520c-efed-4646-89bc-0e330ce43c9b None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:49.116638 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:49.117436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:49.117724 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:49.118003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:49.131083 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:49.132742 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:49.154674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:49.155977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:49.157258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:49.157258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:49.157258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:49.157258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:49.157258 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 616/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:49.162164 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:49.269550 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e61faf-047d-4b89-968f-2fe1c2376840 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:49.303468 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:49.304172 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:49.304459 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:49.304734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:49.305564 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:49.305967 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:49.307785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:49.320702 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 622/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:49.326928 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:49.435911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c344-f2c7-4931-9145-2857cf239c97 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:49.470764 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:49.471576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:49.471898 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:49.472179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] PATH_INFO: `/v3/users/placement` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:49.480724 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:49.483048 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:45:49.501013 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:49.502408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:49.503757 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 617/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:49.509366 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:49.614120 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419951-7ebd-40a4-896d-873581d56a43 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:49.648892 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:49.649569 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:49.649850 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:49.650126 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:49.650958 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:49.651265 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:49.652722 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:49.670623 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 623/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:45:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:49.676483 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:49.789172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8f703-e6a5-458a-aa02-05f9db810cbb None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:49.828113 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae7dea-10e5-4f1f-90e0-b4ded6712e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:49.828767 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae7dea-10e5-4f1f-90e0-b4ded6712e55 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:49.829048 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae7dea-10e5-4f1f-90e0-b4ded6712e55 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:49.829324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae7dea-10e5-4f1f-90e0-b4ded6712e55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:49.903106 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae7dea-10e5-4f1f-90e0-b4ded6712e55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:49.905532 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae7dea-10e5-4f1f-90e0-b4ded6712e55 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:50.006237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 618/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:45:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:45:50.012050 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:50.125426 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b42d-be98-4445-b552-d0d656ec6cb1 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:50.164181 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:50.164964 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.165279 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.165515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.177003 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:50.178861 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:50.203281 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:50.204697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:50.205991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:50.205991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:50.205991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:50.205991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:50.205991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 624/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:50.210694 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae7dea-10e5-4f1f-90e0-b4ded6712e55 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:50.318367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae7dea-10e5-4f1f-90e0-b4ded6712e55 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:50.357594 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:50.358776 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.359072 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.359358 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.360134 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:50.360447 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:50.363916 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:50.378657 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 619/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:50.384507 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:50.493104 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f87c9-5a99-47c3-a48d-1c854f01e17f None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:50.533544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:50.534349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.534639 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.534920 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.542446 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:50.544679 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:45:50.560349 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:50.561666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:50.562745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 625/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:50.567929 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:50.674348 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1a169-b630-488d-8af2-57b40f1c2bdc None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:50.709741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573781a-1a81-4405-867a-c571bae7baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:50.710414 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573781a-1a81-4405-867a-c571bae7baf0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.710700 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573781a-1a81-4405-867a-c571bae7baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.710977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573781a-1a81-4405-867a-c571bae7baf0 None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.711790 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573781a-1a81-4405-867a-c571bae7baf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:50.712121 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573781a-1a81-4405-867a-c571bae7baf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:50.713564 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573781a-1a81-4405-867a-c571bae7baf0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:50.727817 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 620/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:50.734727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:50.854794 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65971f-e8ed-46fb-b071-7310a572a1e4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:50.889571 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f60c2-4428-46d8-bb06-f67605c528e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:50.890277 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f60c2-4428-46d8-bb06-f67605c528e4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.890614 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f60c2-4428-46d8-bb06-f67605c528e4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.890946 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f60c2-4428-46d8-bb06-f67605c528e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.891845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f60c2-4428-46d8-bb06-f67605c528e4 None admin] RBAC: Adding query filter params (role.id=a0d927cd47694ddd9d6e391569dce904, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=6b4724ee840f4a18834f9dc2efde9f6d) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:50.892169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f60c2-4428-46d8-bb06-f67605c528e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:50.893697 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f60c2-4428-46d8-bb06-f67605c528e4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:50.899822 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 626/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:45:50 2022] GET /identity/v3/role_assignments?user.id=6b4724ee840f4a18834f9dc2efde9f6d&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=a0d927cd47694ddd9d6e391569dce904 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:53.609664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8d9c-957e-4005-b941-65785ee5c458 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:53.610285 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8d9c-957e-4005-b941-65785ee5c458 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:53.610285 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8d9c-957e-4005-b941-65785ee5c458 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:53.611614 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 621/1247] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:53.620382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440450-5e06-4c6d-84fc-88b14812e421 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:53.620382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440450-5e06-4c6d-84fc-88b14812e421 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:53.620382 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440450-5e06-4c6d-84fc-88b14812e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:53.637709 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-ec440450-5e06-4c6d-84fc-88b14812e421 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:53.638997 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-ec440450-5e06-4c6d-84fc-88b14812e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:53.721196 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 627/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:45:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:45:53.755598 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8d9c-957e-4005-b941-65785ee5c458 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:53.890779 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8d9c-957e-4005-b941-65785ee5c458 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:53.932768 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dc50d-9aac-41c4-b1eb-369b49ad24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:53.933884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc50d-9aac-41c4-b1eb-369b49ad24a6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:53.934857 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc50d-9aac-41c4-b1eb-369b49ad24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:53.935259 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc50d-9aac-41c4-b1eb-369b49ad24a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:53.947497 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2dc50d-9aac-41c4-b1eb-369b49ad24a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-af2dc50d-9aac-41c4-b1eb-369b49ad24a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:45:53.956324 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:53.957691 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:53.958936 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 622/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:53.964095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440450-5e06-4c6d-84fc-88b14812e421 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:54.080762 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440450-5e06-4c6d-84fc-88b14812e421 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:54.120941 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:54.121681 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:54.122302 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:54.122594 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:54.123414 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:54.123731 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:54.125192 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:54.135550 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 628/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:54.143000 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dc50d-9aac-41c4-b1eb-369b49ad24a6 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:54.264280 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dc50d-9aac-41c4-b1eb-369b49ad24a6 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:54.303997 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:54.304813 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:54.305224 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:54.305512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:54.318566 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:54.320231 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:54.346884 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:54.348248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:54.349511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:54.349511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:54.349511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:54.349511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:54.349511 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 623/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:54.354152 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:54.467483 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d9da5-649b-4b75-b9fc-3f72423119e3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:54.503515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:54.504219 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:54.504503 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:54.504778 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:54.505505 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:54.505856 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:54.507338 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:54.520475 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 629/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:54.526746 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:54.640222 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0fb6-2347-438e-a47c-c0193279488f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:54.683393 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:54.685536 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:54.685821 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:54.686102 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:54.697503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:54.699339 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:45:54.718743 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:54.720034 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:54.722810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:54.727070 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 624/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:54.728046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:54.863070 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57825664-737a-4c4f-a42d-35e53bee494c None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:54.908832 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:54.909538 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:54.909806 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:54.910092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:54.910928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:54.911240 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:54.912758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:54.931565 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 630/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:45:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:54.940165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.070347 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375fcbf-c644-429f-83ad-21307f96f3a6 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.115015 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49291e30-8abb-4c68-b52e-1b01dd63d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.115972 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291e30-8abb-4c68-b52e-1b01dd63d37f None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.116327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291e30-8abb-4c68-b52e-1b01dd63d37f None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.116786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49291e30-8abb-4c68-b52e-1b01dd63d37f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.196009 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49291e30-8abb-4c68-b52e-1b01dd63d37f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:55.197875 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49291e30-8abb-4c68-b52e-1b01dd63d37f None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:55.305102 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 625/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:45:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:45:55.311683 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.422446 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3044bd-30a6-4403-b974-6512ee7b66b2 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.463478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.464645 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.465115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.465590 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.476004 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:55.477433 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:55.496379 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:55.497774 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:55.499449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:55.499449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:55.499449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:55.499449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:55.499449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 631/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:55.505088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49291e30-8abb-4c68-b52e-1b01dd63d37f None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.618643 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49291e30-8abb-4c68-b52e-1b01dd63d37f None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.662230 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.662958 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.663512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.663861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.664657 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:55.665142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:55.666986 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:55.679274 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 626/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:55.685283 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.806106 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38598e-c777-4b63-b83f-dd65d0558a33 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.844239 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.845057 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.845367 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.845668 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.852727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:55.854169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:45:55.868169 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:55.874802 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:45:55.876168 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 632/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:55.876873 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.983533 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a92a06-7767-4728-b059-abb5cf6e477d None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:56.019288 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e3f34-8584-4579-86f3-6f0e04503cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:56.019991 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e3f34-8584-4579-86f3-6f0e04503cea None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:56.020279 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e3f34-8584-4579-86f3-6f0e04503cea None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:56.020557 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e3f34-8584-4579-86f3-6f0e04503cea None admin] PATH_INFO: `/v3/projects` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:56.021346 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e3f34-8584-4579-86f3-6f0e04503cea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:56.021656 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e3f34-8584-4579-86f3-6f0e04503cea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:56.023084 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e3f34-8584-4579-86f3-6f0e04503cea None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:56.036454 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 627/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:56.044700 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:56.158899 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa051c-7dd2-4df5-aca3-e11715a54664 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:56.195539 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb48cb-bf12-4968-9d6b-cb30b9feb1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:56.196235 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb48cb-bf12-4968-9d6b-cb30b9feb1e5 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:56.196518 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb48cb-bf12-4968-9d6b-cb30b9feb1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:56.196793 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb48cb-bf12-4968-9d6b-cb30b9feb1e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:56.197617 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb48cb-bf12-4968-9d6b-cb30b9feb1e5 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=6b4724ee840f4a18834f9dc2efde9f6d) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:56.197926 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb48cb-bf12-4968-9d6b-cb30b9feb1e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:56.199346 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb48cb-bf12-4968-9d6b-cb30b9feb1e5 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:56.205291 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 633/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:45:56 2022] GET /identity/v3/role_assignments?user.id=6b4724ee840f4a18834f9dc2efde9f6d&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:58.496172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94128c26-5fbb-4acb-b60a-499f812697af None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:58.497251 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94128c26-5fbb-4acb-b60a-499f812697af None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:58.497374 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94128c26-5fbb-4acb-b60a-499f812697af None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:58.498686 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 628/1261] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:58.503985 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51ed3-a8c0-4b9c-a4cf-d02a02b2a4ad None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:58.504437 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51ed3-a8c0-4b9c-a4cf-d02a02b2a4ad None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:58.504560 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51ed3-a8c0-4b9c-a4cf-d02a02b2a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:58.521755 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-79b51ed3-a8c0-4b9c-a4cf-d02a02b2a4ad None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:58.522939 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-79b51ed3-a8c0-4b9c-a4cf-d02a02b2a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:58.586137 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 634/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:45:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:45:58.608566 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94128c26-5fbb-4acb-b60a-499f812697af None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:58.705576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94128c26-5fbb-4acb-b60a-499f812697af None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:58.738333 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d01d0-1e34-4430-8119-3a219e2a4dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:58.739128 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d01d0-1e34-4430-8119-3a219e2a4dee None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:58.739412 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d01d0-1e34-4430-8119-3a219e2a4dee None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:58.739693 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d01d0-1e34-4430-8119-3a219e2a4dee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:58.751587 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d01d0-1e34-4430-8119-3a219e2a4dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-260d01d0-1e34-4430-8119-3a219e2a4dee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:45:58.759362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:58.760853 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:58.762017 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 629/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:58.767612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b51ed3-a8c0-4b9c-a4cf-d02a02b2a4ad None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:58.876401 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b51ed3-a8c0-4b9c-a4cf-d02a02b2a4ad None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:58.908918 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:58.909578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:58.909862 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:58.910139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:58.910881 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:58.911190 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:58.912593 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:58.921309 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 635/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:58.927189 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d01d0-1e34-4430-8119-3a219e2a4dee None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:59.025672 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d01d0-1e34-4430-8119-3a219e2a4dee None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:59.058197 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:59.059890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:59.060313 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:59.060599 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:59.070790 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:59.072268 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:59.088952 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:59.090803 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:59.092427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:59.092427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:59.092427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:59.092427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:59.092427 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 630/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:59.096546 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:59.200101 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359cce-fae0-4cc2-b519-206fc93ae3b3 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:59.236507 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:59.237161 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:59.237448 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:59.237729 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:59.238441 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:59.238748 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:59.240139 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:59.251690 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 636/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:59.257383 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:59.352967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6010-e45f-4831-8d9d-3c2e1391a550 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:59.386019 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:59.386818 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:59.387960 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:59.388338 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:59.396274 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:59.397709 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:45:59.411584 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:59.412720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:59.414061 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 631/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:59.418526 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:59.515253 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f347af-fa4e-4ab6-be3f-619f0c3e4618 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:59.547872 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:59.548531 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:59.548816 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:59.549092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] PATH_INFO: `/v3/users` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:59.549928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:59.550237 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:59.551669 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:59.568807 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 637/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:45:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:59.574435 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:59.668074 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ed08-cae2-4bdc-abe3-10db5670b8d8 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:59.700947 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:59.701733 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:59.702021 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:59.702299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:59.712355 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:59.713796 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:59.730165 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:59.731993 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:59.733284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:59.733284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:59.733284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:59.733284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:45:59.733284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 632/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:45:59.737882 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:59.846270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a5e52-33dc-4c30-b76f-af9831042543 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:59.879370 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:59.880056 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:59.880350 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:59.880699 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:59.881417 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:59.881726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:59.883098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:59.894160 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 638/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:59.899842 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:59.995273 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc555e99-e5a0-4743-a787-5349338e1410 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:00.026781 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:00.027561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:00.028468 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:00.028746 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:00.035112 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:00.036549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:46:00.050956 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:00.052396 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:46:00.053774 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 633/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:00.057979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:00.155066 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f803e5-960b-4244-a5d6-936b1a4db3d4 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:00.189578 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c3537-f374-405b-bb2c-d652e1b4a703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:00.190247 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c3537-f374-405b-bb2c-d652e1b4a703 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:00.190530 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c3537-f374-405b-bb2c-d652e1b4a703 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:00.190804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c3537-f374-405b-bb2c-d652e1b4a703 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:00.191591 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c3537-f374-405b-bb2c-d652e1b4a703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:00.191937 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c3537-f374-405b-bb2c-d652e1b4a703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:00.193481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c3537-f374-405b-bb2c-d652e1b4a703 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:00.205884 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 639/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:00.211820 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:00.305725 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026642b-04f2-419a-8e65-c4744868ed16 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:00.337713 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7886-1988-4ae3-893c-dd9e777056fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:00.338581 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7886-1988-4ae3-893c-dd9e777056fa None admin] REQUEST_METHOD: `PUT` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:00.338862 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7886-1988-4ae3-893c-dd9e777056fa None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:00.339167 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7886-1988-4ae3-893c-dd9e777056fa None admin] PATH_INFO: `/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/6b4724ee840f4a18834f9dc2efde9f6d/roles/9ee7046af4834acdb496c02bc9ee597f` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:00.341736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b7886-1988-4ae3-893c-dd9e777056fa None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4d0d0951674dffa2c51d4b07060ce6, user_id=6b4724ee840f4a18834f9dc2efde9f6d, role_id=9ee7046af4834acdb496c02bc9ee597f)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:00.343145 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b7886-1988-4ae3-893c-dd9e777056fa None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:00.355088 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 634/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Mon May 9 15:46:00 2022] PUT /identity/v3/projects/0e4d0d0951674dffa2c51d4b07060ce6/users/6b4724ee840f4a18834f9dc2efde9f6d/roles/9ee7046af4834acdb496c02bc9ee597f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:02.581911 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0f34-eb28-42c9-8309-3068c7255dfc None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.582494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0f34-eb28-42c9-8309-3068c7255dfc None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.582494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c0f34-eb28-42c9-8309-3068c7255dfc None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.584027 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 640/1274] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:02.589221 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ac8e-f564-4102-810b-4d117a2679f6 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.589629 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ac8e-f564-4102-810b-4d117a2679f6 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.589780 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ac8e-f564-4102-810b-4d117a2679f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.606664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-b510ac8e-f564-4102-810b-4d117a2679f6 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:02.607886 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-b510ac8e-f564-4102-810b-4d117a2679f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:02.671508 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 635/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:46:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:46:02.695388 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0f34-eb28-42c9-8309-3068c7255dfc None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:02.806495 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c0f34-eb28-42c9-8309-3068c7255dfc None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:02.839341 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a536f-1649-45bc-890f-6b9ce00e8899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:02.840648 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a536f-1649-45bc-890f-6b9ce00e8899 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.840938 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a536f-1649-45bc-890f-6b9ce00e8899 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.841227 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a536f-1649-45bc-890f-6b9ce00e8899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.851047 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a536f-1649-45bc-890f-6b9ce00e8899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-ad3a536f-1649-45bc-890f-6b9ce00e8899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:02.859509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:02.860860 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:02.862250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 641/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Mon May 9 15:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:02.867008 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ac8e-f564-4102-810b-4d117a2679f6 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:02.962521 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ac8e-f564-4102-810b-4d117a2679f6 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:02.997692 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:02.998367 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.998653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.998934 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] PATH_INFO: `/v3/roles` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.999685 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] RBAC: Adding query filter params (name=admin) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:03.000025 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.001403 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.009284 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 636/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Mon May 9 15:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:03.015509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a536f-1649-45bc-890f-6b9ce00e8899 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.113900 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a536f-1649-45bc-890f-6b9ce00e8899 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.145725 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.146508 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.146795 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.147075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.158625 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.160132 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:46:03.177696 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:03.178992 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:03.180551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:46:03.180551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:46:03.180551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:46:03.180551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:03.180551 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 642/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:03.185217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.283850 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd26d6-3ed0-47a8-a678-40cbb6d2562c None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.316670 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.317327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.317611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.317890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] PATH_INFO: `/v3/domains` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.318616 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:03.318923 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.320326 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.332728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 637/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:03.338487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.435572 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dcbd0-9fc3-4f61-92bc-82dbf0e4217a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.468053 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.468841 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.469132 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.469407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] PATH_INFO: `/v3/users/placement` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.476584 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.478019 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:46:03.492493 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:03.493765 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:03.495270 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 643/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:03.499673 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.595119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e4810-d62e-45e9-a727-b43a062b2504 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.627547 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.628237 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.628519 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.628795 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] PATH_INFO: `/v3/users` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.629630 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:03.629941 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.631361 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.648196 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 638/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:03.653857 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.751128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48285482-f896-484d-9f66-eb5adb8cd76d None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.792906 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beed69a-f1d7-4118-8268-9dd1af1c6598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.794192 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed69a-f1d7-4118-8268-9dd1af1c6598 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.794477 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed69a-f1d7-4118-8268-9dd1af1c6598 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.794758 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed69a-f1d7-4118-8268-9dd1af1c6598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.859380 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beed69a-f1d7-4118-8268-9dd1af1c6598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.860871 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beed69a-f1d7-4118-8268-9dd1af1c6598 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.954372 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 644/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:46:03.960197 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.054623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e7479-744b-4dcc-9373-88a452e994eb None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.087226 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.088039 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.088327 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.088604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.099297 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.100753 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:46:04.117601 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:04.123576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:04.124978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:46:04.124978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:46:04.124978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:46:04.124978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:46:04.124978 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 639/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:04.125330 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beed69a-f1d7-4118-8268-9dd1af1c6598 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.232638 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beed69a-f1d7-4118-8268-9dd1af1c6598 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.265257 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.265914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.266200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.266478 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] PATH_INFO: `/v3/domains` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.267221 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:04.267524 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.268928 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.280612 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 645/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.286294 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.381546 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227365e-c944-4c68-b430-b6926b2eeef1 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.413902 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.414685 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.414971 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.415248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.421777 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.423217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:46:04.437633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application with Lock( May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:04.438838 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: ERROR keystone.server.flask.application May 09 15:46:04.440336 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 640/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:04.444506 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.539469 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ec8b-fd0a-4f12-8327-1cc89eb9b95b None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.571306 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f61f3-75c8-499e-b453-6e01e2476fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.571976 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f61f3-75c8-499e-b453-6e01e2476fe3 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.572263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f61f3-75c8-499e-b453-6e01e2476fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.572540 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f61f3-75c8-499e-b453-6e01e2476fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.573314 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f61f3-75c8-499e-b453-6e01e2476fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:04.573624 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f61f3-75c8-499e-b453-6e01e2476fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.575115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f61f3-75c8-499e-b453-6e01e2476fe3 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.586618 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 646/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.593101 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.691056 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c419d47-bee5-45b8-ac2a-145c2bcf44c0 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.722973 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c36f5f-9dfb-49c5-9867-703c524423c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.723623 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36f5f-9dfb-49c5-9867-703c524423c6 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.723937 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36f5f-9dfb-49c5-9867-703c524423c6 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.724217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36f5f-9dfb-49c5-9867-703c524423c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.725048 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36f5f-9dfb-49c5-9867-703c524423c6 None admin] RBAC: Adding query filter params (role.id=9ee7046af4834acdb496c02bc9ee597f, scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6, user.id=6b4724ee840f4a18834f9dc2efde9f6d) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:04.725363 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36f5f-9dfb-49c5-9867-703c524423c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.726794 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36f5f-9dfb-49c5-9867-703c524423c6 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.733116 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 641/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/role_assignments?user.id=6b4724ee840f4a18834f9dc2efde9f6d&scope.project.id=0e4d0d0951674dffa2c51d4b07060ce6&role.id=9ee7046af4834acdb496c02bc9ee597f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:07.009745 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2b63-ebd5-4750-a83c-5ef7e7565a89 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:07.010326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2b63-ebd5-4750-a83c-5ef7e7565a89 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:07.010326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2b63-ebd5-4750-a83c-5ef7e7565a89 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:07.011672 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 647/1288] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:07.017837 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933f5b-71fd-4751-99f2-6d7dc280be82 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:07.018276 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933f5b-71fd-4751-99f2-6d7dc280be82 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:07.018388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89933f5b-71fd-4751-99f2-6d7dc280be82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:07.035714 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-89933f5b-71fd-4751-99f2-6d7dc280be82 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:07.036932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-89933f5b-71fd-4751-99f2-6d7dc280be82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:07.100996 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 642/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:46:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:46:07.123592 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2b63-ebd5-4750-a83c-5ef7e7565a89 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:07.221355 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2b63-ebd5-4750-a83c-5ef7e7565a89 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:07.254721 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:07.255509 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:07.255815 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:07.256095 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] PATH_INFO: `/v3/services/placement` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:07.256747 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:07.258122 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:07.270063 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:07.271498 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:07.272766 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 648/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:46:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:07.277251 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89933f5b-71fd-4751-99f2-6d7dc280be82 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:07.373422 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89933f5b-71fd-4751-99f2-6d7dc280be82 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:07.405528 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d8eae-c35b-4c48-89ad-83f890c0ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:07.406183 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8eae-c35b-4c48-89ad-83f890c0ca80 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:07.406469 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8eae-c35b-4c48-89ad-83f890c0ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:07.406748 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8eae-c35b-4c48-89ad-83f890c0ca80 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:07.407457 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d8eae-c35b-4c48-89ad-83f890c0ca80 None admin] RBAC: Adding query filter params (name=placement) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:07.407795 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d8eae-c35b-4c48-89ad-83f890c0ca80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:07.409153 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d8eae-c35b-4c48-89ad-83f890c0ca80 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:07.413791 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 643/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:46:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:07.419914 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:07.515604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74443b8f-a076-45bc-8c25-994500d4966a None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:07.547026 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc035c-d4ac-4359-98d6-1701ed7cbb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:07.547616 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc035c-d4ac-4359-98d6-1701ed7cbb7a None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:07.547932 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc035c-d4ac-4359-98d6-1701ed7cbb7a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:07.548210 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc035c-d4ac-4359-98d6-1701ed7cbb7a None admin] PATH_INFO: `/v3/services` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:07.548907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc035c-d4ac-4359-98d6-1701ed7cbb7a None admin] RBAC: Adding query filter params (type=placement) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:07.549212 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc035c-d4ac-4359-98d6-1701ed7cbb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:07.550575 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc035c-d4ac-4359-98d6-1701ed7cbb7a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:07.554804 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 649/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:46:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:09.823065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9b70-b51f-4076-a4d2-a73ae38276bc None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.823660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9b70-b51f-4076-a4d2-a73ae38276bc None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.823660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b9b70-b51f-4076-a4d2-a73ae38276bc None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.825720 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 644/1293] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:09.831082 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951ca82-371d-4b5f-9e5d-1e9c668bd571 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.831494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951ca82-371d-4b5f-9e5d-1e9c668bd571 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.831647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951ca82-371d-4b5f-9e5d-1e9c668bd571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.848339 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-1951ca82-371d-4b5f-9e5d-1e9c668bd571 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:09.849543 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-1951ca82-371d-4b5f-9e5d-1e9c668bd571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:09.914654 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 650/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:46:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:46:09.937974 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b9b70-b51f-4076-a4d2-a73ae38276bc None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.034951 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b9b70-b51f-4076-a4d2-a73ae38276bc None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.067655 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a701d96-d79d-4d3a-bd00-d3f50e9b4304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.068334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a701d96-d79d-4d3a-bd00-d3f50e9b4304 None admin] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.068617 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a701d96-d79d-4d3a-bd00-d3f50e9b4304 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.068890 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a701d96-d79d-4d3a-bd00-d3f50e9b4304 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.069614 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a701d96-d79d-4d3a-bd00-d3f50e9b4304 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.070967 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a701d96-d79d-4d3a-bd00-d3f50e9b4304 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.084633 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 645/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Mon May 9 15:46:09 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:46:12.389193 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3a26-a1c4-4e55-b624-eb7ce1f1cfb1 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:12.389785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3a26-a1c4-4e55-b624-eb7ce1f1cfb1 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:12.389785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3a26-a1c4-4e55-b624-eb7ce1f1cfb1 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:12.391131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 651/1296] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:12.396718 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99983b6-e872-4833-a5f7-0c079e233c6a None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:12.397192 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99983b6-e872-4833-a5f7-0c079e233c6a None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:12.397319 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99983b6-e872-4833-a5f7-0c079e233c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:12.416726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-b99983b6-e872-4833-a5f7-0c079e233c6a None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:12.418295 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-b99983b6-e872-4833-a5f7-0c079e233c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:12.511068 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 646/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:46:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:46:12.540936 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c3a26-a1c4-4e55-b624-eb7ce1f1cfb1 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:12.657785 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c3a26-a1c4-4e55-b624-eb7ce1f1cfb1 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:12.693077 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:12.693880 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:12.694175 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:12.694455 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] PATH_INFO: `/v3/services/placement` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:12.695110 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:12.696524 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:12.708764 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:12.710741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:12.712601 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 652/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:46:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:12.716866 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99983b6-e872-4833-a5f7-0c079e233c6a None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:12.827387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99983b6-e872-4833-a5f7-0c079e233c6a None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:12.860741 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:12.861408 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:12.861695 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:12.861977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:12.862692 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] RBAC: Adding query filter params (name=placement) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:12.863002 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:12.864419 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:12.869604 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 647/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:46:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:12.876412 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:12.975642 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66bd4f-efbc-4c66-babf-5722f99c4458 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:13.007590 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d558d-0141-4b31-ad6e-b7eec562b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:13.008275 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d558d-0141-4b31-ad6e-b7eec562b527 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:13.008562 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d558d-0141-4b31-ad6e-b7eec562b527 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:13.008842 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d558d-0141-4b31-ad6e-b7eec562b527 None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:13.009630 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d558d-0141-4b31-ad6e-b7eec562b527 None admin] RBAC: Adding query filter params (interface=public, service_id=18832332dcb0413c8fb1d303d1233c60, region_id=RegionOne) {{(pid=275842) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:13.009949 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d558d-0141-4b31-ad6e-b7eec562b527 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:13.011322 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d558d-0141-4b31-ad6e-b7eec562b527 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:13.016959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 653/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Mon May 9 15:46:12 2022] GET /identity/v3/endpoints?service_id=18832332dcb0413c8fb1d303d1233c60&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:13.022615 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:13.119859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9778df-0b0c-4d05-8d15-efcc91f96048 None admin] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:13.153736 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc28045-28c3-42b0-ad44-7dda32148f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:13.154399 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28045-28c3-42b0-ad44-7dda32148f25 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:13.154683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28045-28c3-42b0-ad44-7dda32148f25 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:13.154959 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28045-28c3-42b0-ad44-7dda32148f25 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:13.155641 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc28045-28c3-42b0-ad44-7dda32148f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:13.157042 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc28045-28c3-42b0-ad44-7dda32148f25 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:13.163840 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 648/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Mon May 9 15:46:13 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:46:15.399092 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54c78-3dc8-4003-b911-3136483b84fc None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.399668 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54c78-3dc8-4003-b911-3136483b84fc None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.399668 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54c78-3dc8-4003-b911-3136483b84fc None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.401075 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 654/1302] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:15.406660 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ac7-1a35-4bce-8075-38cc22a13d0c None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.407043 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ac7-1a35-4bce-8075-38cc22a13d0c None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.407228 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ac7-1a35-4bce-8075-38cc22a13d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.424247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-693e8ac7-1a35-4bce-8075-38cc22a13d0c None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:15.425374 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-693e8ac7-1a35-4bce-8075-38cc22a13d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:15.489142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 649/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:46:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:46:15.513184 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb54c78-3dc8-4003-b911-3136483b84fc None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.611986 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb54c78-3dc8-4003-b911-3136483b84fc None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.644211 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.644999 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.645282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.645564 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] PATH_INFO: `/v3/services/placement` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.646209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.647577 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:15.659559 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:15.661098 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application with Lock( May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: ERROR keystone.server.flask.application May 09 15:46:15.662358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 655/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Mon May 9 15:46:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:15.666822 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8ac7-1a35-4bce-8075-38cc22a13d0c None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.763371 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8ac7-1a35-4bce-8075-38cc22a13d0c None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.796745 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89805b-408b-4e52-8a02-022aa359dd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.797405 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89805b-408b-4e52-8a02-022aa359dd84 None admin] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.797688 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89805b-408b-4e52-8a02-022aa359dd84 None admin] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.797963 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89805b-408b-4e52-8a02-022aa359dd84 None admin] PATH_INFO: `/v3/services` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.798671 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89805b-408b-4e52-8a02-022aa359dd84 None admin] RBAC: Adding query filter params (name=placement) {{(pid=275843) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:15.798982 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89805b-408b-4e52-8a02-022aa359dd84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.800373 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89805b-408b-4e52-8a02-022aa359dd84 None admin] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.805405 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 650/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Mon May 9 15:46:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:15.811907 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.907236 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52df664-87f7-473d-81a0-37e3e4dda676 None admin] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.939821 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eb4ee-fd71-4ac9-ac70-3bd959f9e75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57514b8d78af4c4d8d5b1768815c9e7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.940470 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eb4ee-fd71-4ac9-ac70-3bd959f9e75a None admin] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.940757 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eb4ee-fd71-4ac9-ac70-3bd959f9e75a None admin] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.941033 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eb4ee-fd71-4ac9-ac70-3bd959f9e75a None admin] PATH_INFO: `/v3/endpoints` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.941762 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eb4ee-fd71-4ac9-ac70-3bd959f9e75a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.943207 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eb4ee-fd71-4ac9-ac70-3bd959f9e75a None admin] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.961258 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 656/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Mon May 9 15:46:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:23.342436 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159976-26d0-4ba5-911f-cdbc02506d8e None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.343563 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159976-26d0-4ba5-911f-cdbc02506d8e None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.344124 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159976-26d0-4ba5-911f-cdbc02506d8e None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.351297 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4d7b1-a97e-4696-a4eb-aa7569985c48 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.352263 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4d7b1-a97e-4696-a4eb-aa7569985c48 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.352775 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4d7b1-a97e-4696-a4eb-aa7569985c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.356151 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 651/1307] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:23 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:23.429015 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-2ed4d7b1-a97e-4696-a4eb-aa7569985c48 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:23.430699 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-2ed4d7b1-a97e-4696-a4eb-aa7569985c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:23.583020 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 657/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:47:23.662193 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a57e2-d940-460a-8fa3-a21bef87ce04 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.662896 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a57e2-d940-460a-8fa3-a21bef87ce04 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.663416 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a57e2-d940-460a-8fa3-a21bef87ce04 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.665451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 652/1309] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 9 15:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:23.672539 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f982701-7f57-41c2-bc70-2d2f4cfa0f75 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.673185 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f982701-7f57-41c2-bc70-2d2f4cfa0f75 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.673686 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f982701-7f57-41c2-bc70-2d2f4cfa0f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.839043 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-1f982701-7f57-41c2-bc70-2d2f4cfa0f75 None None] MFA Rules not processed for user `1516366a4e824577a524f49e0eda8880`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:23.841642 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-1f982701-7f57-41c2-bc70-2d2f4cfa0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:23.975943 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 658/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 9 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:23.985201 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a57e2-d940-460a-8fa3-a21bef87ce04 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.987400 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-420a57e2-d940-460a-8fa3-a21bef87ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:24.186081 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a57e2-d940-460a-8fa3-a21bef87ce04 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.266234 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08392d81-d724-4c59-97cc-1b8cacca8900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.267317 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08392d81-d724-4c59-97cc-1b8cacca8900 service neutron] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.267849 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08392d81-d724-4c59-97cc-1b8cacca8900 service neutron] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.268370 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08392d81-d724-4c59-97cc-1b8cacca8900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.270238 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-08392d81-d724-4c59-97cc-1b8cacca8900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:24.464489 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08392d81-d724-4c59-97cc-1b8cacca8900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.467698 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08392d81-d724-4c59-97cc-1b8cacca8900 service neutron] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.492578 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 653/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:27.344045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4406-8692-4090-80e7-1bc36e07497c None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.345045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4406-8692-4090-80e7-1bc36e07497c None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.345734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4406-8692-4090-80e7-1bc36e07497c None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.348991 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 659/1312] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:27.353185 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a539c1-eddd-414a-9c21-8b4b2c3bc0c2 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.354238 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a539c1-eddd-414a-9c21-8b4b2c3bc0c2 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.354754 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a539c1-eddd-414a-9c21-8b4b2c3bc0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.454932 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-52a539c1-eddd-414a-9c21-8b4b2c3bc0c2 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:27.456305 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-52a539c1-eddd-414a-9c21-8b4b2c3bc0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:27.562684 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 654/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:27.615611 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac85b8f-b4bc-4cf5-8fe4-0df84abbb093 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.615956 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac85b8f-b4bc-4cf5-8fe4-0df84abbb093 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.616351 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac85b8f-b4bc-4cf5-8fe4-0df84abbb093 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.618250 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 660/1314] 10.222.0.32 () {54 vars in 964 bytes} [Mon May 9 15:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:27.624999 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150c3f-407e-4728-b794-b3059a6e3a1a None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.625299 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150c3f-407e-4728-b794-b3059a6e3a1a None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.625577 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150c3f-407e-4728-b794-b3059a6e3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.711119 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-82150c3f-407e-4728-b794-b3059a6e3a1a None None] MFA Rules not processed for user `1516366a4e824577a524f49e0eda8880`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:27.714248 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-82150c3f-407e-4728-b794-b3059a6e3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:27.794287 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 655/1315] 10.222.0.32 () {58 vars in 1061 bytes} [Mon May 9 15:47:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:27.803585 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac85b8f-b4bc-4cf5-8fe4-0df84abbb093 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.805245 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-bac85b8f-b4bc-4cf5-8fe4-0df84abbb093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:27.910131 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac85b8f-b4bc-4cf5-8fe4-0df84abbb093 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:27.989472 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026ff05-5097-4343-b13a-08dc2ca13763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:27.990144 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026ff05-5097-4343-b13a-08dc2ca13763 service neutron] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.990430 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026ff05-5097-4343-b13a-08dc2ca13763 service neutron] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.990712 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026ff05-5097-4343-b13a-08dc2ca13763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.992398 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-a026ff05-5097-4343-b13a-08dc2ca13763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:28.113200 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026ff05-5097-4343-b13a-08dc2ca13763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.114583 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026ff05-5097-4343-b13a-08dc2ca13763 service neutron] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.133945 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 661/1316] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:31.017859 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35757f3-6239-4f59-9e84-8b0f5cc613d7 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.018448 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35757f3-6239-4f59-9e84-8b0f5cc613d7 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.018448 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35757f3-6239-4f59-9e84-8b0f5cc613d7 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.019836 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 656/1317] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:31.025115 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235474e-4504-407b-979f-ca923f9d0c11 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.025558 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235474e-4504-407b-979f-ca923f9d0c11 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.025682 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235474e-4504-407b-979f-ca923f9d0c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.090515 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-5235474e-4504-407b-979f-ca923f9d0c11 None None] MFA Rules not processed for user `d45befe87ee147b2ae291802a76a5ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:31.091733 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-5235474e-4504-407b-979f-ca923f9d0c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:31.185942 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 662/1318] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:31.226152 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35757f3-6239-4f59-9e84-8b0f5cc613d7 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:31.227680 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-c35757f3-6239-4f59-9e84-8b0f5cc613d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:31.331178 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35757f3-6239-4f59-9e84-8b0f5cc613d7 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:31.404636 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110145e4-f360-4854-a3d8-39177b01bc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:31.405285 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110145e4-f360-4854-a3d8-39177b01bc4b service neutron] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.405573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110145e4-f360-4854-a3d8-39177b01bc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.405856 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110145e4-f360-4854-a3d8-39177b01bc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.407503 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-110145e4-f360-4854-a3d8-39177b01bc4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:31.515876 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110145e4-f360-4854-a3d8-39177b01bc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:31.517362 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110145e4-f360-4854-a3d8-39177b01bc4b service neutron] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:31.534905 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 657/1319] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:34.438129 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1879662-dcb3-4ec6-a7f8-e22933947920 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.438667 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1879662-dcb3-4ec6-a7f8-e22933947920 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.438667 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1879662-dcb3-4ec6-a7f8-e22933947920 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.440103 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 663/1320] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:34.445232 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357972-0026-40f9-af4b-e72b758af89a None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.445689 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357972-0026-40f9-af4b-e72b758af89a None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.445810 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6357972-0026-40f9-af4b-e72b758af89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.513786 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-a6357972-0026-40f9-af4b-e72b758af89a None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:34.515011 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-a6357972-0026-40f9-af4b-e72b758af89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:34.608020 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 658/1321] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:34.647254 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1879662-dcb3-4ec6-a7f8-e22933947920 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.648833 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-a1879662-dcb3-4ec6-a7f8-e22933947920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:34.748741 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1879662-dcb3-4ec6-a7f8-e22933947920 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.820096 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15e791-be78-4566-a97f-9fd93d8e21f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.820754 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e791-be78-4566-a97f-9fd93d8e21f8 service neutron] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.821043 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e791-be78-4566-a97f-9fd93d8e21f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.821326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15e791-be78-4566-a97f-9fd93d8e21f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.822973 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-da15e791-be78-4566-a97f-9fd93d8e21f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:34.929727 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15e791-be78-4566-a97f-9fd93d8e21f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.931161 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15e791-be78-4566-a97f-9fd93d8e21f8 service neutron] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.949391 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 664/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:37.961646 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819b21-0c9a-4d8d-8ccc-9ed474c252de None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:37.962222 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819b21-0c9a-4d8d-8ccc-9ed474c252de None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:37.962222 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819b21-0c9a-4d8d-8ccc-9ed474c252de None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:37.963690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 659/1323] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:37.970046 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88169e-fd88-4265-afe3-86d61005372f None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:37.970544 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88169e-fd88-4265-afe3-86d61005372f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:37.970734 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88169e-fd88-4265-afe3-86d61005372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.034886 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-ff88169e-fd88-4265-afe3-86d61005372f None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:38.036105 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-ff88169e-fd88-4265-afe3-86d61005372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:38.132994 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 665/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:38.169035 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819b21-0c9a-4d8d-8ccc-9ed474c252de None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:38.170666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-e2819b21-0c9a-4d8d-8ccc-9ed474c252de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:38.274679 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819b21-0c9a-4d8d-8ccc-9ed474c252de None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:38.347240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f28ebf-1602-4f13-9ec9-a378c416548f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:38.347926 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28ebf-1602-4f13-9ec9-a378c416548f service neutron] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.348217 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28ebf-1602-4f13-9ec9-a378c416548f service neutron] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.348498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f28ebf-1602-4f13-9ec9-a378c416548f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.350130 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-82f28ebf-1602-4f13-9ec9-a378c416548f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:38.458726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f28ebf-1602-4f13-9ec9-a378c416548f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:38.460202 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f28ebf-1602-4f13-9ec9-a378c416548f service neutron] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:38.478730 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 660/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:40.791746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd13d9-8c44-440f-9580-d8d142f3df8e None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.792830 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd13d9-8c44-440f-9580-d8d142f3df8e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.793054 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd13d9-8c44-440f-9580-d8d142f3df8e None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.794511 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 666/1326] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:40.800515 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1616ac-ba53-45ca-a592-206e2a58090e None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.801002 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1616ac-ba53-45ca-a592-206e2a58090e None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.801114 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1616ac-ba53-45ca-a592-206e2a58090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.870879 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-5c1616ac-ba53-45ca-a592-206e2a58090e None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:40.872247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-5c1616ac-ba53-45ca-a592-206e2a58090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:40.974545 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 661/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:47:41.009642 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd13d9-8c44-440f-9580-d8d142f3df8e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.011666 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-c7fd13d9-8c44-440f-9580-d8d142f3df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:41.118085 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd13d9-8c44-440f-9580-d8d142f3df8e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.193062 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30015af-2993-43a2-9031-0399a6d6ad34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.193723 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30015af-2993-43a2-9031-0399a6d6ad34 service neutron] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.194007 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30015af-2993-43a2-9031-0399a6d6ad34 service neutron] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.194282 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30015af-2993-43a2-9031-0399a6d6ad34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.196015 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-b30015af-2993-43a2-9031-0399a6d6ad34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:41.303194 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30015af-2993-43a2-9031-0399a6d6ad34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.304604 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30015af-2993-43a2-9031-0399a6d6ad34 service neutron] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.323009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 667/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:43.632576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9d9e1-0154-4b3e-bbca-46f449922537 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.633180 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9d9e1-0154-4b3e-bbca-46f449922537 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.633180 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9d9e1-0154-4b3e-bbca-46f449922537 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.634518 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 662/1329] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:43.640337 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb10df6-2988-4018-a3ca-ebfc46f78090 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.640737 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb10df6-2988-4018-a3ca-ebfc46f78090 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.640898 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb10df6-2988-4018-a3ca-ebfc46f78090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.704418 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-0fb10df6-2988-4018-a3ca-ebfc46f78090 None None] MFA Rules not processed for user `d45befe87ee147b2ae291802a76a5ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:43.705631 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-0fb10df6-2988-4018-a3ca-ebfc46f78090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:43.801959 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 668/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:43.839579 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9d9e1-0154-4b3e-bbca-46f449922537 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:43.841134 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-79c9d9e1-0154-4b3e-bbca-46f449922537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:43.942953 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9d9e1-0154-4b3e-bbca-46f449922537 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:44.013648 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17da2a-4cbb-46c4-832d-1ed6d5f244bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:44.014292 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17da2a-4cbb-46c4-832d-1ed6d5f244bb service neutron] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:44.014576 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17da2a-4cbb-46c4-832d-1ed6d5f244bb service neutron] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:44.014861 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17da2a-4cbb-46c4-832d-1ed6d5f244bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:44.016517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-9f17da2a-4cbb-46c4-832d-1ed6d5f244bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:44.127435 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17da2a-4cbb-46c4-832d-1ed6d5f244bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:44.128917 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17da2a-4cbb-46c4-832d-1ed6d5f244bb service neutron] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:44.146726 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 663/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:46.697752 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452702-48e7-4f85-b272-05ecb849d167 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:46.698963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452702-48e7-4f85-b272-05ecb849d167 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:46.698963 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee452702-48e7-4f85-b272-05ecb849d167 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:46.700326 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 669/1332] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:46.705492 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5282-7565-42ae-bcfd-f1e210561603 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:46.705933 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5282-7565-42ae-bcfd-f1e210561603 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:46.706052 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5282-7565-42ae-bcfd-f1e210561603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:46.768638 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-d69b5282-7565-42ae-bcfd-f1e210561603 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:46.769842 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-d69b5282-7565-42ae-bcfd-f1e210561603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:46.863906 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 664/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:47:46.898841 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452702-48e7-4f85-b272-05ecb849d167 None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:46.900397 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-ee452702-48e7-4f85-b272-05ecb849d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:47.001726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee452702-48e7-4f85-b272-05ecb849d167 None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:47.074358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84caeb52-a165-40d1-924c-40050a39b49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:47.075011 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caeb52-a165-40d1-924c-40050a39b49f service neutron] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:47.075298 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caeb52-a165-40d1-924c-40050a39b49f service neutron] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:47.075574 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84caeb52-a165-40d1-924c-40050a39b49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:47.077252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-84caeb52-a165-40d1-924c-40050a39b49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:47.186494 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caeb52-a165-40d1-924c-40050a39b49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:47.187983 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84caeb52-a165-40d1-924c-40050a39b49f service neutron] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:47.206573 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 670/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:49.487148 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f68472-fd80-4eff-9465-ee5a8f1ca2cf None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.487701 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f68472-fd80-4eff-9465-ee5a8f1ca2cf None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.487701 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f68472-fd80-4eff-9465-ee5a8f1ca2cf None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.489172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 665/1335] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:49.494527 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864198f9-5f00-402b-a3a0-b1c9012c4ee1 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.495593 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864198f9-5f00-402b-a3a0-b1c9012c4ee1 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.496232 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864198f9-5f00-402b-a3a0-b1c9012c4ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.560682 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-864198f9-5f00-402b-a3a0-b1c9012c4ee1 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:49.561912 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-864198f9-5f00-402b-a3a0-b1c9012c4ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:49.657009 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 671/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:49.698256 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f68472-fd80-4eff-9465-ee5a8f1ca2cf None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:49.699812 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-c1f68472-fd80-4eff-9465-ee5a8f1ca2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:49.799561 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f68472-fd80-4eff-9465-ee5a8f1ca2cf None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:49.877026 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cbb6a-1b2c-463a-926a-4768d82e2c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:49.877683 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cbb6a-1b2c-463a-926a-4768d82e2c29 service neutron] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.877968 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cbb6a-1b2c-463a-926a-4768d82e2c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.878247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cbb6a-1b2c-463a-926a-4768d82e2c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.879921 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-c03cbb6a-1b2c-463a-926a-4768d82e2c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:49.988627 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cbb6a-1b2c-463a-926a-4768d82e2c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:49.990070 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cbb6a-1b2c-463a-926a-4768d82e2c29 service neutron] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:50.009750 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 666/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:52.681838 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497c8a-9d7c-4b20-9c28-ce31136d0bbf None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.682407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497c8a-9d7c-4b20-9c28-ce31136d0bbf None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.682407 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2497c8a-9d7c-4b20-9c28-ce31136d0bbf None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.684124 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 672/1338] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:52.689549 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887938-d8c6-4d61-832f-a88bb9050b3b None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.690003 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887938-d8c6-4d61-832f-a88bb9050b3b None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.690117 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01887938-d8c6-4d61-832f-a88bb9050b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.753666 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-01887938-d8c6-4d61-832f-a88bb9050b3b None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:52.754897 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-01887938-d8c6-4d61-832f-a88bb9050b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:52.853233 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 667/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:52.889000 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2497c8a-9d7c-4b20-9c28-ce31136d0bbf None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:52.890575 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-e2497c8a-9d7c-4b20-9c28-ce31136d0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:52.992845 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2497c8a-9d7c-4b20-9c28-ce31136d0bbf None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:53.064940 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4b9a-b366-4112-a9c5-f1496b21f8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:53.065586 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4b9a-b366-4112-a9c5-f1496b21f8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:53.065878 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4b9a-b366-4112-a9c5-f1496b21f8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:53.066160 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4b9a-b366-4112-a9c5-f1496b21f8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:53.067809 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-955e4b9a-b366-4112-a9c5-f1496b21f8f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:53.174849 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4b9a-b366-4112-a9c5-f1496b21f8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:53.176358 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4b9a-b366-4112-a9c5-f1496b21f8f5 service neutron] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:53.195535 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 673/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:47:57.936401 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e18ae-6f3b-4f60-8b54-46793e88635d None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.937250 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e18ae-6f3b-4f60-8b54-46793e88635d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.937545 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e18ae-6f3b-4f60-8b54-46793e88635d None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:57.939142 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 668/1341] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:57.944864 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78acfe-44fc-41ac-aee2-b39ca6f56ad8 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.945425 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78acfe-44fc-41ac-aee2-b39ca6f56ad8 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.945425 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78acfe-44fc-41ac-aee2-b39ca6f56ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.026978 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-ec78acfe-44fc-41ac-aee2-b39ca6f56ad8 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:58.028485 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-ec78acfe-44fc-41ac-aee2-b39ca6f56ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:58.143900 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 674/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:47:58.181223 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e18ae-6f3b-4f60-8b54-46793e88635d None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.184397 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-a17e18ae-6f3b-4f60-8b54-46793e88635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:58.297456 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e18ae-6f3b-4f60-8b54-46793e88635d None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.301147 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6018af-59d1-4557-83cf-b6d0172f341e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.301802 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6018af-59d1-4557-83cf-b6d0172f341e service neutron] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.302093 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6018af-59d1-4557-83cf-b6d0172f341e service neutron] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.302372 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6018af-59d1-4557-83cf-b6d0172f341e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.313239 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6018af-59d1-4557-83cf-b6d0172f341e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.314721 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6018af-59d1-4557-83cf-b6d0172f341e service neutron] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.325236 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 669/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:48:01.301406 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2808-109a-4ee6-9737-94305a2f938e None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.301979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2808-109a-4ee6-9737-94305a2f938e None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.301979 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d2808-109a-4ee6-9737-94305a2f938e None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.303335 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 675/1344] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:01.308911 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c478d4-7187-4cfe-b1fa-d38d9adc2443 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.309388 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c478d4-7187-4cfe-b1fa-d38d9adc2443 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.309611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c478d4-7187-4cfe-b1fa-d38d9adc2443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.337421 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-36c478d4-7187-4cfe-b1fa-d38d9adc2443 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:01.339271 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-36c478d4-7187-4cfe-b1fa-d38d9adc2443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:01.415847 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 670/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:48:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:01.453154 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d2808-109a-4ee6-9737-94305a2f938e None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:01.464044 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d2808-109a-4ee6-9737-94305a2f938e None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:01.467550 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65c229-467a-40f6-803c-96d9ea16396f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:01.468213 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c229-467a-40f6-803c-96d9ea16396f service neutron] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.468495 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c229-467a-40f6-803c-96d9ea16396f service neutron] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.468772 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65c229-467a-40f6-803c-96d9ea16396f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.477482 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65c229-467a-40f6-803c-96d9ea16396f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:01.479547 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65c229-467a-40f6-803c-96d9ea16396f service neutron] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:01.489015 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 676/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:48:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:48:06.232653 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81d00-7668-4be3-ab8d-c91ae780f9a1 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:06.233334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81d00-7668-4be3-ab8d-c91ae780f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:06.233334 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d81d00-7668-4be3-ab8d-c91ae780f9a1 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:06.234798 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 671/1347] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:06.240180 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5898a-388e-42fe-ab38-e3ea7fcaec49 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:06.240626 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5898a-388e-42fe-ab38-e3ea7fcaec49 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:06.240736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5898a-388e-42fe-ab38-e3ea7fcaec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:06.260499 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-08d5898a-388e-42fe-ab38-e3ea7fcaec49 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:06.261711 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-08d5898a-388e-42fe-ab38-e3ea7fcaec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:06.271113 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 677/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:06.311290 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d81d00-7668-4be3-ab8d-c91ae780f9a1 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:06.323439 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d81d00-7668-4be3-ab8d-c91ae780f9a1 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:06.326573 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0c3db-ccd9-4dcb-9bc2-e59aff96d350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1516366a4e824577a524f49e0eda8880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:06.327242 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c3db-ccd9-4dcb-9bc2-e59aff96d350 service neutron] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:06.327534 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c3db-ccd9-4dcb-9bc2-e59aff96d350 service neutron] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:06.327848 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c3db-ccd9-4dcb-9bc2-e59aff96d350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:06.337648 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0c3db-ccd9-4dcb-9bc2-e59aff96d350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:06.339674 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0c3db-ccd9-4dcb-9bc2-e59aff96d350 service neutron] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:06.349451 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 672/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:48:11.955935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc0de3-dedd-47f1-a786-fe029266eb8b None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.956801 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc0de3-dedd-47f1-a786-fe029266eb8b None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.957090 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc0de3-dedd-47f1-a786-fe029266eb8b None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.958935 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 678/1350] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:11.965512 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a521b3-74a6-431c-8270-acc494a4b134 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.965994 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a521b3-74a6-431c-8270-acc494a4b134 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.966085 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a521b3-74a6-431c-8270-acc494a4b134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:12.108690 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-b4a521b3-74a6-431c-8270-acc494a4b134 None None] MFA Rules not processed for user `6b4724ee840f4a18834f9dc2efde9f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:12.109977 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-b4a521b3-74a6-431c-8270-acc494a4b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:12.241240 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 673/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:48:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:48:16.901473 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d223e0c-b55b-49d3-ad5a-592294b86455 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:16.902128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d223e0c-b55b-49d3-ad5a-592294b86455 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:16.902128 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d223e0c-b55b-49d3-ad5a-592294b86455 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:16.904106 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 679/1352] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:16.909496 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfd70-0d1c-4118-be77-db904a997070 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:16.910378 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfd70-0d1c-4118-be77-db904a997070 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:16.910664 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfd70-0d1c-4118-be77-db904a997070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:16.930170 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-a54bfd70-0d1c-4118-be77-db904a997070 None None] MFA Rules not processed for user `6b4724ee840f4a18834f9dc2efde9f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:16.931626 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-a54bfd70-0d1c-4118-be77-db904a997070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:16.941079 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 674/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:48:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:18.597487 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac7ac7-47aa-41cf-ab7d-efe61b93a636 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:18.598036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac7ac7-47aa-41cf-ab7d-efe61b93a636 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:18.598036 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac7ac7-47aa-41cf-ab7d-efe61b93a636 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:18.599410 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 680/1354] 10.222.0.32 () {54 vars in 921 bytes} [Mon May 9 15:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:18.604878 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d63c6c-2365-48a8-a349-ae834792f06d None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:18.605308 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d63c6c-2365-48a8-a349-ae834792f06d None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:18.605609 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d63c6c-2365-48a8-a349-ae834792f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:18.623992 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-d6d63c6c-2365-48a8-a349-ae834792f06d None None] MFA Rules not processed for user `6b4724ee840f4a18834f9dc2efde9f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:18.625172 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-d6d63c6c-2365-48a8-a349-ae834792f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:18.633611 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 675/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Mon May 9 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:48:22.409792 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280bfd-b69e-4595-a92d-2921d2e17fa7 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:22.410389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280bfd-b69e-4595-a92d-2921d2e17fa7 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:22.410389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280bfd-b69e-4595-a92d-2921d2e17fa7 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:22.412625 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 681/1356] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:22.422083 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657962-88fa-4025-9327-f4a78b9e2b2f None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:22.422675 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657962-88fa-4025-9327-f4a78b9e2b2f None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:22.422799 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75657962-88fa-4025-9327-f4a78b9e2b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:22.442100 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-75657962-88fa-4025-9327-f4a78b9e2b2f None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:22.443677 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-75657962-88fa-4025-9327-f4a78b9e2b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:22.452826 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 676/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:22.502389 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71878c68-aac4-4764-bb18-20ba5f88f08a None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:22.502682 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71878c68-aac4-4764-bb18-20ba5f88f08a None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:22.502966 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71878c68-aac4-4764-bb18-20ba5f88f08a None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:22.504364 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 682/1358] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 9 15:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:22.509919 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f15f-ab6d-4fbe-b30b-75bd52fa84ff None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:22.510216 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f15f-ab6d-4fbe-b30b-75bd52fa84ff None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:22.510498 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559f15f-ab6d-4fbe-b30b-75bd52fa84ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:22.564734 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-2559f15f-ab6d-4fbe-b30b-75bd52fa84ff None None] MFA Rules not processed for user `8bc210c9b3f94f09b32127dc754a2094`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:22.565940 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-2559f15f-ab6d-4fbe-b30b-75bd52fa84ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:22.656415 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 677/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 9 15:48:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:22.666726 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71878c68-aac4-4764-bb18-20ba5f88f08a None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:22.683231 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71878c68-aac4-4764-bb18-20ba5f88f08a None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:22.689573 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5462-b1d9-4eb6-aa52-743a2ce3d19b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc210c9b3f94f09b32127dc754a2094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:22.690464 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5462-b1d9-4eb6-aa52-743a2ce3d19b service nova] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:22.690757 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5462-b1d9-4eb6-aa52-743a2ce3d19b service nova] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:22.691040 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5462-b1d9-4eb6-aa52-743a2ce3d19b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:22.700659 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab5462-b1d9-4eb6-aa52-743a2ce3d19b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:22.702402 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab5462-b1d9-4eb6-aa52-743a2ce3d19b service nova] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:22.712102 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 683/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:48:25.173783 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92515f72-3a24-4d58-b56b-1aec3ec872e9 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.174179 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92515f72-3a24-4d58-b56b-1aec3ec872e9 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.174286 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92515f72-3a24-4d58-b56b-1aec3ec872e9 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.175675 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 678/1361] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:25.181481 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39243acb-c589-4b16-8bea-8205d4c14662 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.182209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39243acb-c589-4b16-8bea-8205d4c14662 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.182209 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39243acb-c589-4b16-8bea-8205d4c14662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.200746 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-39243acb-c589-4b16-8bea-8205d4c14662 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:25.201951 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-39243acb-c589-4b16-8bea-8205d4c14662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:25.210143 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 684/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:25.254913 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92515f72-3a24-4d58-b56b-1aec3ec872e9 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:25.272728 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92515f72-3a24-4d58-b56b-1aec3ec872e9 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.278982 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370efb9-8fd5-4cac-9582-ace7f8bcdeab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc210c9b3f94f09b32127dc754a2094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.279662 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370efb9-8fd5-4cac-9582-ace7f8bcdeab service nova] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.280269 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370efb9-8fd5-4cac-9582-ace7f8bcdeab service nova] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.280531 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370efb9-8fd5-4cac-9582-ace7f8bcdeab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.289420 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370efb9-8fd5-4cac-9582-ace7f8bcdeab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.291199 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370efb9-8fd5-4cac-9582-ace7f8bcdeab service nova] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.301444 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 679/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:48:27.882835 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee873d-c07e-487f-8191-87bfe8390253 None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:27.883378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee873d-c07e-487f-8191-87bfe8390253 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:27.883378 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee873d-c07e-487f-8191-87bfe8390253 None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:27.884926 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 685/1364] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:27.890663 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697afd6-6b93-44bc-8500-28f5d5541776 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:27.891464 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697afd6-6b93-44bc-8500-28f5d5541776 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:27.891792 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697afd6-6b93-44bc-8500-28f5d5541776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:27.910667 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-5697afd6-6b93-44bc-8500-28f5d5541776 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:27.911926 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-5697afd6-6b93-44bc-8500-28f5d5541776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:27.923914 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 680/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:48:27.967252 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6607-29f8-423d-8b08-cfa9f000d42f None None] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:27.967628 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6607-29f8-423d-8b08-cfa9f000d42f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:27.967865 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6607-29f8-423d-8b08-cfa9f000d42f None None] PATH_INFO: `/` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:27.969369 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 686/1366] 10.222.0.32 () {54 vars in 961 bytes} [Mon May 9 15:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:27.975855 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd221f-e959-4ec1-ae6f-3594219b6c68 None None] REQUEST_METHOD: `POST` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:27.976438 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd221f-e959-4ec1-ae6f-3594219b6c68 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:27.976899 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd221f-e959-4ec1-ae6f-3594219b6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:27.996126 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.auth.core [None req-4bfd221f-e959-4ec1-ae6f-3594219b6c68 None None] MFA Rules not processed for user `8bc210c9b3f94f09b32127dc754a2094`. Rule list: `[]` (Enabled: `True`). {{(pid=275843) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:27.997613 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.fernet_utils [None req-4bfd221f-e959-4ec1-ae6f-3594219b6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275843) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:28.007632 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 681/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Mon May 9 15:48:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:28.017045 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c6607-29f8-423d-8b08-cfa9f000d42f None None] Authenticating user token {{(pid=275842) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:28.032897 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c6607-29f8-423d-8b08-cfa9f000d42f None None] Validating token access rules against request {{(pid=275842) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:28.039255 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fef948-e550-4bab-923c-ddd3aed1cf62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc210c9b3f94f09b32127dc754a2094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275842) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:28.040198 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef948-e550-4bab-923c-ddd3aed1cf62 service nova] REQUEST_METHOD: `GET` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:28.040503 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef948-e550-4bab-923c-ddd3aed1cf62 service nova] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:28.040760 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef948-e550-4bab-923c-ddd3aed1cf62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:28.050130 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fef948-e550-4bab-923c-ddd3aed1cf62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:28.051736 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fef948-e550-4bab-923c-ddd3aed1cf62 service nova] RBAC: Authorization granted {{(pid=275842) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:28.062571 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 687/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:48:29.092517 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3a1a-fb4e-442b-a875-828d9215a4d4 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:29.093064 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3a1a-fb4e-442b-a875-828d9215a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:29.093064 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf3a1a-fb4e-442b-a875-828d9215a4d4 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:29.094631 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 682/1369] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:29.099747 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa367-ab8e-4cde-bfbc-57bb8ace17f9 None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:29.100232 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa367-ab8e-4cde-bfbc-57bb8ace17f9 None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:29.100449 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fa367-ab8e-4cde-bfbc-57bb8ace17f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:29.119901 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-d23fa367-ab8e-4cde-bfbc-57bb8ace17f9 None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:29.121105 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-d23fa367-ab8e-4cde-bfbc-57bb8ace17f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:29.129540 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 688/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:30.389387 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f7f8-dc60-4437-88e5-1553ec6bda74 None None] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:30.390027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f7f8-dc60-4437-88e5-1553ec6bda74 None None] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:30.390027 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305f7f8-dc60-4437-88e5-1553ec6bda74 None None] PATH_INFO: `/` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:30.391264 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 683/1371] 10.222.0.32 () {54 vars in 926 bytes} [Mon May 9 15:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:30.397071 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae3619-e4bb-465d-8278-f6d6fbd8275f None None] REQUEST_METHOD: `POST` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:30.397617 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae3619-e4bb-465d-8278-f6d6fbd8275f None None] SCRIPT_NAME: `/identity` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:30.397788 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae3619-e4bb-465d-8278-f6d6fbd8275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=275842) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:30.417453 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.auth.core [None req-dcae3619-e4bb-465d-8278-f6d6fbd8275f None None] MFA Rules not processed for user `57514b8d78af4c4d8d5b1768815c9e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=275842) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:30.418647 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: DEBUG keystone.common.fernet_utils [None req-dcae3619-e4bb-465d-8278-f6d6fbd8275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=275842) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:30.426806 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: [pid: 275842|app: 0|req: 689/1372] 10.222.0.32 () {58 vars in 1023 bytes} [Mon May 9 15:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:48:30.482166 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305f7f8-dc60-4437-88e5-1553ec6bda74 None None] Authenticating user token {{(pid=275843) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:30.497775 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305f7f8-dc60-4437-88e5-1553ec6bda74 None None] Validating token access rules against request {{(pid=275843) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:30.503385 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4311873-5431-49a9-8ac1-4a65f6756285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc210c9b3f94f09b32127dc754a2094', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4d0d0951674dffa2c51d4b07060ce6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=275843) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:30.504065 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311873-5431-49a9-8ac1-4a65f6756285 service nova] REQUEST_METHOD: `GET` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:30.504355 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311873-5431-49a9-8ac1-4a65f6756285 service nova] SCRIPT_NAME: `/identity` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:30.504635 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311873-5431-49a9-8ac1-4a65f6756285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=275843) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:30.514069 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4311873-5431-49a9-8ac1-4a65f6756285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:30.515705 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4311873-5431-49a9-8ac1-4a65f6756285 service nova] RBAC: Authorization granted {{(pid=275843) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:30.526247 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: [pid: 275843|app: 0|req: 684/1373] 10.222.0.32 () {60 vars in 1365 bytes} [Mon May 9 15:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:48:59.780952 dv-cinder-841125-1-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 09 15:48:59.781142 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: Mon May 9 15:48:59 2022 - graceful shutdown triggered... May 09 15:48:59.781702 dv-cinder-841125-1-iscsi devstack@keystone.service[275842]: Gracefully killing worker 1 (pid: 275842)... May 09 15:48:59.782138 dv-cinder-841125-1-iscsi devstack@keystone.service[275843]: Gracefully killing worker 2 (pid: 275843)... May 09 15:49:00.782460 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: worker 1 buried after 1 seconds May 09 15:49:00.782460 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: worker 2 buried after 1 seconds May 09 15:49:00.782460 dv-cinder-841125-1-iscsi devstack@keystone.service[275828]: goodbye to uWSGI. May 09 15:49:00.784054 dv-cinder-841125-1-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 09 15:49:00.784597 dv-cinder-841125-1-iscsi systemd[1]: Stopped Devstack devstack@keystone.service.